2024-04-25T13:08:44.178 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T13:08:44.178 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468 --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} --verbose --name leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi --owner scheduled_leonidus@teuthology -- /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468/orig.config.yaml 2024-04-25T13:08:44.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T13:08:44.314 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} email: null first_in_suite: false job_id: '7673468' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 4d7908725372ec8e17504b848bfa122dd1d43386 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 4060 sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: 4d7908725372ec8e17504b848bfa122dd1d43386 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHN40TN02CFy16TIYygASZdCzCNdeQkDh4GqddIIZ287jmTGqraO2TBL7HUka/rSlKCcEEwg6W3lJLqETzdbRJY= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKZy4LXCxehu78tYMqjlOJPaioDsGf4zKFv9f4XShIUJlKtDMUwcfom9Gf15eDhO9WOi99hh12CaXLiXF9jv24Q= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - quiescer: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_12:17:05 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T13:08:44.315 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa; will attempt to use it 2024-04-25T13:08:44.315 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa/tasks 2024-04-25T13:08:44.316 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T13:08:44.317 INFO:teuthology.task.internal:Checking packages... 2024-04-25T13:08:44.341 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd69f13d827952bb07bb9b7973bca14f97d764d6f' 2024-04-25T13:08:44.341 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T13:08:44.341 INFO:teuthology.packaging:ref: None 2024-04-25T13:08:44.341 INFO:teuthology.packaging:tag: None 2024-04-25T13:08:44.341 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-25T13:08:44.341 INFO:teuthology.packaging:sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:08:44.341 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer 2024-04-25T13:08:44.513 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156.gd69f13d8 2024-04-25T13:08:44.514 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T13:08:44.522 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T13:08:44.522 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T13:08:44.531 INFO:teuthology.task.internal:Saving configuration 2024-04-25T13:08:44.550 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T13:08:44.558 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T13:08:44.585 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:03:59.605070', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHN40TN02CFy16TIYygASZdCzCNdeQkDh4GqddIIZ287jmTGqraO2TBL7HUka/rSlKCcEEwg6W3lJLqETzdbRJY='} 2024-04-25T13:08:44.608 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:03:59.606861', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKZy4LXCxehu78tYMqjlOJPaioDsGf4zKFv9f4XShIUJlKtDMUwcfom9Gf15eDhO9WOi99hh12CaXLiXF9jv24Q='} 2024-04-25T13:08:44.609 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T13:08:44.617 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T13:08:44.617 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T13:08:44.617 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T13:08:44.696 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdabd0e30d0>, signals=[15]) 2024-04-25T13:08:44.696 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T13:08:44.707 INFO:teuthology.task.internal:Opening connections... 2024-04-25T13:08:44.707 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:08:44.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:08:44.785 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-04-25T13:08:44.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:08:44.858 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T13:08:44.870 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-04-25T13:08:44.888 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-04-25T13:08:44.888 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-04-25T13:08:44.946 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-04-25T13:08:44.946 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-04-25T13:08:44.946 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-04-25T13:08:44.946 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-04-25T13:08:44.946 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-04-25T13:08:44.946 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-04-25T13:08:44.947 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T13:08:44.947 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-04-25T13:08:44.947 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-04-25T13:08:44.947 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T13:08:44.947 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-04-25T13:08:44.947 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T13:08:44.947 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T13:08:44.947 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T13:08:44.948 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-04-25T13:08:44.967 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-04-25T13:08:44.984 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-04-25T13:08:44.984 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-04-25T13:08:45.040 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-04-25T13:08:45.040 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-04-25T13:08:45.040 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-04-25T13:08:45.040 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-04-25T13:08:45.040 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-04-25T13:08:45.040 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-04-25T13:08:45.040 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T13:08:45.041 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-04-25T13:08:45.041 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-04-25T13:08:45.041 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T13:08:45.041 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-04-25T13:08:45.041 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T13:08:45.041 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T13:08:45.041 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T13:08:45.041 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-04-25T13:08:45.059 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T13:08:45.069 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T13:08:45.080 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T13:08:45.081 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:08:45.083 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:08:45.099 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T13:08:45.110 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T13:08:45.110 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:08:45.141 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:08:45.162 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T13:08:45.220 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T13:08:45.239 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T13:08:45.240 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T13:08:45.240 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:08:45.240 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:08:45.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:08:45.257 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-04-25T13:08:45.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:08:45.258 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-04-25T13:08:45.313 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-437.el9.x86_64 2024-04-25T13:08:45.313 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.14.0-437.el9.x86_64 2024-04-25T13:08:45.313 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2024-04-25T13:08:45.316 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-437.el9.x86_64 2024-04-25T13:08:45.316 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.14.0-437.el9.x86_64 2024-04-25T13:08:45.316 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum install -y kernel 2024-04-25T13:08:47.576 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-25T13:08:47.658 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T13:08:49.561 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-04-25T13:08:49.701 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-25T13:08:53.911 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.2 MB 00:00 2024-04-25T13:08:54.003 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 8.3 MB/s | 6.2 MB 00:00 2024-04-25T13:08:55.551 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 16 kB 00:00 2024-04-25T13:08:55.958 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 16 kB 00:00 2024-04-25T13:08:56.985 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-04-25T13:08:57.936 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 21 MB 00:02 2024-04-25T13:09:02.085 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-25T13:09:02.270 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:01 ago on Thu 25 Apr 2024 01:09:01 PM UTC. 2024-04-25T13:09:03.153 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-25T13:09:03.991 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T13:09:03.991 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T13:09:04.090 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-25T13:09:04.090 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-04-25T13:09:04.090 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-25T13:09:04.221 DEBUG:teuthology.orchestra.run.smithi102:> echo no | sudo yum reinstall kernel || true 2024-04-25T13:09:04.720 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:09:01 PM UTC. 2024-04-25T13:09:04.863 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-25T13:09:04.875 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-25T13:09:04.875 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-04-25T13:09:04.875 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-25T13:09:04.875 INFO:teuthology.orchestra.run.smithi102.stdout:Reinstalling: 2024-04-25T13:09:04.875 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:09:04.875 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:09:04.875 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-25T13:09:04.875 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-25T13:09:04.875 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:09:04.875 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 255 k 2024-04-25T13:09:04.875 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 0 2024-04-25T13:09:04.876 INFO:teuthology.orchestra.run.smithi102.stderr:Operation aborted. 2024-04-25T13:09:04.932 INFO:teuthology.orchestra.run.smithi102.stdout:Is this ok [y/N]: 2024-04-25T13:09:04.932 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum reinstall -y kernel || true 2024-04-25T13:09:05.142 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T13:09:05.143 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T13:09:05.238 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-04-25T13:09:05.240 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-04-25T13:09:05.240 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-04-25T13:09:05.330 DEBUG:teuthology.orchestra.run.smithi052:> echo no | sudo yum reinstall kernel || true 2024-04-25T13:09:05.427 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 01:09:01 PM UTC. 2024-04-25T13:09:05.542 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-25T13:09:05.543 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-25T13:09:05.543 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-04-25T13:09:05.543 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-25T13:09:05.543 INFO:teuthology.orchestra.run.smithi102.stdout:Reinstalling: 2024-04-25T13:09:05.543 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:09:05.543 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:09:05.543 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-25T13:09:05.544 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-25T13:09:05.544 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:09:05.544 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 255 k 2024-04-25T13:09:05.544 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 0 2024-04-25T13:09:05.544 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-25T13:09:05.849 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 01:09:03 PM UTC. 2024-04-25T13:09:05.973 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-04-25T13:09:05.985 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-25T13:09:05.985 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-04-25T13:09:05.985 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-25T13:09:05.985 INFO:teuthology.orchestra.run.smithi052.stdout:Reinstalling: 2024-04-25T13:09:05.985 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:09:05.986 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:09:05.986 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-04-25T13:09:05.986 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-25T13:09:05.986 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:09:05.986 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 255 k 2024-04-25T13:09:05.986 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 0 2024-04-25T13:09:05.987 INFO:teuthology.orchestra.run.smithi052.stderr:Operation aborted. 2024-04-25T13:09:06.038 INFO:teuthology.orchestra.run.smithi052.stdout:Is this ok [y/N]: 2024-04-25T13:09:06.039 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum reinstall -y kernel || true 2024-04-25T13:09:06.279 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-437.el9.x86_64.rpm 581 kB/s | 255 kB 00:00 2024-04-25T13:09:06.279 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:09:06.279 INFO:teuthology.orchestra.run.smithi102.stdout:Total 346 kB/s | 255 kB 00:00 2024-04-25T13:09:06.295 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-25T13:09:06.486 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-25T13:09:06.486 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-25T13:09:06.491 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-25T13:09:06.491 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-25T13:09:06.551 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:09:03 PM UTC. 2024-04-25T13:09:06.629 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-25T13:09:06.672 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-04-25T13:09:06.673 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-25T13:09:06.673 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-04-25T13:09:06.673 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-25T13:09:06.673 INFO:teuthology.orchestra.run.smithi052.stdout:Reinstalling: 2024-04-25T13:09:06.673 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:09:06.673 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:09:06.673 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-04-25T13:09:06.673 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-25T13:09:06.673 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:09:06.673 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 255 k 2024-04-25T13:09:06.673 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 0 2024-04-25T13:09:06.673 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-04-25T13:09:06.730 INFO:teuthology.orchestra.run.smithi102.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:09:06.730 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:07.088 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.0 MB/s | 255 kB 00:00 2024-04-25T13:09:07.089 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:09:07.089 INFO:teuthology.orchestra.run.smithi052.stdout:Total 612 kB/s | 255 kB 00:00 2024-04-25T13:09:07.109 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-04-25T13:09:07.289 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-04-25T13:09:07.289 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-04-25T13:09:07.294 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-04-25T13:09:07.295 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-04-25T13:09:07.377 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:07.378 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:09:07.442 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-04-25T13:09:07.515 INFO:teuthology.orchestra.run.smithi052.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:09:07.515 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:08.141 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:08.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:09:08.141 INFO:teuthology.orchestra.run.smithi102.stdout:Reinstalled: 2024-04-25T13:09:08.141 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T13:09:08.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:09:08.141 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-25T13:09:08.181 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:08.181 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:09:08.343 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T13:09:08.389 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T13:09:08.389 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T13:09:08.389 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T13:09:08.390 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-25T13:09:08.390 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:09:08.421 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-04-25T13:09:08.439 DEBUG:teuthology.parallel:result is None 2024-04-25T13:09:08.844 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:08.844 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:09:08.844 INFO:teuthology.orchestra.run.smithi052.stdout:Reinstalled: 2024-04-25T13:09:08.844 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T13:09:08.844 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:09:08.844 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-04-25T13:09:09.001 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T13:09:09.049 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T13:09:09.049 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T13:09:09.049 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T13:09:09.049 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T13:09:09.049 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:09:09.081 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2024-04-25T13:09:09.101 DEBUG:teuthology.parallel:result is None 2024-04-25T13:09:09.102 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T13:09:09.111 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T13:09:09.111 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:09:09.144 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:09:09.160 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T13:09:09.171 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T13:09:09.188 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T13:09:09.188 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:09:09.199 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:09:09.236 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T13:09:09.248 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T13:09:09.248 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:09:09.259 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:09:09.283 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:09:09.292 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:09:09.302 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:09:09.311 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:09:09.313 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T13:09:09.324 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T13:09:09.325 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:09:09.337 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:09:09.378 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T13:09:09.388 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T13:09:09.388 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:09:09.400 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:09:09.433 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:09:09.492 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:09:09.540 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:09:09.623 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:09:09.661 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:09:09.662 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:09:09.725 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:09:09.765 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:09:09.814 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:09:09.895 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:09:09.935 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:09:09.935 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:09:09.998 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-04-25T13:09:10.000 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-04-25T13:09:10.036 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:09:10.081 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:09:10.577 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T13:09:10.584 INFO:teuthology.task.internal:Starting timer... 2024-04-25T13:09:10.584 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T13:09:10.595 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T13:09:10.605 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T13:09:10.606 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-04-25T13:09:10.655 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-04-25T13:09:10.656 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-04-25T13:09:10.693 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-04-25T13:09:10.695 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T13:09:10.695 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-04-25T13:09:10.714 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-04-25T13:09:10.715 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-04-25T13:09:10.758 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-04-25T13:09:10.759 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi102.front.sepia.ceph.com': 'permissive'} 2024-04-25T13:09:10.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:09:10.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:09:10.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:09:10.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:09:10.822 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T13:09:10.823 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-04-25T13:09:10.849 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-04-25T13:09:10.886 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T13:09:10.895 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T13:09:10.912 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T13:09:10.913 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T13:12:45.284 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2024-04-25T13:12:45.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-25T13:12:45.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:12:45.363 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-04-25T13:12:45.442 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-25T13:12:45.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-25T13:12:45.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:12:45.517 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-04-25T13:12:45.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-25T13:12:45.598 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T13:12:45.608 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T13:12:45.609 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:12:45.609 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:12:45.612 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:12:45.612 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:12:45.640 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T13:12:45.655 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T13:12:45.668 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T13:12:45.680 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-04-25T13:12:45.682 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T13:12:45.692 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-04-25T13:12:45.704 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-04-25T13:12:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T13:12:45.714 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-04-25T13:12:45.718 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T13:12:45.727 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T13:12:45.740 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T13:12:45.781 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:12:45.785 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:12:45.785 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-04-25T13:12:45.785 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:12:45.785 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:12:45.785 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:12:45.785 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:12:45.796 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:12:45.800 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:12:45.800 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-04-25T13:12:45.800 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:12:45.800 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:12:45.800 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:12:45.800 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:12:45.801 INFO:teuthology.run_tasks:Running task install... 2024-04-25T13:12:45.838 DEBUG:teuthology.task.install:project ceph 2024-04-25T13:12:45.838 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}} 2024-04-25T13:12:45.838 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'} 2024-04-25T13:12:45.838 INFO:teuthology.task.install:Using flavor: default 2024-04-25T13:12:45.844 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T13:12:45.844 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T13:12:45.844 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-25T13:12:45.845 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:12:45.847 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-25T13:12:45.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:12:46.075 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-25T13:12:46.075 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-25T13:12:46.079 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-25T13:12:46.079 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-25T13:12:46.202 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T13:12:46.203 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:12:46.203 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T13:12:46.230 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T13:12:46.230 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T13:12:46.257 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T13:12:46.257 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:12:46.257 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T13:12:46.283 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T13:12:46.284 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T13:12:46.297 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T13:12:46.352 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T13:12:46.373 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T13:12:46.427 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T13:12:46.437 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-04-25T13:12:46.439 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-04-25T13:12:46.491 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-04-25T13:12:46.493 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-04-25T13:12:46.676 INFO:teuthology.orchestra.run.smithi052.stdout:48 files removed 2024-04-25T13:12:46.703 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T13:12:46.719 INFO:teuthology.orchestra.run.smithi102.stdout:48 files removed 2024-04-25T13:12:46.746 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T13:12:47.419 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 202 kB/s | 83 kB 00:00 2024-04-25T13:12:47.466 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 170 kB/s | 83 kB 00:00 2024-04-25T13:12:47.833 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-04-25T13:12:47.878 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-04-25T13:12:48.251 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-25T13:12:48.303 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-04-25T13:12:49.298 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.0 MB 00:00 2024-04-25T13:12:49.762 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.0 MB 00:01 2024-04-25T13:12:51.341 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-25T13:12:51.746 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-25T13:12:55.417 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-25T13:12:56.497 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.2 MB 00:01 2024-04-25T13:12:57.166 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-25T13:12:58.070 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-04-25T13:12:58.635 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-25T13:13:03.692 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-04-25T13:13:05.843 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:13:05.844 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:13:05.854 INFO:teuthology.orchestra.run.smithi102.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T13:13:05.855 INFO:teuthology.orchestra.run.smithi102.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T13:13:05.856 INFO:teuthology.orchestra.run.smithi102.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T13:13:05.857 INFO:teuthology.orchestra.run.smithi102.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T13:13:05.859 INFO:teuthology.orchestra.run.smithi102.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T13:13:05.861 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T13:13:05.862 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T13:13:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-25T13:13:05.933 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================= 2024-04-25T13:13:05.933 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-25T13:13:05.933 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================= 2024-04-25T13:13:05.933 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-25T13:13:05.933 INFO:teuthology.orchestra.run.smithi102.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T13:13:05.933 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-25T13:13:05.934 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T13:13:05.935 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T13:13:05.936 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-25T13:13:05.937 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T13:13:05.938 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T13:13:05.939 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T13:13:05.940 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T13:13:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T13:13:05.942 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T13:13:05.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T13:13:05.944 INFO:teuthology.orchestra.run.smithi102.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T13:13:05.945 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T13:13:05.945 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T13:13:05.945 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-04-25T13:13:05.945 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T13:13:05.945 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:13:05.945 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-25T13:13:05.945 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================= 2024-04-25T13:13:05.945 INFO:teuthology.orchestra.run.smithi102.stdout:Install 148 Packages 2024-04-25T13:13:05.945 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 4 Packages 2024-04-25T13:13:05.945 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:13:05.946 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 222 M 2024-04-25T13:13:05.946 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-25T13:13:07.410 INFO:teuthology.orchestra.run.smithi102.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 27 kB/s | 6.6 kB 00:00 2024-04-25T13:13:07.793 INFO:teuthology.orchestra.run.smithi102.stdout:(2/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 8.6 MB/s | 5.4 MB 00:00 2024-04-25T13:13:07.852 INFO:teuthology.orchestra.run.smithi102.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 2.4 MB/s | 145 kB 00:00 2024-04-25T13:13:08.094 INFO:teuthology.orchestra.run.smithi102.stdout:(4/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 9.8 MB/s | 2.4 MB 00:00 2024-04-25T13:13:08.277 INFO:teuthology.orchestra.run.smithi102.stdout:(5/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 8.2 MB/s | 1.5 MB 00:00 2024-04-25T13:13:08.311 INFO:teuthology.orchestra.run.smithi102.stdout:(6/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 988 kB/s | 890 kB 00:00 2024-04-25T13:13:08.736 INFO:teuthology.orchestra.run.smithi102.stdout:(7/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 10 MB/s | 4.7 MB 00:00 2024-04-25T13:13:08.937 INFO:teuthology.orchestra.run.smithi102.stdout:(8/152): ceph-common-19.0.0-3156.gd69f13d8.el7. 12 MB/s | 21 MB 00:01 2024-04-25T13:13:08.978 INFO:teuthology.orchestra.run.smithi102.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 609 kB/s | 25 kB 00:00 2024-04-25T13:13:09.620 INFO:teuthology.orchestra.run.smithi102.stdout:(10/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 12 MB/s | 11 MB 00:00 2024-04-25T13:13:09.735 INFO:teuthology.orchestra.run.smithi102.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 1.9 MB/s | 225 kB 00:00 2024-04-25T13:13:09.804 INFO:teuthology.orchestra.run.smithi102.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 395 kB/s | 27 kB 00:00 2024-04-25T13:13:09.871 INFO:teuthology.orchestra.run.smithi102.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 477 kB/s | 32 kB 00:00 2024-04-25T13:13:09.971 INFO:teuthology.orchestra.run.smithi102.stdout:(14/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 7.3 MB/s | 747 kB 00:00 2024-04-25T13:13:10.046 INFO:teuthology.orchestra.run.smithi102.stdout:(15/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 2.1 MB/s | 163 kB 00:00 2024-04-25T13:13:10.122 INFO:teuthology.orchestra.run.smithi102.stdout:(16/152): librados-devel-19.0.0-3156.gd69f13d8. 1.6 MB/s | 126 kB 00:00 2024-04-25T13:13:10.222 INFO:teuthology.orchestra.run.smithi102.stdout:(17/152): libradosstriper1-19.0.0-3156.gd69f13d 4.9 MB/s | 500 kB 00:00 2024-04-25T13:13:10.748 INFO:teuthology.orchestra.run.smithi102.stdout:(18/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 10 MB/s | 5.4 MB 00:00 2024-04-25T13:13:10.815 INFO:teuthology.orchestra.run.smithi102.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 679 kB/s | 45 kB 00:00 2024-04-25T13:13:10.889 INFO:teuthology.orchestra.run.smithi102.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 1.8 MB/s | 135 kB 00:00 2024-04-25T13:13:10.973 INFO:teuthology.orchestra.run.smithi102.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 1.9 MB/s | 161 kB 00:00 2024-04-25T13:13:11.049 INFO:teuthology.orchestra.run.smithi102.stdout:(22/152): python3-rados-19.0.0-3156.gd69f13d8.e 4.2 MB/s | 320 kB 00:00 2024-04-25T13:13:11.141 INFO:teuthology.orchestra.run.smithi102.stdout:(23/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 3.2 MB/s | 298 kB 00:00 2024-04-25T13:13:11.208 INFO:teuthology.orchestra.run.smithi102.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 1.5 MB/s | 99 kB 00:00 2024-04-25T13:13:11.275 INFO:teuthology.orchestra.run.smithi102.stdout:(25/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 1.2 MB/s | 85 kB 00:00 2024-04-25T13:13:11.617 INFO:teuthology.orchestra.run.smithi102.stdout:(26/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 9.0 MB/s | 3.1 MB 00:00 2024-04-25T13:13:12.043 INFO:teuthology.orchestra.run.smithi102.stdout:(27/152): ceph-test-19.0.0-3156.gd69f13d8.el7.x 16 MB/s | 49 MB 00:03 2024-04-25T13:13:12.068 INFO:teuthology.orchestra.run.smithi102.stdout:(28/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 378 kB/s | 170 kB 00:00 2024-04-25T13:13:12.084 INFO:teuthology.orchestra.run.smithi102.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3156.g 825 kB/s | 34 kB 00:00 2024-04-25T13:13:12.118 INFO:teuthology.orchestra.run.smithi102.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 2.8 MB/s | 142 kB 00:00 2024-04-25T13:13:12.377 INFO:teuthology.orchestra.run.smithi102.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 12 MB/s | 3.5 MB 00:00 2024-04-25T13:13:12.452 INFO:teuthology.orchestra.run.smithi102.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3156.gd6 3.3 MB/s | 249 kB 00:00 2024-04-25T13:13:12.519 INFO:teuthology.orchestra.run.smithi102.stdout:(33/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 741 kB/s | 49 kB 00:00 2024-04-25T13:13:12.578 INFO:teuthology.orchestra.run.smithi102.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3156.gd 281 kB/s | 16 kB 00:00 2024-04-25T13:13:12.662 INFO:teuthology.orchestra.run.smithi102.stdout:(35/152): ceph-mgr-diskprediction-local-19.0.0- 14 MB/s | 7.4 MB 00:00 2024-04-25T13:13:12.687 INFO:teuthology.orchestra.run.smithi102.stdout:(36/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 2.5 MB/s | 273 kB 00:00 2024-04-25T13:13:12.737 INFO:teuthology.orchestra.run.smithi102.stdout:(37/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 9.9 MB/s | 762 kB 00:00 2024-04-25T13:13:12.762 INFO:teuthology.orchestra.run.smithi102.stdout:(38/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 242 kB/s | 18 kB 00:00 2024-04-25T13:13:12.896 INFO:teuthology.orchestra.run.smithi102.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 507 kB/s | 80 kB 00:00 2024-04-25T13:13:12.929 INFO:teuthology.orchestra.run.smithi102.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 803 kB 00:00 2024-04-25T13:13:12.954 INFO:teuthology.orchestra.run.smithi102.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-04-25T13:13:12.980 INFO:teuthology.orchestra.run.smithi102.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-25T13:13:13.031 INFO:teuthology.orchestra.run.smithi102.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-04-25T13:13:13.056 INFO:teuthology.orchestra.run.smithi102.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-04-25T13:13:13.081 INFO:teuthology.orchestra.run.smithi102.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-25T13:13:13.106 INFO:teuthology.orchestra.run.smithi102.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T13:13:13.131 INFO:teuthology.orchestra.run.smithi102.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-25T13:13:13.157 INFO:teuthology.orchestra.run.smithi102.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 13 MB/s | 689 kB 00:00 2024-04-25T13:13:13.207 INFO:teuthology.orchestra.run.smithi102.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-04-25T13:13:13.233 INFO:teuthology.orchestra.run.smithi102.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-04-25T13:13:13.258 INFO:teuthology.orchestra.run.smithi102.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 428 kB/s | 21 kB 00:00 2024-04-25T13:13:13.291 INFO:teuthology.orchestra.run.smithi102.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-04-25T13:13:13.316 INFO:teuthology.orchestra.run.smithi102.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-04-25T13:13:13.375 INFO:teuthology.orchestra.run.smithi102.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 316 kB/s | 18 kB 00:00 2024-04-25T13:13:13.426 INFO:teuthology.orchestra.run.smithi102.stdout:(55/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-04-25T13:13:13.451 INFO:teuthology.orchestra.run.smithi102.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 150 kB/s | 11 kB 00:00 2024-04-25T13:13:13.476 INFO:teuthology.orchestra.run.smithi102.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T13:13:13.521 INFO:teuthology.orchestra.run.smithi102.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 654 kB/s | 45 kB 00:00 2024-04-25T13:13:13.552 INFO:teuthology.orchestra.run.smithi102.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-04-25T13:13:13.586 INFO:teuthology.orchestra.run.smithi102.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 9.0 MB/s | 582 kB 00:00 2024-04-25T13:13:13.611 INFO:teuthology.orchestra.run.smithi102.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 441 kB/s | 25 kB 00:00 2024-04-25T13:13:13.636 INFO:teuthology.orchestra.run.smithi102.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-04-25T13:13:13.661 INFO:teuthology.orchestra.run.smithi102.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-25T13:13:13.687 INFO:teuthology.orchestra.run.smithi102.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T13:13:13.703 INFO:teuthology.orchestra.run.smithi102.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 850 kB/s | 35 kB 00:00 2024-04-25T13:13:13.871 INFO:teuthology.orchestra.run.smithi102.stdout:(66/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x8 3.0 MB/s | 17 MB 00:05 2024-04-25T13:13:14.013 INFO:teuthology.orchestra.run.smithi102.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-04-25T13:13:14.088 INFO:teuthology.orchestra.run.smithi102.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-25T13:13:14.130 INFO:teuthology.orchestra.run.smithi102.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 6.2 MB/s | 1.6 MB 00:00 2024-04-25T13:13:14.155 INFO:teuthology.orchestra.run.smithi102.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 6.4 MB/s | 911 kB 00:00 2024-04-25T13:13:14.180 INFO:teuthology.orchestra.run.smithi102.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-04-25T13:13:14.255 INFO:teuthology.orchestra.run.smithi102.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-25T13:13:14.381 INFO:teuthology.orchestra.run.smithi102.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-04-25T13:13:14.406 INFO:teuthology.orchestra.run.smithi102.stdout:(74/152): python3-attrs-20.3.0-7.el9.noarch.rpm 390 kB/s | 87 kB 00:00 2024-04-25T13:13:14.506 INFO:teuthology.orchestra.run.smithi102.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 6.0 MB 00:00 2024-04-25T13:13:14.531 INFO:teuthology.orchestra.run.smithi102.stdout:(76/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.6 MB/s | 244 kB 00:00 2024-04-25T13:13:14.557 INFO:teuthology.orchestra.run.smithi102.stdout:(77/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-04-25T13:13:14.582 INFO:teuthology.orchestra.run.smithi102.stdout:(78/152): python3-jsonpatch-1.21-16.el9.noarch. 343 kB/s | 26 kB 00:00 2024-04-25T13:13:14.609 INFO:teuthology.orchestra.run.smithi102.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 365 kB/s | 19 kB 00:00 2024-04-25T13:13:14.635 INFO:teuthology.orchestra.run.smithi102.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-25T13:13:14.660 INFO:teuthology.orchestra.run.smithi102.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 451 kB/s | 35 kB 00:00 2024-04-25T13:13:14.685 INFO:teuthology.orchestra.run.smithi102.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-04-25T13:13:14.752 INFO:teuthology.orchestra.run.smithi102.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-04-25T13:13:14.819 INFO:teuthology.orchestra.run.smithi102.stdout:(84/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-04-25T13:13:14.844 INFO:teuthology.orchestra.run.smithi102.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 491 kB/s | 77 kB 00:00 2024-04-25T13:13:14.869 INFO:teuthology.orchestra.run.smithi102.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 366 kB/s | 42 kB 00:00 2024-04-25T13:13:14.895 INFO:teuthology.orchestra.run.smithi102.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-04-25T13:13:14.920 INFO:teuthology.orchestra.run.smithi102.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-25T13:13:14.945 INFO:teuthology.orchestra.run.smithi102.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-25T13:13:14.970 INFO:teuthology.orchestra.run.smithi102.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T13:13:14.987 INFO:teuthology.orchestra.run.smithi102.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 807 kB/s | 54 kB 00:00 2024-04-25T13:13:15.187 INFO:teuthology.orchestra.run.smithi102.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 210 kB/s | 42 kB 00:00 2024-04-25T13:13:15.212 INFO:teuthology.orchestra.run.smithi102.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 198 kB/s | 44 kB 00:00 2024-04-25T13:13:15.380 INFO:teuthology.orchestra.run.smithi102.stdout:(94/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-04-25T13:13:15.405 INFO:teuthology.orchestra.run.smithi102.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 221 kB 00:00 2024-04-25T13:13:15.430 INFO:teuthology.orchestra.run.smithi102.stdout:(96/152): qatlib-service-24.02.0-1.el9.x86_64.r 167 kB/s | 36 kB 00:00 2024-04-25T13:13:15.455 INFO:teuthology.orchestra.run.smithi102.stdout:(97/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-04-25T13:13:15.480 INFO:teuthology.orchestra.run.smithi102.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-04-25T13:13:15.506 INFO:teuthology.orchestra.run.smithi102.stdout:(99/152): uuid-1.6.2-55.el9.x86_64.rpm 772 kB/s | 58 kB 00:00 2024-04-25T13:13:15.531 INFO:teuthology.orchestra.run.smithi102.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-04-25T13:13:15.548 INFO:teuthology.orchestra.run.smithi102.stdout:(101/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 955 kB/s | 64 kB 00:00 2024-04-25T13:13:15.565 INFO:teuthology.orchestra.run.smithi102.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-04-25T13:13:15.598 INFO:teuthology.orchestra.run.smithi102.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 443 kB/s | 22 kB 00:00 2024-04-25T13:13:15.623 INFO:teuthology.orchestra.run.smithi102.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 11 MB/s | 863 kB 00:00 2024-04-25T13:13:16.057 INFO:teuthology.orchestra.run.smithi102.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 45 kB/s | 19 kB 00:00 2024-04-25T13:13:16.483 INFO:teuthology.orchestra.run.smithi102.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 350 kB/s | 309 kB 00:00 2024-04-25T13:13:16.600 INFO:teuthology.orchestra.run.smithi102.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 530 kB/s | 548 kB 00:01 2024-04-25T13:13:16.633 INFO:teuthology.orchestra.run.smithi102.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 173 kB/s | 26 kB 00:00 2024-04-25T13:13:16.750 INFO:teuthology.orchestra.run.smithi102.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 323 kB/s | 49 kB 00:00 2024-04-25T13:13:16.792 INFO:teuthology.orchestra.run.smithi102.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 425 kB/s | 67 kB 00:00 2024-04-25T13:13:16.917 INFO:teuthology.orchestra.run.smithi102.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 904 kB/s | 151 kB 00:00 2024-04-25T13:13:17.084 INFO:teuthology.orchestra.run.smithi102.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-04-25T13:13:17.118 INFO:teuthology.orchestra.run.smithi102.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.5 MB/s | 838 kB 00:00 2024-04-25T13:13:17.177 INFO:teuthology.orchestra.run.smithi102.stdout:(114/152): libarrow-9.0.0-10.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-04-25T13:13:17.244 INFO:teuthology.orchestra.run.smithi102.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 273 kB/s | 43 kB 00:00 2024-04-25T13:13:17.306 INFO:teuthology.orchestra.run.smithi102.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 171 kB/s | 32 kB 00:00 2024-04-25T13:13:17.336 INFO:teuthology.orchestra.run.smithi102.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 94 kB/s | 15 kB 00:00 2024-04-25T13:13:17.394 INFO:teuthology.orchestra.run.smithi102.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2024-04-25T13:13:17.470 INFO:teuthology.orchestra.run.smithi102.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2024-04-25T13:13:17.495 INFO:teuthology.orchestra.run.smithi102.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.9 MB/s | 303 kB 00:00 2024-04-25T13:13:17.554 INFO:teuthology.orchestra.run.smithi102.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 222 kB/s | 35 kB 00:00 2024-04-25T13:13:17.629 INFO:teuthology.orchestra.run.smithi102.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.3 MB/s | 206 kB 00:00 2024-04-25T13:13:17.713 INFO:teuthology.orchestra.run.smithi102.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 911 kB/s | 144 kB 00:00 2024-04-25T13:13:17.788 INFO:teuthology.orchestra.run.smithi102.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 67 kB/s | 11 kB 00:00 2024-04-25T13:13:17.871 INFO:teuthology.orchestra.run.smithi102.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 111 kB/s | 18 kB 00:00 2024-04-25T13:13:17.946 INFO:teuthology.orchestra.run.smithi102.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 146 kB/s | 23 kB 00:00 2024-04-25T13:13:18.030 INFO:teuthology.orchestra.run.smithi102.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 122 kB/s | 19 kB 00:00 2024-04-25T13:13:18.105 INFO:teuthology.orchestra.run.smithi102.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 124 kB/s | 20 kB 00:00 2024-04-25T13:13:18.214 INFO:teuthology.orchestra.run.smithi102.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 5.6 MB/s | 1.0 MB 00:00 2024-04-25T13:13:18.264 INFO:teuthology.orchestra.run.smithi102.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 292 kB/s | 46 kB 00:00 2024-04-25T13:13:18.373 INFO:teuthology.orchestra.run.smithi102.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 497 kB/s | 79 kB 00:00 2024-04-25T13:13:18.423 INFO:teuthology.orchestra.run.smithi102.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 364 kB/s | 58 kB 00:00 2024-04-25T13:13:18.532 INFO:teuthology.orchestra.run.smithi102.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-04-25T13:13:18.582 INFO:teuthology.orchestra.run.smithi102.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 103 kB/s | 16 kB 00:00 2024-04-25T13:13:18.690 INFO:teuthology.orchestra.run.smithi102.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 567 kB/s | 90 kB 00:00 2024-04-25T13:13:18.741 INFO:teuthology.orchestra.run.smithi102.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 178 kB/s | 28 kB 00:00 2024-04-25T13:13:18.850 INFO:teuthology.orchestra.run.smithi102.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 194 kB/s | 31 kB 00:00 2024-04-25T13:13:18.900 INFO:teuthology.orchestra.run.smithi102.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-04-25T13:13:19.008 INFO:teuthology.orchestra.run.smithi102.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 373 kB/s | 59 kB 00:00 2024-04-25T13:13:19.059 INFO:teuthology.orchestra.run.smithi102.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 225 kB/s | 36 kB 00:00 2024-04-25T13:13:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 305 kB/s | 51 kB 00:00 2024-04-25T13:13:19.218 INFO:teuthology.orchestra.run.smithi102.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-04-25T13:13:19.223 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 21 MB 00:21 2024-04-25T13:13:19.335 INFO:teuthology.orchestra.run.smithi102.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 566 kB/s | 90 kB 00:00 2024-04-25T13:13:19.385 INFO:teuthology.orchestra.run.smithi102.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-04-25T13:13:19.485 INFO:teuthology.orchestra.run.smithi102.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 133 kB/s | 20 kB 00:00 2024-04-25T13:13:19.544 INFO:teuthology.orchestra.run.smithi102.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-04-25T13:13:19.669 INFO:teuthology.orchestra.run.smithi102.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-25T13:13:19.953 INFO:teuthology.orchestra.run.smithi102.stdout:(148/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 11 MB/s | 3.1 MB 00:00 2024-04-25T13:13:20.020 INFO:teuthology.orchestra.run.smithi102.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-04-25T13:13:20.120 INFO:teuthology.orchestra.run.smithi102.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-04-25T13:13:20.279 INFO:teuthology.orchestra.run.smithi102.stdout:(151/152): librados2-19.0.0-3156.gd69f13d8.el7. 4.6 MB/s | 3.4 MB 00:00 2024-04-25T13:13:20.754 INFO:teuthology.orchestra.run.smithi102.stdout:(152/152): python3-grpcio-1.46.7-10.el9.x86_64. 640 kB/s | 2.0 MB 00:03 2024-04-25T13:13:20.759 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:13:20.759 INFO:teuthology.orchestra.run.smithi102.stdout:Total 15 MB/s | 222 MB 00:14 2024-04-25T13:13:21.872 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-25T13:13:22.016 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-25T13:13:22.017 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-25T13:13:23.775 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-25T13:13:23.776 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-25T13:13:24.378 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-04-25T13:13:26.605 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:13:26.605 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:13:26.616 INFO:teuthology.orchestra.run.smithi052.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T13:13:26.617 INFO:teuthology.orchestra.run.smithi052.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T13:13:26.618 INFO:teuthology.orchestra.run.smithi052.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T13:13:26.619 INFO:teuthology.orchestra.run.smithi052.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T13:13:26.620 INFO:teuthology.orchestra.run.smithi052.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T13:13:26.623 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T13:13:26.623 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T13:13:26.687 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-04-25T13:13:26.697 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-04-25T13:13:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-04-25T13:13:26.697 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-04-25T13:13:26.697 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-04-25T13:13:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T13:13:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-25T13:13:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T13:13:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-25T13:13:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-25T13:13:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T13:13:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T13:13:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T13:13:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-25T13:13:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T13:13:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T13:13:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T13:13:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T13:13:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T13:13:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T13:13:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T13:13:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T13:13:26.708 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2024-04-25T13:13:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T13:13:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:13:26.708 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-04-25T13:13:26.708 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-04-25T13:13:26.708 INFO:teuthology.orchestra.run.smithi052.stdout:Install 148 Packages 2024-04-25T13:13:26.708 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 4 Packages 2024-04-25T13:13:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:13:26.709 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 222 M 2024-04-25T13:13:26.709 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-04-25T13:13:29.934 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-25T13:13:30.016 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T13:13:30.054 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T13:13:30.108 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T13:13:30.142 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T13:13:30.167 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T13:13:30.211 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T13:13:30.538 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T13:13:30.652 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:13:30.773 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:13:30.803 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:13:30.894 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:13:30.924 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T13:13:31.076 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T13:13:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T13:13:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:13:31.253 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:13:31.275 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T13:13:31.338 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T13:13:31.360 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:13:31.384 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:13:31.568 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:13:31.601 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:13:31.712 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T13:13:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T13:13:31.850 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T13:13:31.886 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T13:13:31.960 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T13:13:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T13:13:32.062 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T13:13:32.094 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T13:13:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T13:13:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T13:13:32.244 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T13:13:32.275 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T13:13:32.318 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T13:13:32.396 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T13:13:32.429 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-25T13:13:32.473 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-25T13:13:32.501 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-25T13:13:32.572 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T13:13:32.616 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T13:13:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T13:13:32.844 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T13:13:32.910 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T13:13:33.440 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T13:13:33.523 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T13:13:33.551 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T13:13:33.594 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T13:13:33.632 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-25T13:13:33.674 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T13:13:33.821 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T13:13:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T13:13:33.924 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T13:13:33.997 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T13:13:34.029 INFO:teuthology.orchestra.run.smithi052.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 17 kB/s | 6.6 kB 00:00 2024-04-25T13:13:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T13:13:34.072 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T13:13:34.119 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T13:13:34.155 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T13:13:34.198 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T13:13:34.240 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T13:13:34.379 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T13:13:34.421 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T13:13:34.451 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T13:13:34.493 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T13:13:34.596 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T13:13:34.634 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T13:13:34.674 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T13:13:34.700 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T13:13:34.725 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T13:13:34.800 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T13:13:34.934 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T13:13:34.974 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T13:13:35.002 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T13:13:35.029 INFO:teuthology.orchestra.run.smithi052.stdout:(2/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 890 kB/s | 890 kB 00:00 2024-04-25T13:13:35.044 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T13:13:35.083 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T13:13:35.115 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T13:13:35.145 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T13:13:35.179 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T13:13:35.213 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T13:13:35.221 INFO:teuthology.orchestra.run.smithi052.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 756 kB/s | 145 kB 00:00 2024-04-25T13:13:35.254 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T13:13:35.289 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T13:13:35.418 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T13:13:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T13:13:35.878 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T13:13:36.001 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T13:13:36.110 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T13:13:36.161 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T13:13:36.891 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T13:13:36.905 INFO:teuthology.orchestra.run.smithi052.stdout:(4/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 1.6 MB/s | 5.4 MB 00:03 2024-04-25T13:13:36.941 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T13:13:36.975 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T13:13:37.068 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T13:13:37.125 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T13:13:37.213 INFO:teuthology.orchestra.run.smithi052.stdout:(5/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 1.2 MB/s | 2.4 MB 00:01 2024-04-25T13:13:37.230 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T13:13:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T13:13:37.447 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T13:13:37.483 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T13:13:37.561 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T13:13:37.672 INFO:teuthology.orchestra.run.smithi052.stdout:(6/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 2.0 MB/s | 1.5 MB 00:00 2024-04-25T13:13:38.205 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T13:13:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T13:13:39.556 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T13:13:39.646 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T13:13:39.674 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T13:13:39.707 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T13:13:40.020 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T13:13:40.070 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T13:13:40.159 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T13:13:40.192 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-25T13:13:40.227 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T13:13:40.414 INFO:teuthology.orchestra.run.smithi052.stdout:(7/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 1.5 MB/s | 4.7 MB 00:03 2024-04-25T13:13:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T13:13:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T13:13:40.802 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T13:13:40.824 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-25T13:13:43.126 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:13:43.163 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:13:43.698 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:13:43.758 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T13:13:43.865 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T13:13:43.865 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T13:13:43.865 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T13:13:43.865 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:13:43.901 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T13:13:44.780 INFO:teuthology.orchestra.run.smithi052.stdout:(8/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x86 2.4 MB/s | 17 MB 00:07 2024-04-25T13:13:44.847 INFO:teuthology.orchestra.run.smithi052.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 380 kB/s | 25 kB 00:00 2024-04-25T13:13:46.948 INFO:teuthology.orchestra.run.smithi052.stdout:(10/152): ceph-common-19.0.0-3156.gd69f13d8.el7 1.6 MB/s | 21 MB 00:13 2024-04-25T13:13:47.389 INFO:teuthology.orchestra.run.smithi052.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 509 kB/s | 225 kB 00:00 2024-04-25T13:13:47.531 INFO:teuthology.orchestra.run.smithi052.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 191 kB/s | 27 kB 00:00 2024-04-25T13:13:47.649 INFO:teuthology.orchestra.run.smithi052.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 272 kB/s | 32 kB 00:00 2024-04-25T13:13:48.715 INFO:teuthology.orchestra.run.smithi052.stdout:(14/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 700 kB/s | 747 kB 00:01 2024-04-25T13:13:49.007 INFO:teuthology.orchestra.run.smithi052.stdout:(15/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 560 kB/s | 163 kB 00:00 2024-04-25T13:13:49.207 INFO:teuthology.orchestra.run.smithi052.stdout:(16/152): librados-devel-19.0.0-3156.gd69f13d8. 633 kB/s | 126 kB 00:00 2024-04-25T13:13:49.849 INFO:teuthology.orchestra.run.smithi052.stdout:(17/152): libradosstriper1-19.0.0-3156.gd69f13d 780 kB/s | 500 kB 00:00 2024-04-25T13:13:50.242 INFO:teuthology.orchestra.run.smithi052.stdout:(18/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 1.1 MB/s | 11 MB 00:09 2024-04-25T13:13:50.367 INFO:teuthology.orchestra.run.smithi052.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 361 kB/s | 45 kB 00:00 2024-04-25T13:13:50.567 INFO:teuthology.orchestra.run.smithi052.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 674 kB/s | 135 kB 00:00 2024-04-25T13:13:50.759 INFO:teuthology.orchestra.run.smithi052.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 842 kB/s | 161 kB 00:00 2024-04-25T13:13:51.068 INFO:teuthology.orchestra.run.smithi052.stdout:(22/152): python3-rados-19.0.0-3156.gd69f13d8.e 1.0 MB/s | 320 kB 00:00 2024-04-25T13:13:51.359 INFO:teuthology.orchestra.run.smithi052.stdout:(23/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 1.0 MB/s | 298 kB 00:00 2024-04-25T13:13:51.471 INFO:teuthology.orchestra.run.smithi052.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 892 kB/s | 99 kB 00:00 2024-04-25T13:13:51.577 INFO:teuthology.orchestra.run.smithi052.stdout:(25/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 811 kB/s | 85 kB 00:00 2024-04-25T13:13:54.085 INFO:teuthology.orchestra.run.smithi052.stdout:(26/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 1.2 MB/s | 3.1 MB 00:02 2024-04-25T13:13:54.294 INFO:teuthology.orchestra.run.smithi052.stdout:(27/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 820 kB/s | 170 kB 00:00 2024-04-25T13:13:54.411 INFO:teuthology.orchestra.run.smithi052.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3156.g 294 kB/s | 34 kB 00:00 2024-04-25T13:13:54.536 INFO:teuthology.orchestra.run.smithi052.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 1.1 MB/s | 142 kB 00:00 2024-04-25T13:13:54.720 INFO:teuthology.orchestra.run.smithi052.stdout:(30/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 1.1 MB/s | 5.4 MB 00:04 2024-04-25T13:13:55.610 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T13:13:55.610 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-04-25T13:13:55.610 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-04-25T13:13:55.610 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-04-25T13:13:55.611 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-04-25T13:13:55.611 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-04-25T13:13:55.611 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-04-25T13:13:55.611 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-04-25T13:13:55.611 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:13:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T13:13:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T13:13:55.822 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:13:55.822 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T13:13:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:13:57.301 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T13:13:57.327 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T13:13:57.327 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:13:57.327 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T13:13:57.327 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:13:57.327 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:13:57.327 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:13:57.552 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T13:13:57.570 INFO:teuthology.orchestra.run.smithi052.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 1.2 MB/s | 3.5 MB 00:03 2024-04-25T13:13:57.574 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T13:13:57.574 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:13:57.574 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T13:13:57.574 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:13:57.575 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:13:57.575 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:13:57.745 INFO:teuthology.orchestra.run.smithi052.stdout:(32/152): ceph-mgr-diskprediction-local-19.0.0- 2.4 MB/s | 7.4 MB 00:03 2024-04-25T13:13:57.862 INFO:teuthology.orchestra.run.smithi052.stdout:(33/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 424 kB/s | 49 kB 00:00 2024-04-25T13:13:57.904 INFO:teuthology.orchestra.run.smithi052.stdout:(34/152): ceph-mgr-modules-core-19.0.0-3156.gd6 745 kB/s | 249 kB 00:00 2024-04-25T13:13:57.940 INFO:teuthology.orchestra.run.smithi052.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3156.gd 212 kB/s | 16 kB 00:00 2024-04-25T13:13:58.011 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T13:13:58.033 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T13:13:58.034 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:13:58.034 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T13:13:58.034 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:13:58.034 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:13:58.034 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:13:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T13:13:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T13:13:58.254 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T13:13:58.316 INFO:teuthology.orchestra.run.smithi052.stdout:(36/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 665 kB/s | 273 kB 00:00 2024-04-25T13:13:58.383 INFO:teuthology.orchestra.run.smithi052.stdout:(37/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 1.7 MB/s | 762 kB 00:00 2024-04-25T13:13:58.424 INFO:teuthology.orchestra.run.smithi052.stdout:(38/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 168 kB/s | 18 kB 00:00 2024-04-25T13:13:58.439 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T13:13:58.489 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T13:13:58.566 INFO:teuthology.orchestra.run.smithi052.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 439 kB/s | 80 kB 00:00 2024-04-25T13:13:58.566 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T13:13:58.657 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:13:58.708 INFO:teuthology.orchestra.run.smithi052.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-04-25T13:13:58.794 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:13:58.816 INFO:teuthology.orchestra.run.smithi052.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-04-25T13:13:58.837 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T13:13:58.867 INFO:teuthology.orchestra.run.smithi052.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-04-25T13:13:58.869 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T13:13:58.913 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T13:13:59.323 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T13:13:59.353 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T13:13:59.385 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-25T13:13:59.425 INFO:teuthology.orchestra.run.smithi052.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 2.0 MB/s | 1.2 MB 00:00 2024-04-25T13:13:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-25T13:13:59.475 INFO:teuthology.orchestra.run.smithi052.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 175 kB/s | 106 kB 00:00 2024-04-25T13:13:59.485 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T13:13:59.542 INFO:teuthology.orchestra.run.smithi052.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-04-25T13:13:59.593 INFO:teuthology.orchestra.run.smithi052.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-04-25T13:13:59.693 INFO:teuthology.orchestra.run.smithi052.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 1.4 MB/s | 215 kB 00:00 2024-04-25T13:13:59.876 INFO:teuthology.orchestra.run.smithi052.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-04-25T13:14:00.019 INFO:teuthology.orchestra.run.smithi052.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-04-25T13:14:00.044 INFO:teuthology.orchestra.run.smithi052.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 642 kB/s | 107 kB 00:00 2024-04-25T13:14:00.069 INFO:teuthology.orchestra.run.smithi052.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 431 kB/s | 21 kB 00:00 2024-04-25T13:14:00.120 INFO:teuthology.orchestra.run.smithi052.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-04-25T13:14:00.145 INFO:teuthology.orchestra.run.smithi052.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 438 kB/s | 33 kB 00:00 2024-04-25T13:14:00.328 INFO:teuthology.orchestra.run.smithi052.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 99 kB/s | 18 kB 00:00 2024-04-25T13:14:00.479 INFO:teuthology.orchestra.run.smithi052.stdout:(55/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.3 MB/s | 3.0 MB 00:00 2024-04-25T13:14:00.504 INFO:teuthology.orchestra.run.smithi052.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 64 kB/s | 11 kB 00:00 2024-04-25T13:14:00.521 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T13:14:00.529 INFO:teuthology.orchestra.run.smithi052.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T13:14:00.554 INFO:teuthology.orchestra.run.smithi052.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-04-25T13:14:00.562 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T13:14:00.613 INFO:teuthology.orchestra.run.smithi052.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-04-25T13:14:00.638 INFO:teuthology.orchestra.run.smithi052.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 6.9 MB/s | 582 kB 00:00 2024-04-25T13:14:00.664 INFO:teuthology.orchestra.run.smithi052.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 521 kB/s | 25 kB 00:00 2024-04-25T13:14:00.689 INFO:teuthology.orchestra.run.smithi052.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-04-25T13:14:00.722 INFO:teuthology.orchestra.run.smithi052.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-04-25T13:14:00.756 INFO:teuthology.orchestra.run.smithi052.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-25T13:14:00.782 INFO:teuthology.orchestra.run.smithi052.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 604 kB/s | 35 kB 00:00 2024-04-25T13:14:01.165 INFO:teuthology.orchestra.run.smithi052.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-25T13:14:01.232 INFO:teuthology.orchestra.run.smithi052.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 10 MB/s | 4.7 MB 00:00 2024-04-25T13:14:01.292 INFO:teuthology.orchestra.run.smithi052.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-25T13:14:01.333 INFO:teuthology.orchestra.run.smithi052.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 9.1 MB/s | 911 kB 00:00 2024-04-25T13:14:01.350 INFO:teuthology.orchestra.run.smithi052.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 133 kB 00:00 2024-04-25T13:14:01.526 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T13:14:01.575 INFO:teuthology.orchestra.run.smithi052.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-04-25T13:14:01.646 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T13:14:01.650 INFO:teuthology.orchestra.run.smithi052.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 18 MB/s | 5.8 MB 00:00 2024-04-25T13:14:01.667 INFO:teuthology.orchestra.run.smithi052.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 957 kB/s | 87 kB 00:00 2024-04-25T13:14:01.749 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T13:14:01.751 INFO:teuthology.orchestra.run.smithi052.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-04-25T13:14:01.908 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-25T13:14:01.918 INFO:teuthology.orchestra.run.smithi052.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-04-25T13:14:01.939 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T13:14:01.943 INFO:teuthology.orchestra.run.smithi052.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-04-25T13:14:01.962 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T13:14:01.962 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:01.962 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T13:14:01.963 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:14:01.963 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:14:01.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:14:01.968 INFO:teuthology.orchestra.run.smithi052.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 517 kB/s | 26 kB 00:00 2024-04-25T13:14:01.993 INFO:teuthology.orchestra.run.smithi052.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-25T13:14:02.007 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T13:14:02.019 INFO:teuthology.orchestra.run.smithi052.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-25T13:14:02.019 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T13:14:02.044 INFO:teuthology.orchestra.run.smithi052.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-04-25T13:14:02.114 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-25T13:14:02.163 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-25T13:14:02.228 INFO:teuthology.orchestra.run.smithi052.stdout:(81/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-04-25T13:14:02.253 INFO:teuthology.orchestra.run.smithi052.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 250 kB 00:00 2024-04-25T13:14:02.278 INFO:teuthology.orchestra.run.smithi052.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-04-25T13:14:02.295 INFO:teuthology.orchestra.run.smithi052.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-04-25T13:14:02.321 INFO:teuthology.orchestra.run.smithi052.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-04-25T13:14:02.346 INFO:teuthology.orchestra.run.smithi052.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-04-25T13:14:02.371 INFO:teuthology.orchestra.run.smithi052.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T13:14:02.396 INFO:teuthology.orchestra.run.smithi052.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-25T13:14:02.422 INFO:teuthology.orchestra.run.smithi052.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T13:14:02.447 INFO:teuthology.orchestra.run.smithi052.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-25T13:14:02.639 INFO:teuthology.orchestra.run.smithi052.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 219 kB/s | 42 kB 00:00 2024-04-25T13:14:02.931 INFO:teuthology.orchestra.run.smithi052.stdout:(92/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-04-25T13:14:02.973 INFO:teuthology.orchestra.run.smithi052.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 133 kB/s | 44 kB 00:00 2024-04-25T13:14:02.998 INFO:teuthology.orchestra.run.smithi052.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-04-25T13:14:03.024 INFO:teuthology.orchestra.run.smithi052.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 722 kB/s | 36 kB 00:00 2024-04-25T13:14:03.049 INFO:teuthology.orchestra.run.smithi052.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-04-25T13:14:03.074 INFO:teuthology.orchestra.run.smithi052.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-25T13:14:03.079 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T13:14:03.100 INFO:teuthology.orchestra.run.smithi052.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-25T13:14:03.110 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T13:14:03.125 INFO:teuthology.orchestra.run.smithi052.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-25T13:14:03.132 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T13:14:03.132 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:03.132 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T13:14:03.133 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:14:03.133 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:14:03.133 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:14:03.150 INFO:teuthology.orchestra.run.smithi052.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T13:14:03.175 INFO:teuthology.orchestra.run.smithi052.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-04-25T13:14:03.177 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T13:14:03.199 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T13:14:03.199 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:03.199 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T13:14:03.199 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:14:03.200 INFO:teuthology.orchestra.run.smithi052.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 446 kB/s | 22 kB 00:00 2024-04-25T13:14:03.234 INFO:teuthology.orchestra.run.smithi052.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 14 MB/s | 863 kB 00:00 2024-04-25T13:14:03.244 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T13:14:03.266 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T13:14:03.266 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:03.267 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T13:14:03.267 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:14:03.267 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:14:03.267 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:14:03.570 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T13:14:03.592 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T13:14:03.592 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:03.592 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T13:14:03.592 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:14:03.592 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:14:03.593 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:14:03.801 INFO:teuthology.orchestra.run.smithi052.stdout:(104/152): ceph-test-19.0.0-3156.gd69f13d8.el7. 2.6 MB/s | 49 MB 00:18 2024-04-25T13:14:04.201 INFO:teuthology.orchestra.run.smithi052.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 49 kB/s | 19 kB 00:00 2024-04-25T13:14:04.335 INFO:teuthology.orchestra.run.smithi052.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 281 kB/s | 309 kB 00:01 2024-04-25T13:14:04.385 INFO:teuthology.orchestra.run.smithi052.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 463 kB/s | 548 kB 00:01 2024-04-25T13:14:04.461 INFO:teuthology.orchestra.run.smithi052.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 207 kB/s | 26 kB 00:00 2024-04-25T13:14:04.494 INFO:teuthology.orchestra.run.smithi052.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 448 kB/s | 49 kB 00:00 2024-04-25T13:14:04.578 INFO:teuthology.orchestra.run.smithi052.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 577 kB/s | 67 kB 00:00 2024-04-25T13:14:04.620 INFO:teuthology.orchestra.run.smithi052.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-04-25T13:14:04.795 INFO:teuthology.orchestra.run.smithi052.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 3.1 MB/s | 548 kB 00:00 2024-04-25T13:14:04.862 INFO:teuthology.orchestra.run.smithi052.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.9 MB/s | 838 kB 00:00 2024-04-25T13:14:04.904 INFO:teuthology.orchestra.run.smithi052.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 401 kB/s | 43 kB 00:00 2024-04-25T13:14:04.971 INFO:teuthology.orchestra.run.smithi052.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 296 kB/s | 32 kB 00:00 2024-04-25T13:14:05.038 INFO:teuthology.orchestra.run.smithi052.stdout:(116/152): libarrow-9.0.0-10.el9.x86_64.rpm 5.3 MB/s | 4.4 MB 00:00 2024-04-25T13:14:05.063 INFO:teuthology.orchestra.run.smithi052.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 94 kB/s | 15 kB 00:00 2024-04-25T13:14:05.088 INFO:teuthology.orchestra.run.smithi052.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-04-25T13:14:05.180 INFO:teuthology.orchestra.run.smithi052.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-04-25T13:14:05.197 INFO:teuthology.orchestra.run.smithi052.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 325 kB/s | 35 kB 00:00 2024-04-25T13:14:05.222 INFO:teuthology.orchestra.run.smithi052.stdout:(121/152): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-04-25T13:14:05.290 INFO:teuthology.orchestra.run.smithi052.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.8 MB/s | 206 kB 00:00 2024-04-25T13:14:05.340 INFO:teuthology.orchestra.run.smithi052.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-04-25T13:14:05.432 INFO:teuthology.orchestra.run.smithi052.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 75 kB/s | 11 kB 00:00 2024-04-25T13:14:05.457 INFO:teuthology.orchestra.run.smithi052.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 151 kB/s | 18 kB 00:00 2024-04-25T13:14:05.507 INFO:teuthology.orchestra.run.smithi052.stdout:(126/152): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-04-25T13:14:05.541 INFO:teuthology.orchestra.run.smithi052.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 212 kB/s | 23 kB 00:00 2024-04-25T13:14:05.566 INFO:teuthology.orchestra.run.smithi052.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 178 kB/s | 19 kB 00:00 2024-04-25T13:14:05.617 INFO:teuthology.orchestra.run.smithi052.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 180 kB/s | 20 kB 00:00 2024-04-25T13:14:05.667 INFO:teuthology.orchestra.run.smithi052.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-04-25T13:14:05.692 INFO:teuthology.orchestra.run.smithi052.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 369 kB/s | 46 kB 00:00 2024-04-25T13:14:05.725 INFO:teuthology.orchestra.run.smithi052.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 726 kB/s | 79 kB 00:00 2024-04-25T13:14:05.776 INFO:teuthology.orchestra.run.smithi052.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 531 kB/s | 58 kB 00:00 2024-04-25T13:14:05.826 INFO:teuthology.orchestra.run.smithi052.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-04-25T13:14:05.851 INFO:teuthology.orchestra.run.smithi052.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 131 kB/s | 16 kB 00:00 2024-04-25T13:14:05.893 INFO:teuthology.orchestra.run.smithi052.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 768 kB/s | 90 kB 00:00 2024-04-25T13:14:05.960 INFO:teuthology.orchestra.run.smithi052.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 211 kB/s | 28 kB 00:00 2024-04-25T13:14:05.985 INFO:teuthology.orchestra.run.smithi052.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 229 kB/s | 31 kB 00:00 2024-04-25T13:14:06.011 INFO:teuthology.orchestra.run.smithi052.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-04-25T13:14:06.069 INFO:teuthology.orchestra.run.smithi052.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 543 kB/s | 59 kB 00:00 2024-04-25T13:14:06.094 INFO:teuthology.orchestra.run.smithi052.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 329 kB/s | 36 kB 00:00 2024-04-25T13:14:06.120 INFO:teuthology.orchestra.run.smithi052.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 469 kB/s | 51 kB 00:00 2024-04-25T13:14:06.212 INFO:teuthology.orchestra.run.smithi052.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-04-25T13:14:06.237 INFO:teuthology.orchestra.run.smithi052.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 631 kB/s | 90 kB 00:00 2024-04-25T13:14:06.262 INFO:teuthology.orchestra.run.smithi052.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-04-25T13:14:06.321 INFO:teuthology.orchestra.run.smithi052.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 183 kB/s | 20 kB 00:00 2024-04-25T13:14:06.346 INFO:teuthology.orchestra.run.smithi052.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-25T13:14:06.413 INFO:teuthology.orchestra.run.smithi052.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-25T13:14:06.489 INFO:teuthology.orchestra.run.smithi052.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 18 MB/s | 1.3 MB 00:00 2024-04-25T13:14:06.597 INFO:teuthology.orchestra.run.smithi052.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-04-25T13:14:07.464 INFO:teuthology.orchestra.run.smithi052.stdout:(151/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 2.8 MB/s | 3.1 MB 00:01 2024-04-25T13:14:08.148 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-25T13:14:08.189 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-25T13:14:08.230 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-25T13:14:08.263 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T13:14:08.290 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T13:14:08.477 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-25T13:14:08.519 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T13:14:08.541 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-25T13:14:08.931 INFO:teuthology.orchestra.run.smithi052.stdout:(152/152): librados2-19.0.0-3156.gd69f13d8.el7. 1.3 MB/s | 3.4 MB 00:02 2024-04-25T13:14:08.940 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:14:08.940 INFO:teuthology.orchestra.run.smithi052.stdout:Total 5.2 MB/s | 222 MB 00:42 2024-04-25T13:14:09.115 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:10.010 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-25T13:14:10.023 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-04-25T13:14:10.094 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T13:14:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T13:14:10.183 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-04-25T13:14:10.183 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-04-25T13:14:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T13:14:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T13:14:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:14:10.332 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:14:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:14:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:14:10.457 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:14:10.521 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:14:12.060 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-04-25T13:14:12.061 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-04-25T13:14:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:14:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-25T13:14:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-25T13:14:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-25T13:14:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T13:14:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T13:14:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T13:14:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T13:14:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T13:14:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T13:14:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T13:14:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T13:14:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:14:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T13:14:18.193 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-04-25T13:14:18.276 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T13:14:18.324 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T13:14:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:14:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:14:18.373 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-04-25T13:14:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:14:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T13:14:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T13:14:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T13:14:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T13:14:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T13:14:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T13:14:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T13:14:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T13:14:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T13:14:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T13:14:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T13:14:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T13:14:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T13:14:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T13:14:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T13:14:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T13:14:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T13:14:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T13:14:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T13:14:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T13:14:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T13:14:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T13:14:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T13:14:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T13:14:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T13:14:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T13:14:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T13:14:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T13:14:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T13:14:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T13:14:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T13:14:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T13:14:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T13:14:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T13:14:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T13:14:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T13:14:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T13:14:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T13:14:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T13:14:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T13:14:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T13:14:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T13:14:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T13:14:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T13:14:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T13:14:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T13:14:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T13:14:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T13:14:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T13:14:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T13:14:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T13:14:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T13:14:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T13:14:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T13:14:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T13:14:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:14:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T13:14:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T13:14:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T13:14:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T13:14:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T13:14:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T13:14:18.386 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T13:14:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T13:14:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:14:18.387 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-25T13:14:18.427 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T13:14:18.461 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T13:14:18.505 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T13:14:18.769 DEBUG:teuthology.parallel:result is None 2024-04-25T13:14:18.849 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T13:14:18.962 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:14:19.086 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:14:19.114 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:14:19.205 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:14:19.242 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T13:14:19.399 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T13:14:19.448 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T13:14:19.475 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:14:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:14:19.610 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T13:14:19.673 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T13:14:19.694 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:14:19.715 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:14:19.861 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:14:19.894 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:14:19.996 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T13:14:20.118 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T13:14:20.151 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T13:14:20.187 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T13:14:20.270 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T13:14:20.318 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T13:14:20.363 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T13:14:20.395 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T13:14:20.423 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T13:14:20.495 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T13:14:20.554 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T13:14:20.583 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T13:14:20.619 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T13:14:20.698 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T13:14:20.733 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-25T13:14:20.773 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-25T13:14:20.802 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-25T13:14:20.875 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T13:14:20.917 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T13:14:20.995 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T13:14:21.139 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T13:14:21.195 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T13:14:21.752 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T13:14:21.833 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T13:14:21.869 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T13:14:21.912 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T13:14:21.950 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-25T13:14:21.992 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T13:14:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T13:14:22.236 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T13:14:22.292 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T13:14:22.367 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T13:14:22.403 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T13:14:22.440 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T13:14:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T13:14:22.539 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T13:14:22.583 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T13:14:22.633 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T13:14:22.778 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T13:14:22.821 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T13:14:22.851 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T13:14:22.894 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T13:14:22.992 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T13:14:23.026 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T13:14:23.066 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T13:14:23.092 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T13:14:23.116 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T13:14:23.188 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T13:14:23.324 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T13:14:23.507 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T13:14:23.535 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T13:14:23.570 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T13:14:23.609 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T13:14:23.649 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T13:14:23.687 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T13:14:23.722 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T13:14:23.755 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T13:14:23.797 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T13:14:23.831 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T13:14:23.921 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T13:14:23.970 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T13:14:24.001 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T13:14:24.049 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T13:14:24.160 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T13:14:24.220 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T13:14:24.987 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T13:14:25.041 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T13:14:25.075 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T13:14:25.179 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T13:14:25.242 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T13:14:25.333 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T13:14:25.368 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T13:14:25.554 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T13:14:25.591 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T13:14:25.671 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T13:14:26.357 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T13:14:26.469 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T13:14:27.794 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T13:14:27.879 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T13:14:27.898 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T13:14:27.926 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T13:14:28.252 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T13:14:28.294 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T13:14:28.377 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T13:14:28.407 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-25T13:14:28.443 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T13:14:28.949 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T13:14:28.999 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T13:14:29.060 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T13:14:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-25T13:14:31.466 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:31.503 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:32.072 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:32.107 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T13:14:32.197 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T13:14:32.197 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T13:14:32.197 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T13:14:32.197 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:14:32.224 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T13:14:44.058 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T13:14:44.058 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-04-25T13:14:44.058 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-04-25T13:14:44.058 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-04-25T13:14:44.058 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-04-25T13:14:44.059 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-04-25T13:14:44.059 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-04-25T13:14:44.059 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-04-25T13:14:44.059 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:14:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T13:14:44.245 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T13:14:44.246 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:44.246 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T13:14:44.246 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:14:45.791 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T13:14:45.817 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T13:14:45.817 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:45.818 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T13:14:45.818 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:14:45.818 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:14:45.818 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:14:46.050 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T13:14:46.073 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T13:14:46.074 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:46.074 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T13:14:46.074 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:14:46.074 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:14:46.074 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:14:46.542 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T13:14:46.566 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T13:14:46.566 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:46.566 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T13:14:46.566 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:14:46.566 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:14:46.566 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:14:46.673 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T13:14:46.731 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T13:14:46.795 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T13:14:46.997 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T13:14:47.043 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T13:14:47.124 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T13:14:47.213 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:14:47.355 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:14:47.393 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T13:14:47.425 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T13:14:47.452 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T13:14:47.832 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T13:14:47.859 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T13:14:47.893 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-25T13:14:47.956 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-25T13:14:47.991 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T13:14:49.088 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T13:14:49.126 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T13:14:50.144 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T13:14:50.168 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T13:14:50.275 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T13:14:50.447 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-25T13:14:50.478 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T13:14:50.501 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T13:14:50.502 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:50.502 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T13:14:50.502 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:14:50.502 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:14:50.502 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:14:50.554 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T13:14:50.564 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T13:14:50.667 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-25T13:14:50.729 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-25T13:14:51.705 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T13:14:51.748 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T13:14:51.772 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T13:14:51.772 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:51.772 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T13:14:51.772 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:14:51.772 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:14:51.773 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:14:51.816 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T13:14:51.839 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T13:14:51.839 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:51.839 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T13:14:51.839 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:14:51.915 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T13:14:51.938 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T13:14:51.938 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:51.938 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T13:14:51.938 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:14:51.939 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:14:51.939 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:14:52.267 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T13:14:52.291 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T13:14:52.291 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:52.291 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T13:14:52.291 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:14:52.291 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:14:52.291 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:14:57.154 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-25T13:14:57.196 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-25T13:14:57.237 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-25T13:14:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T13:14:57.296 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T13:14:57.490 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-25T13:14:57.533 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T13:14:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-25T13:14:58.179 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:58.219 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:58.239 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:59.146 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-25T13:14:59.241 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T13:14:59.283 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T13:14:59.367 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T13:14:59.403 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T13:14:59.403 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:14:59.496 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:14:59.528 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:14:59.528 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:14:59.612 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:14:59.681 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:05.417 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:05.418 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-25T13:15:05.418 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-25T13:15:05.418 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-25T13:15:05.418 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-25T13:15:05.418 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-25T13:15:05.418 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-25T13:15:05.418 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-25T13:15:05.418 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:15:05.418 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:15:05.418 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T13:15:05.418 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-25T13:15:05.418 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-25T13:15:05.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-25T13:15:05.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-25T13:15:05.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-25T13:15:05.431 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-25T13:15:05.431 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-25T13:15:05.431 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-25T13:15:05.431 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-25T13:15:05.431 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-25T13:15:05.431 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-25T13:15:05.431 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-25T13:15:05.431 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-25T13:15:05.431 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-25T13:15:05.431 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T13:15:05.431 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T13:15:05.432 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T13:15:05.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T13:15:05.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T13:15:05.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T13:15:05.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T13:15:05.437 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T13:15:05.438 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:15:05.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T13:15:07.469 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:07.469 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:07.469 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-04-25T13:15:07.469 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.469 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.469 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:07.469 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.471 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T13:15:07.472 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T13:15:07.473 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T13:15:07.474 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T13:15:07.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T13:15:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T13:15:07.477 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.478 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T13:15:07.479 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T13:15:07.480 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T13:15:07.480 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T13:15:07.480 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T13:15:07.480 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.480 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.480 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.480 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T13:15:07.480 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T13:15:07.480 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T13:15:07.480 INFO:teuthology.orchestra.run.smithi052.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T13:15:07.480 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T13:15:07.480 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T13:15:07.481 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T13:15:07.481 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:07.481 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-04-25T13:15:07.872 DEBUG:teuthology.parallel:result is None 2024-04-25T13:15:07.873 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:15:08.100 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T13:15:08.122 INFO:teuthology.orchestra.run.smithi052.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-25T13:15:08.122 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-25T13:15:08.123 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-25T13:15:08.124 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:15:08.340 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T13:15:08.365 INFO:teuthology.orchestra.run.smithi102.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-25T13:15:08.365 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-25T13:15:08.365 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-25T13:15:08.367 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T13:15:08.367 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:08.367 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:15:08.394 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:08.394 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:15:08.434 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T13:15:08.434 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:08.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:15:08.460 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:15:08.523 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:08.524 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:15:08.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:15:08.616 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T13:15:08.617 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:08.617 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:15:08.641 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:15:08.705 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:08.705 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:15:08.731 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:15:08.796 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T13:15:08.796 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:08.797 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:15:08.821 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:15:08.886 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:08.886 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:15:08.909 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:15:08.972 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T13:15:09.058 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T13:15:09.058 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2024-04-25T13:15:09.060 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2024-04-25T13:15:09.084 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T13:15:09.084 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:15:09.125 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:15:09.148 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T13:15:09.148 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:15:09.191 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:15:09.221 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T13:15:09.221 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T13:15:09.221 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T13:15:09.221 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:09.221 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:15:09.269 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:09.379 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:09.404 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:09.404 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:15:09.418 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:09.528 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:09.570 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T13:15:09.570 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T13:15:09.570 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}}', 'email': None, 'first_in_suite': False, 'job_id': '7673468', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': '4d7908725372ec8e17504b848bfa122dd1d43386'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 4060, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph', 'suite_sha1': '4d7908725372ec8e17504b848bfa122dd1d43386', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHN40TN02CFy16TIYygASZdCzCNdeQkDh4GqddIIZ287jmTGqraO2TBL7HUka/rSlKCcEEwg6W3lJLqETzdbRJY=', 'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKZy4LXCxehu78tYMqjlOJPaioDsGf4zKFv9f4XShIUJlKtDMUwcfom9Gf15eDhO9WOi99hh12CaXLiXF9jv24Q='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_12:17:05', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T13:15:09.571 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:15:09.573 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:15:09.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:15:09.628 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:15:09.682 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:09.682 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:15:09.705 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:15:09.705 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-04-25T13:15:09.761 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:15:09.761 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:09.761 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-25T13:15:09.761 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:09.761 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:09.761 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-04-25 13:15:00.046885303 +0000 2024-04-25T13:15:09.761 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-04-25 13:12:26.176426011 +0000 2024-04-25T13:15:09.761 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-04-25 13:12:26.176426011 +0000 2024-04-25T13:15:09.761 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-04-25 13:12:26.176426011 +0000 2024-04-25T13:15:09.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:15:09.823 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-04-25T13:15:09.823 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-04-25T13:15:09.823 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000112598 s, 4.5 MB/s 2024-04-25T13:15:09.824 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:15:09.882 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-04-25T13:15:09.938 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:15:09.938 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:09.938 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T13:15:09.938 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:09.938 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:09.938 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-04-25 13:15:00.047885292 +0000 2024-04-25T13:15:09.938 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-04-25 13:12:26.510422149 +0000 2024-04-25T13:15:09.938 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-04-25 13:12:26.510422149 +0000 2024-04-25T13:15:09.938 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-04-25 13:12:26.510422149 +0000 2024-04-25T13:15:09.939 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:15:10.000 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-04-25T13:15:10.000 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-04-25T13:15:10.000 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000106534 s, 4.8 MB/s 2024-04-25T13:15:10.001 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:15:10.057 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-04-25T13:15:10.112 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:15:10.113 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:10.113 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-25T13:15:10.113 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:10.113 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:10.113 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-04-25 13:15:00.047885292 +0000 2024-04-25T13:15:10.113 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-04-25 13:12:26.835418392 +0000 2024-04-25T13:15:10.113 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-04-25 13:12:26.835418392 +0000 2024-04-25T13:15:10.113 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-04-25 13:12:26.835418392 +0000 2024-04-25T13:15:10.113 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:15:10.175 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-04-25T13:15:10.175 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-04-25T13:15:10.175 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000103298 s, 5.0 MB/s 2024-04-25T13:15:10.177 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:15:10.232 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-04-25T13:15:10.287 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:15:10.288 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:10.288 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-25T13:15:10.288 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:10.288 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:10.288 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-04-25 13:15:00.048885280 +0000 2024-04-25T13:15:10.288 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-04-25 13:12:27.164414589 +0000 2024-04-25T13:15:10.288 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-04-25 13:12:27.164414589 +0000 2024-04-25T13:15:10.288 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-04-25 13:12:27.164414589 +0000 2024-04-25T13:15:10.288 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:15:10.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-04-25T13:15:10.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-04-25T13:15:10.351 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000105418 s, 4.9 MB/s 2024-04-25T13:15:10.352 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:15:10.407 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:10.407 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:10.407 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:15:10.424 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:15:10.424 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-04-25T13:15:10.479 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:15:10.479 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:10.479 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T13:15:10.479 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:10.479 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:10.479 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-04-25 13:14:10.893763955 +0000 2024-04-25T13:15:10.479 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-04-25 13:12:18.775271003 +0000 2024-04-25T13:15:10.479 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-04-25 13:12:18.775271003 +0000 2024-04-25T13:15:10.479 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-04-25 13:12:18.775271003 +0000 2024-04-25T13:15:10.479 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:15:10.541 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-04-25T13:15:10.541 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-04-25T13:15:10.541 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000280698 s, 1.8 MB/s 2024-04-25T13:15:10.543 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:15:10.598 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-04-25T13:15:10.653 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:15:10.653 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:10.653 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T13:15:10.654 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:10.654 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:10.654 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-04-25 13:14:10.894763935 +0000 2024-04-25T13:15:10.654 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-04-25 13:12:19.122263746 +0000 2024-04-25T13:15:10.654 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-04-25 13:12:19.122263746 +0000 2024-04-25T13:15:10.654 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-04-25 13:12:19.122263746 +0000 2024-04-25T13:15:10.654 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:15:10.716 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-04-25T13:15:10.716 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-04-25T13:15:10.716 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000189125 s, 2.7 MB/s 2024-04-25T13:15:10.717 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:15:10.772 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-04-25T13:15:10.828 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:15:10.828 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:10.828 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T13:15:10.828 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:10.828 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:10.828 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-04-25 13:14:10.894763935 +0000 2024-04-25T13:15:10.828 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-04-25 13:12:19.460256677 +0000 2024-04-25T13:15:10.828 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-04-25 13:12:19.460256677 +0000 2024-04-25T13:15:10.828 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-04-25 13:12:19.460256677 +0000 2024-04-25T13:15:10.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:15:10.889 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-04-25T13:15:10.889 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-04-25T13:15:10.889 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000214381 s, 2.4 MB/s 2024-04-25T13:15:10.891 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:15:10.946 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-04-25T13:15:11.000 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:15:11.001 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:11.001 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T13:15:11.001 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:11.001 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:11.001 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-04-25 13:14:10.894763935 +0000 2024-04-25T13:15:11.001 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-04-25 13:12:19.826249023 +0000 2024-04-25T13:15:11.001 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-04-25 13:12:19.826249023 +0000 2024-04-25T13:15:11.001 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-04-25 13:12:19.826249023 +0000 2024-04-25T13:15:11.002 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:15:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-04-25T13:15:11.062 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-04-25T13:15:11.063 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000183699 s, 2.8 MB/s 2024-04-25T13:15:11.064 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:15:11.119 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:11.119 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T13:15:11.119 INFO:tasks.ceph:Generating config... 2024-04-25T13:15:11.120 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T13:15:11.120 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-25T13:15:11.120 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T13:15:11.121 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T13:15:11.121 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T13:15:11.121 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T13:15:11.121 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T13:15:11.121 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T13:15:11.121 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T13:15:11.121 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-25T13:15:11.121 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-25T13:15:11.121 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-25T13:15:11.121 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-25T13:15:11.121 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T13:15:11.121 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T13:15:11.121 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-25T13:15:11.121 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T13:15:11.121 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T13:15:11.122 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T13:15:11.123 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T13:15:11.123 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T13:15:11.123 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T13:15:11.123 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T13:15:11.123 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T13:15:11.123 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T13:15:11.123 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T13:15:11.123 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T13:15:11.123 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T13:15:11.123 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T13:15:11.123 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-25T13:15:11.123 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T13:15:11.123 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T13:15:11.123 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T13:15:11.123 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-25T13:15:11.124 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-25T13:15:11.124 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-25T13:15:11.124 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-25T13:15:11.124 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T13:15:11.124 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T13:15:11.124 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T13:15:11.124 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T13:15:11.124 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T13:15:11.124 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T13:15:11.124 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T13:15:11.191 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T13:15:11.194 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T13:15:11.235 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:15:11.300 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52'), ('mon.b', '172.21.15.102'), ('mon.c', '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]')] 2024-04-25T13:15:11.300 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T13:15:11.301 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:11.301 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T13:15:11.355 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --add b 172.21.15.102 --addv c '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:11.441 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:11.441 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid 223f60a6-8e09-4413-a2a5-fc4244f2a674 2024-04-25T13:15:11.441 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = quincy 2024-04-25T13:15:11.441 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2024-04-25T13:15:11.441 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 223f60a6-8e09-4413-a2a5-fc4244f2a674 2024-04-25T13:15:11.441 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2024-04-25T13:15:11.442107+0000 2024-04-25T13:15:11.441 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-04-25T13:15:11.442107+0000 2024-04-25T13:15:11.441 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 17 (quincy) 2024-04-25T13:15:11.441 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2024-04-25T13:15:11.441 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-04-25T13:15:11.442 INFO:teuthology.orchestra.run.smithi052.stdout:1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-04-25T13:15:11.442 INFO:teuthology.orchestra.run.smithi052.stdout:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-04-25T13:15:11.442 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T13:15:11.443 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T13:15:11.457 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 223f60a6-8e09-4413-a2a5-fc4244f2a674... 2024-04-25T13:15:11.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:15:11.500 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:15:11.539 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-04-25T13:15:11.539 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-04-25T13:15:11.539 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:15:11.539 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-04-25T13:15:11.539 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.539 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-04-25T13:15:11.539 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.539 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-04-25T13:15:11.539 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.539 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-04-25T13:15:11.539 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-04-25T13:15:11.540 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.541 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 223f60a6-8e09-4413-a2a5-fc4244f2a674 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-04-25T13:15:11.542 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.543 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 20 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 20 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 10 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: mon client directed command retry = 5 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-04-25T13:15:11.544 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: ms inject delay max = 1 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: ms inject delay probability = 0.005 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: ms inject delay type = client mds 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: ms inject socket failures = 2500 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: osd blocked scrub grace period = 3600 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: osd max markdown count = 1000 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-04-25T13:15:11.545 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-04-25T13:15:11.546 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:15:11.547 INFO:teuthology.orchestra.run.smithi052.stdout: mon down mkfs grace = 300 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: mon op complaint time = 120 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: client mount timeout = 600 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: client_shutdown_timeout = 120 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2024-04-25T13:15:11.548 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.e] 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.f] 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout:[mds] 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds = 20 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds balancer = 20 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout: mds bal fragment size max = 10000 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout: mds bal merge size = 5 2024-04-25T13:15:11.549 INFO:teuthology.orchestra.run.smithi052.stdout: mds bal split bits = 3 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: mds bal split size = 100 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug frag = True 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug scatterstat = True 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: mds oft prefetch dirfrags = True 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: mds op complaint time = 180 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: mds verify scatter = True 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: mds_dir_prefetch = True 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: mon client directed command retry = 5 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: ms inject delay max = 1 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: ms inject delay probability = 0.005 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: ms inject delay type = client mds osd 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: ms inject socket failures = 2500 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2024-04-25T13:15:11.550 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2024-04-25T13:15:11.551 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2024-04-25T13:15:11.552 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-04-25T13:15:11.552 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-04-25T13:15:11.552 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:15:11.552 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-04-25T13:15:11.552 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.552 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-04-25T13:15:11.552 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.552 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-04-25T13:15:11.553 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:15:11.554 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.52,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 223f60a6-8e09-4413-a2a5-fc4244f2a674 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.555 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:15:11.556 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2024-04-25T13:15:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: mon client directed command retry = 5 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: ms inject delay max = 1 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: ms inject delay probability = 0.005 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: ms inject delay type = client mds 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: ms inject socket failures = 2500 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: osd blocked scrub grace period = 3600 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: osd max markdown count = 1000 2024-04-25T13:15:11.558 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-04-25T13:15:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:15:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: mon down mkfs grace = 300 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:15:11.561 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout: client_shutdown_timeout = 120 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.e] 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-04-25T13:15:11.562 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.f] 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal fragment size max = 10000 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal merge size = 5 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split bits = 3 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split size = 100 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: mds oft prefetch dirfrags = True 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: mds_dir_prefetch = True 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T13:15:11.563 INFO:teuthology.orchestra.run.smithi102.stdout: mon client directed command retry = 5 2024-04-25T13:15:11.564 INFO:teuthology.orchestra.run.smithi102.stdout: ms inject delay max = 1 2024-04-25T13:15:11.564 INFO:teuthology.orchestra.run.smithi102.stdout: ms inject delay probability = 0.005 2024-04-25T13:15:11.564 INFO:teuthology.orchestra.run.smithi102.stdout: ms inject delay type = client mds osd 2024-04-25T13:15:11.564 INFO:teuthology.orchestra.run.smithi102.stdout: ms inject socket failures = 2500 2024-04-25T13:15:11.564 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-04-25T13:15:11.564 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-04-25T13:15:11.564 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-04-25T13:15:11.564 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T13:15:11.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T13:15:11.645 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T13:15:11.645 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:11.646 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T13:15:11.660 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:11.660 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T13:15:11.716 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:15:11.716 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:11.716 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:15:11.716 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:15:11.789 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:11.789 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:11.845 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2024-04-25T13:15:11.845 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:11.845 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:15:11.845 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:15:11.877 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:11.878 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:11.932 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T13:15:11.932 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T13:15:11.932 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T13:15:11.982 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T13:15:11.984 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T13:15:12.037 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T13:15:12.039 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T13:15:12.040 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T13:15:12.089 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T13:15:12.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T13:15:12.116 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T13:15:12.206 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T13:15:12.209 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T13:15:12.233 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T13:15:12.322 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T13:15:12.324 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-25T13:15:12.348 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T13:15:12.397 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T13:15:12.399 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T13:15:12.423 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T13:15:12.510 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T13:15:12.512 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T13:15:12.535 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T13:15:12.623 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T13:15:12.626 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-25T13:15:12.649 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T13:15:12.649 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T13:15:12.690 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T13:15:12.703 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T13:15:12.703 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T13:15:12.703 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T13:15:12.767 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:12.767 INFO:tasks.ceph:role: osd.0 2024-04-25T13:15:12.767 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:15:12.768 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T13:15:12.831 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:12.831 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:12.832 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:12.832 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:12.832 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:12.832 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:12.832 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:12.832 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:12.832 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:12.832 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:12.864 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-04-25T13:15:12.866 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-04-25T13:15:12.866 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T13:15:12.935 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T13:15:13.003 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T13:15:13.068 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:13.068 INFO:tasks.ceph:role: osd.1 2024-04-25T13:15:13.069 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:15:13.069 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T13:15:13.132 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:13.132 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:13.132 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:13.132 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:13.133 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:13.133 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:13.133 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:13.133 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:13.133 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:13.133 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:13.165 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-04-25T13:15:13.166 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-04-25T13:15:13.167 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T13:15:13.237 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T13:15:13.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T13:15:13.371 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:13.371 INFO:tasks.ceph:role: osd.2 2024-04-25T13:15:13.371 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:15:13.371 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T13:15:13.434 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:13.435 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:13.435 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:13.435 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:13.435 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:13.435 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:13.435 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:13.435 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:13.435 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:13.435 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:13.469 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-04-25T13:15:13.471 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-04-25T13:15:13.472 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T13:15:13.545 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T13:15:13.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T13:15:13.679 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:13.679 INFO:tasks.ceph:role: osd.3 2024-04-25T13:15:13.679 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:15:13.679 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T13:15:13.744 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:13.744 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:13.744 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:13.744 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:13.744 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:13.744 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:13.744 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:13.744 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:13.745 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:13.745 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:13.776 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-04-25T13:15:13.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-04-25T13:15:13.778 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T13:15:13.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T13:15:13.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:14.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:14.018+0000 7f0c5dafd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T13:15:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:14.018+0000 7f0c5dafd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T13:15:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:14.018+0000 7f0c5dafd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:15:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:14.018+0000 7f0c5dafd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:15:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:14.018+0000 7f0c5dafd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:15:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:14.018+0000 7f0c5dafd640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T13:15:16.869 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T13:15:16.899 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:16.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:16.991+0000 7f52851c0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T13:15:16.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:16.991+0000 7f52851c0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T13:15:16.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:16.991+0000 7f52851c0640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:15:16.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:16.991+0000 7f52851c0640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:15:16.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:16.991+0000 7f52851c0640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:15:16.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:16.991+0000 7f52851c0640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T13:15:19.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T13:15:19.880 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:19.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:19.972+0000 7f3d5872c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T13:15:19.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:19.972+0000 7f3d5872c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T13:15:19.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:19.972+0000 7f3d5872c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:15:19.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:19.972+0000 7f3d5872c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:15:19.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:19.972+0000 7f3d5872c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:15:19.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:19.972+0000 7f3d5872c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T13:15:22.828 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T13:15:22.857 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:22.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:22.948+0000 7f79aec17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T13:15:22.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:22.948+0000 7f79aec17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T13:15:22.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:22.948+0000 7f79aec17640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:15:22.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:22.948+0000 7f79aec17640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:15:22.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:22.948+0000 7f79aec17640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:15:22.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:22.949+0000 7f79aec17640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T13:15:25.791 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T13:15:25.820 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T13:15:25.848 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:25.848 INFO:tasks.ceph:role: osd.4 2024-04-25T13:15:25.849 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2024-04-25T13:15:25.849 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T13:15:25.924 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:25.924 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:25.924 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:25.924 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:25.924 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:25.924 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:25.924 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:25.924 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:25.924 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:25.924 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:26.433 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-04-25T13:15:26.435 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-04-25T13:15:26.435 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T13:15:26.549 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T13:15:26.581 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T13:15:26.648 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:26.648 INFO:tasks.ceph:role: osd.5 2024-04-25T13:15:26.648 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2024-04-25T13:15:26.648 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T13:15:26.720 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:26.720 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:26.720 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:26.720 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:26.720 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:26.720 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:26.720 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:26.721 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:26.721 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:26.721 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:27.183 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-04-25T13:15:27.185 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-04-25T13:15:27.185 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T13:15:27.278 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T13:15:27.308 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T13:15:27.374 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:27.374 INFO:tasks.ceph:role: osd.6 2024-04-25T13:15:27.374 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2024-04-25T13:15:27.374 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T13:15:27.446 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:27.446 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:27.447 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:27.447 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:27.447 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:27.447 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:27.447 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:27.447 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:27.447 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:27.447 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:27.933 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-04-25T13:15:27.935 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-04-25T13:15:27.935 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T13:15:28.085 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T13:15:28.117 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T13:15:28.185 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:28.185 INFO:tasks.ceph:role: osd.7 2024-04-25T13:15:28.185 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com 2024-04-25T13:15:28.186 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T13:15:28.259 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:28.259 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:28.259 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:28.260 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:28.260 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:28.260 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:28.260 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:28.260 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:28.260 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:28.260 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:28.775 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-04-25T13:15:28.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-04-25T13:15:28.778 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T13:15:28.898 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T13:15:28.931 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:29.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:29.027+0000 7feaac60c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T13:15:29.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:29.027+0000 7feaac60c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T13:15:29.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:29.027+0000 7feaac60c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:15:29.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:29.027+0000 7feaac60c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:15:29.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:29.027+0000 7feaac60c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:15:29.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:29.027+0000 7feaac60c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T13:15:31.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T13:15:31.906 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:31.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:31.995+0000 7fb911b2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T13:15:31.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:31.995+0000 7fb911b2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T13:15:31.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:31.995+0000 7fb911b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:15:31.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:31.995+0000 7fb911b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:15:31.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:31.995+0000 7fb911b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:15:31.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:31.996+0000 7fb911b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T13:15:34.839 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T13:15:34.867 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:34.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:34.956+0000 7f524340d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T13:15:34.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:34.957+0000 7f524340d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T13:15:34.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:34.957+0000 7f524340d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:15:34.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:34.957+0000 7f524340d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:15:34.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:34.957+0000 7f524340d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:15:34.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:34.957+0000 7f524340d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T13:15:37.811 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T13:15:37.840 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:37.930+0000 7f97a2832640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T13:15:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:37.930+0000 7f97a2832640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T13:15:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:37.931+0000 7f97a2832640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:15:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:37.931+0000 7f97a2832640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:15:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:37.931+0000 7f97a2832640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:15:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:37.931+0000 7f97a2832640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T13:15:39.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:39.575 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:40.775 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T13:15:40.803 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T13:15:40.803 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:40.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T13:15:40.833 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:40.833 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T13:15:40.901 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:40.901 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T13:15:40.968 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:40.969 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-25T13:15:41.036 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:41.036 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T13:15:41.102 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:41.102 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T13:15:41.168 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:41.168 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T13:15:41.234 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:41.234 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T13:15:41.299 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:41.299 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T13:15:41.327 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:41.327 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T13:15:41.394 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:41.394 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T13:15:41.459 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:41.459 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-25T13:15:41.525 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:41.525 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T13:15:41.589 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:41.589 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T13:15:41.652 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:41.652 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T13:15:41.716 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:41.716 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T13:15:41.780 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:41.780 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T13:15:41.799 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T13:15:41.799 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T13:15:41.841 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T13:15:41.863 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2024-04-25T13:15:41.863 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBfVypmWGWaOhAAW8ib5RioBCeJk8PQG5Sw8Q== 2024-04-25T13:15:41.863 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-04-25T13:15:41.863 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBgVypmfwlwBRAAj0mOIqQU1eBxsOIZ3PkHDg== 2024-04-25T13:15:41.863 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-04-25T13:15:41.863 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBgVypmT+5lDBAAz3+uGhx/JmRRePnbL5sxuw== 2024-04-25T13:15:41.863 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.e] 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBgVypmXsxHExAAn1ZczVysSKb4rBCf3QAoQw== 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBiVypm0lAoARAACCcyHqVdJNUdMmxLmkJLkw== 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBkVypmCY0nOxAAjP4LkfhGZqmINedsZZwBfA== 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBnVypmVCsEOhAA3hrPI9OecbaaWOWRrnqwjQ== 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBqVypmjUmaOBAAxy6dD5lCqfNVAqgW7grzUg== 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBgVypmAydMAhAACWpLvLNJhNjDs+d7kZFtYg== 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBgVypm5eLAFxAA6WOOrG+hEqRBtcnAqVQL6w== 2024-04-25T13:15:41.864 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBgVypmrO2AHhAA+QPECR/Vr11sHxoCQLPpig== 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.f] 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBgVypmPw0/JRAAqCQUU0BoIwp9qX/CJ5Q9vQ== 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.4] 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBxVypmMGusARAAL4cegQTt/s9SM/esTBTR7A== 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.5] 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBzVypmgo5jOxAA141wxu/WH7QLIleI2MXw/g== 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.6] 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQB2VypmqIsZORAAbGMdegrAexnSecNHyRVR/A== 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.7] 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQB5Vypm9sWJNxAASi+ZaXwBqP5eFV9819ByoA== 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2024-04-25T13:15:41.865 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBgVypmQJc+KRAAwL/uYc23VGmQVQJnsMVnUw== 2024-04-25T13:15:41.866 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2024-04-25T13:15:41.866 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBfVypmWGWaOhAAW8ib5RioBCeJk8PQG5Sw8Q== 2024-04-25T13:15:41.866 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBgVypmfwlwBRAAj0mOIqQU1eBxsOIZ3PkHDg== 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBgVypmT+5lDBAAz3+uGhx/JmRRePnbL5sxuw== 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.e] 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBgVypmXsxHExAAn1ZczVysSKb4rBCf3QAoQw== 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBiVypm0lAoARAACCcyHqVdJNUdMmxLmkJLkw== 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBkVypmCY0nOxAAjP4LkfhGZqmINedsZZwBfA== 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBnVypmVCsEOhAA3hrPI9OecbaaWOWRrnqwjQ== 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBqVypmjUmaOBAAxy6dD5lCqfNVAqgW7grzUg== 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2024-04-25T13:15:41.867 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBgVypmAydMAhAACWpLvLNJhNjDs+d7kZFtYg== 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBgVypm5eLAFxAA6WOOrG+hEqRBtcnAqVQL6w== 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBgVypmrO2AHhAA+QPECR/Vr11sHxoCQLPpig== 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.f] 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBgVypmPw0/JRAAqCQUU0BoIwp9qX/CJ5Q9vQ== 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.4] 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBxVypmMGusARAAL4cegQTt/s9SM/esTBTR7A== 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.5] 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBzVypmgo5jOxAA141wxu/WH7QLIleI2MXw/g== 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.6] 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQB2VypmqIsZORAAbGMdegrAexnSecNHyRVR/A== 2024-04-25T13:15:41.868 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.7] 2024-04-25T13:15:41.869 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQB5Vypm9sWJNxAASi+ZaXwBqP5eFV9819ByoA== 2024-04-25T13:15:41.869 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-04-25T13:15:41.869 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBgVypmQJc+KRAAwL/uYc23VGmQVQJnsMVnUw== 2024-04-25T13:15:41.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:15:41.913 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:15:41.966 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:41.968 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:42.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:42.023 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:42.075 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:42.077 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:42.128 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.131 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.181 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.229 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.231 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.279 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.282 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.330 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:15:42.332 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:15:42.381 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:42.383 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:42.435 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:42.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:42.488 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:42.491 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:42.543 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.545 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.594 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.645 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.647 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.698 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:42.746 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:15:42.749 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:15:42.800 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T13:15:42.800 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T13:15:42.824 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:15:42.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T13:15:42.944 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T13:15:42.967 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:15:43.060 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T13:15:43.084 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T13:15:43.147 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:15:43.241 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T13:15:43.263 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:43.266 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:43.318 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T13:15:43.318 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T13:15:43.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T13:15:43.321 INFO:tasks.ceph.mon.a:Started 2024-04-25T13:15:43.321 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T13:15:43.321 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T13:15:43.361 INFO:tasks.ceph.mon.b:Started 2024-04-25T13:15:43.361 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T13:15:43.362 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T13:15:43.363 INFO:tasks.ceph.mon.c:Started 2024-04-25T13:15:43.363 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T13:15:43.364 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T13:15:43.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T13:15:43.366 INFO:tasks.ceph.mgr.y:Started 2024-04-25T13:15:43.366 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T13:15:43.366 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T13:15:43.368 INFO:tasks.ceph.mgr.x:Started 2024-04-25T13:15:43.368 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T13:15:43.368 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T13:15:43.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.468+0000 7f89b515d640 1 Processor -- start 2024-04-25T13:15:43.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.469+0000 7f89b515d640 1 -- start start 2024-04-25T13:15:43.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.469+0000 7f89b515d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f89b00cb7c0 0x7f89b01668d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:43.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.469+0000 7f89b515d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89b015b360 con 0x7f89b00cb350 2024-04-25T13:15:43.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.469+0000 7f89b515d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89b015b640 con 0x7f89b0155300 2024-04-25T13:15:43.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.469+0000 7f89b515d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f89b00c9a30 con 0x7f89b00cb7c0 2024-04-25T13:15:43.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.469+0000 7f89a7fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f89b00cb350 0x7f89b00710a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40452/0 (socket says 172.21.15.52:40452) 2024-04-25T13:15:43.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.469+0000 7f89a7fff640 1 -- 172.21.15.52:0/3011948376 learned_addr learned my addr 172.21.15.52:0/3011948376 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:15:43.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.470+0000 7f89af59e640 1 --2- 172.21.15.52:0/3011948376 >> v2:172.21.15.102:3300/0 conn(0x7f89b00cb7c0 0x7f89b01668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:43.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.470+0000 7f89af59e640 1 -- 172.21.15.52:0/3011948376 >> v2:172.21.15.102:3300/0 conn(0x7f89b00cb7c0 msgr2=0x7f89b01668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:15:43.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.470+0000 7f89af59e640 1 -- 172.21.15.52:0/3011948376 >> v2:172.21.15.102:3300/0 conn(0x7f89b00cb7c0 msgr2=0x7f89b01668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:43.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.470+0000 7f89af59e640 1 --2- 172.21.15.52:0/3011948376 >> v2:172.21.15.102:3300/0 conn(0x7f89b00cb7c0 0x7f89b01668d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:43.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.470+0000 7f89af59e640 1 --2- 172.21.15.52:0/3011948376 >> v2:172.21.15.102:3300/0 conn(0x7f89b00cb7c0 0x7f89b01668d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:15:43.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.637+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529308724 0 0) 0x7f89b015b360 con 0x7f89b00cb350 2024-04-25T13:15:43.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.637+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f899c003520 con 0x7f89b00cb350 2024-04-25T13:15:43.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.637+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 590921534 0 0) 0x7f89b015b640 con 0x7f89b0155300 2024-04-25T13:15:43.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.637+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89b015b360 con 0x7f89b0155300 2024-04-25T13:15:43.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.637+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1223745488 0 0) 0x7f899c003520 con 0x7f89b00cb350 2024-04-25T13:15:43.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.637+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 >> v2:172.21.15.102:3300/0 conn(0x7f89b00cb7c0 msgr2=0x7f89b01668d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:15:43.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89ae59c640 1 --2- 172.21.15.52:0/3011948376 >> v2:172.21.15.102:3300/0 conn(0x7f89b00cb7c0 0x7f89b01668d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 >> v1:172.21.15.102:6789/0 conn(0x7f89b0155300 legacy=0x7f89b015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b015b920 con 0x7f89b00cb350 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f8998001670 con 0x7f89b00cb350 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 >> v1:172.21.15.52:6789/0 conn(0x7f89b00cb350 legacy=0x7f89b00710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89ae59c640 1 --2- 172.21.15.52:0/3011948376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f899c003b70 0x7f899c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89ae59c640 1 --2- 172.21.15.52:0/3011948376 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f899c004800 0x7f899c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89ae59c640 1 --2- 172.21.15.52:0/3011948376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f899c0051c0 0x7f899c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f89b00c9a30 con 0x7f899c003b70 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f899c00c0c0 con 0x7f899c0051c0 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f899c00c2c0 con 0x7f899c004800 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89aed9d640 1 --2- 172.21.15.52:0/3011948376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f899c003b70 0x7f899c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89a7fff640 1 --2- 172.21.15.52:0/3011948376 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f899c004800 0x7f899c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89af59e640 1 --2- 172.21.15.52:0/3011948376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f899c0051c0 0x7f899c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:43.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89aed9d640 1 -- 172.21.15.52:0/3011948376 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f899c004800 msgr2=0x7f899c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:43.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89aed9d640 1 --2- 172.21.15.52:0/3011948376 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f899c004800 0x7f899c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:43.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89aed9d640 1 -- 172.21.15.52:0/3011948376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f899c0051c0 msgr2=0x7f899c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:43.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89aed9d640 1 --2- 172.21.15.52:0/3011948376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f899c0051c0 0x7f899c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:43.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89aed9d640 1 -- 172.21.15.52:0/3011948376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c003520 con 0x7f899c003b70 2024-04-25T13:15:43.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89af59e640 1 -- 172.21.15.52:0/3011948376 reap_dead start 2024-04-25T13:15:43.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.638+0000 7f89a7fff640 1 --2- 172.21.15.52:0/3011948376 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f899c004800 0x7f899c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:15:43.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.639+0000 7f89aed9d640 1 --2- 172.21.15.52:0/3011948376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f899c003b70 0x7f899c003f50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f89a0007f00 tx=0x7f899c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e457f28c828dbe79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:43.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.640+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0007ad0 con 0x7f899c003b70 2024-04-25T13:15:43.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.640+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a0005070 con 0x7f899c003b70 2024-04-25T13:15:43.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.640+0000 7f89ae59c640 1 -- 172.21.15.52:0/3011948376 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a00035f0 con 0x7f899c003b70 2024-04-25T13:15:43.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.640+0000 7f89b515d640 1 -- 172.21.15.52:0/3011948376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f899c003b70 msgr2=0x7f899c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.640+0000 7f89b515d640 1 --2- 172.21.15.52:0/3011948376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f899c003b70 0x7f899c003f50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f89a0007f00 tx=0x7f899c005830 comp rx=0 tx=0).stop 2024-04-25T13:15:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.640+0000 7f89b515d640 1 -- 172.21.15.52:0/3011948376 shutdown_connections 2024-04-25T13:15:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.640+0000 7f89b515d640 1 --2- 172.21.15.52:0/3011948376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f899c003b70 0x7f899c003f50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.640+0000 7f89b515d640 1 -- 172.21.15.52:0/3011948376 >> 172.21.15.52:0/3011948376 conn(0x7f89b0074f30 msgr2=0x7f89b0075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.640+0000 7f89b515d640 1 -- 172.21.15.52:0/3011948376 shutdown_connections 2024-04-25T13:15:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.640+0000 7f89b515d640 1 -- 172.21.15.52:0/3011948376 wait complete. 2024-04-25T13:15:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.642+0000 7f89b515d640 1 Processor -- start 2024-04-25T13:15:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.642+0000 7f89b515d640 1 -- start start 2024-04-25T13:15:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89b515d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f899c003b70 0x7f89b01541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89b515d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89b0156240 0x7f89b015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89b515d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89b0156fd0 0x7f89b0152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89b515d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f89b00cbba0 con 0x7f899c003b70 2024-04-25T13:15:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89b515d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f89b015e760 con 0x7f89b0156fd0 2024-04-25T13:15:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89b515d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f89b006d4d0 con 0x7f89b0156240 2024-04-25T13:15:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89aed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f899c003b70 0x7f89b01541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89aed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f899c003b70 0x7f89b01541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52298/0 (socket says 172.21.15.52:52298) 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89aed9d640 1 -- 172.21.15.52:0/128560821 learned_addr learned my addr 172.21.15.52:0/128560821 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89a7fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89b0156240 0x7f89b015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89af59e640 1 --2- 172.21.15.52:0/128560821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89b0156fd0 0x7f89b0152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89af59e640 1 -- 172.21.15.52:0/128560821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89b0156240 msgr2=0x7f89b015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89af59e640 1 --2- 172.21.15.52:0/128560821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89b0156240 0x7f89b015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89af59e640 1 -- 172.21.15.52:0/128560821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f899c003b70 msgr2=0x7f89b01541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89af59e640 1 --2- 172.21.15.52:0/128560821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f899c003b70 0x7f89b01541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.643+0000 7f89af59e640 1 -- 172.21.15.52:0/128560821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b00c61f0 con 0x7f89b0156fd0 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.644+0000 7f89af59e640 1 --2- 172.21.15.52:0/128560821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89b0156fd0 0x7f89b0152c90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f89b00cbde0 tx=0x7f89a800f5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.644+0000 7f89a77fe640 1 -- 172.21.15.52:0/128560821 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a801a070 con 0x7f89b0156fd0 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.644+0000 7f89a77fe640 1 -- 172.21.15.52:0/128560821 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a8009c90 con 0x7f89b0156fd0 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.644+0000 7f89b515d640 1 -- 172.21.15.52:0/128560821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b0154850 con 0x7f89b0156fd0 2024-04-25T13:15:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.644+0000 7f89a77fe640 1 -- 172.21.15.52:0/128560821 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8003bd0 con 0x7f89b0156fd0 2024-04-25T13:15:43.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.644+0000 7f89b515d640 1 -- 172.21.15.52:0/128560821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b01f44a0 con 0x7f89b0156fd0 2024-04-25T13:15:43.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.644+0000 7f89a77fe640 1 -- 172.21.15.52:0/128560821 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f89a8005d10 con 0x7f89b0156fd0 2024-04-25T13:15:43.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.644+0000 7f89a77fe640 1 -- 172.21.15.52:0/128560821 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f89a800a390 con 0x7f89b0156fd0 2024-04-25T13:15:43.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.645+0000 7f89b515d640 1 -- 172.21.15.52:0/128560821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89b0068f50 con 0x7f89b0156fd0 2024-04-25T13:15:43.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.647+0000 7f89a77fe640 1 -- 172.21.15.52:0/128560821 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f89a8036e50 con 0x7f89b0156fd0 2024-04-25T13:15:43.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.715+0000 7f89b515d640 1 -- 172.21.15.52:0/128560821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f89b014f380 con 0x7f89b0156fd0 2024-04-25T13:15:43.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.718+0000 7f89a77fe640 1 -- 172.21.15.52:0/128560821 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f89a8025090 con 0x7f89b0156fd0 2024-04-25T13:15:43.719 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-04-25T13:15:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.719+0000 7f89b515d640 1 -- 172.21.15.52:0/128560821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89b0156fd0 msgr2=0x7f89b0152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.719+0000 7f89b515d640 1 --2- 172.21.15.52:0/128560821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89b0156fd0 0x7f89b0152c90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f89b00cbde0 tx=0x7f89a800f5e0 comp rx=0 tx=0).stop 2024-04-25T13:15:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.719+0000 7f89b515d640 1 -- 172.21.15.52:0/128560821 shutdown_connections 2024-04-25T13:15:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.719+0000 7f89b515d640 1 --2- 172.21.15.52:0/128560821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89b0156240 0x7f89b015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.719+0000 7f89b515d640 1 --2- 172.21.15.52:0/128560821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89b0156fd0 0x7f89b0152c90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.719+0000 7f89b515d640 1 --2- 172.21.15.52:0/128560821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f899c003b70 0x7f89b01541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.719+0000 7f89b515d640 1 -- 172.21.15.52:0/128560821 >> 172.21.15.52:0/128560821 conn(0x7f89b0074f30 msgr2=0x7f89b0159c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.719+0000 7f89b515d640 1 -- 172.21.15.52:0/128560821 shutdown_connections 2024-04-25T13:15:43.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:43.719+0000 7f89b515d640 1 -- 172.21.15.52:0/128560821 wait complete. 2024-04-25T13:15:43.731 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T13:15:43.731 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T13:15:43.731 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:43.731 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T13:15:43.741 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:43.741+0000 7f060200d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:15:43.755 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:43.755+0000 7f94bd3dc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:15:43.755 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:43.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T13:15:43.820 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:43.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T13:15:43.884 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:15:43.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T13:15:43.890 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:43.891+0000 7f060200d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:15:43.922 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:43.922+0000 7f94bd3dc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:15:43.943 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:43.943+0000 7f060200d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:15:43.945 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:43.946 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T13:15:43.969 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:43.969 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T13:15:43.979 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:43.979+0000 7f94bd3dc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:15:44.032 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:44.032 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T13:15:44.096 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-25T13:15:44.096 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T13:15:44.161 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new ca31ab05-06c2-4777-8bfe-f23439eb52fc 0 2024-04-25T13:15:44.217 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:44.218+0000 7f060200d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:15:44.227 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:44.227+0000 7f94bd3dc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:15:44.266 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:44.266+0000 7f060200d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:15:44.274 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:44.275+0000 7f94bd3dc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:15:44.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.298+0000 7f8dff860640 1 Processor -- start 2024-04-25T13:15:44.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.298+0000 7f8dff860640 1 -- start start 2024-04-25T13:15:44.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.299+0000 7f8dff860640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 0x7f8df80cba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.299+0000 7f8dff860640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df815eaa0 con 0x7f8df806cf90 2024-04-25T13:15:44.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.299+0000 7f8dff860640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df815ed80 con 0x7f8df80cbf50 2024-04-25T13:15:44.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.299+0000 7f8dff860640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8df80c8940 con 0x7f8df8155710 2024-04-25T13:15:44.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.299+0000 7f8dfd5fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 0x7f8df80cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.299+0000 7f8dfcdfb640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8df80cbf50 0x7f8df806c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55044/0 (socket says 172.21.15.102:55044) 2024-04-25T13:15:44.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.299+0000 7f8dfcdfb640 1 -- 172.21.15.102:0/3316012705 learned_addr learned my addr 172.21.15.102:0/3316012705 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-04-25T13:15:44.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.299+0000 7f8dfd5fc640 1 -- 172.21.15.102:0/3316012705 >> v1:172.21.15.102:6789/0 conn(0x7f8df80cbf50 legacy=0x7f8df806c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.299+0000 7f8dfd5fc640 1 -- 172.21.15.102:0/3316012705 >> v1:172.21.15.52:6789/0 conn(0x7f8df806cf90 legacy=0x7f8df80c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.299+0000 7f8deffff640 1 -- 172.21.15.102:0/3316012705 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706175070 0 0) 0x7f8df815ed80 con 0x7f8df80cbf50 2024-04-25T13:15:44.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.299+0000 7f8dfd5fc640 1 -- 172.21.15.102:0/3316012705 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df815f060 con 0x7f8df8155710 2024-04-25T13:15:44.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.300+0000 7f8dfd5fc640 1 --2- 172.21.15.102:0/3316012705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 0x7f8df80cba10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8df40097d0 tx=0x7f8df402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90c9c02717a7e055 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:44.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.300+0000 7f8deffff640 1 -- 172.21.15.102:0/3316012705 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4037070 con 0x7f8df8155710 2024-04-25T13:15:44.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.300+0000 7f8deffff640 1 -- 172.21.15.102:0/3316012705 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df4032440 con 0x7f8df8155710 2024-04-25T13:15:44.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.300+0000 7f8deffff640 1 -- 172.21.15.102:0/3316012705 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4032810 con 0x7f8df8155710 2024-04-25T13:15:44.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.301+0000 7f8dff860640 1 -- 172.21.15.102:0/3316012705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 msgr2=0x7f8df80cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.301+0000 7f8dff860640 1 --2- 172.21.15.102:0/3316012705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 0x7f8df80cba10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8df40097d0 tx=0x7f8df402a210 comp rx=0 tx=0).stop 2024-04-25T13:15:44.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.301+0000 7f8dff860640 1 -- 172.21.15.102:0/3316012705 shutdown_connections 2024-04-25T13:15:44.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.301+0000 7f8dff860640 1 --2- 172.21.15.102:0/3316012705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 0x7f8df80cba10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.301+0000 7f8dff860640 1 -- 172.21.15.102:0/3316012705 >> 172.21.15.102:0/3316012705 conn(0x7f8df80731d0 msgr2=0x7f8df80735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:44.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.301+0000 7f8dff860640 1 -- 172.21.15.102:0/3316012705 shutdown_connections 2024-04-25T13:15:44.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.301+0000 7f8dff860640 1 -- 172.21.15.102:0/3316012705 wait complete. 2024-04-25T13:15:44.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.302+0000 7f8dff860640 1 Processor -- start 2024-04-25T13:15:44.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.302+0000 7f8dff860640 1 -- start start 2024-04-25T13:15:44.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dff860640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8df806cf90 0x7f8df81e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dff860640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8df80cbf50 0x7f8df81f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dff860640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 0x7f8df81f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dff860640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8df815f6b0 con 0x7f8df806cf90 2024-04-25T13:15:44.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dff860640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8df8155af0 con 0x7f8df80cbf50 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dff860640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8df80ccb10 con 0x7f8df8155710 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfcdfb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8df80cbf50 0x7f8df81f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfddfd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 0x7f8df81f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfcdfb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8df80cbf50 0x7f8df81f5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53980/0 (socket says 172.21.15.102:53980) 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfddfd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 0x7f8df81f55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:41312/0 (socket says 172.21.15.102:41312) 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfcdfb640 1 -- 172.21.15.102:0/209449886 learned_addr learned my addr 172.21.15.102:0/209449886 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfd5fc640 1 --2- 172.21.15.102:0/209449886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8df806cf90 0x7f8df81e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfddfd640 1 -- 172.21.15.102:0/209449886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8df80cbf50 msgr2=0x7f8df81f5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfddfd640 1 --2- 172.21.15.102:0/209449886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8df80cbf50 0x7f8df81f5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfddfd640 1 -- 172.21.15.102:0/209449886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8df806cf90 msgr2=0x7f8df81e7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfddfd640 1 --2- 172.21.15.102:0/209449886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8df806cf90 0x7f8df81e7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfddfd640 1 -- 172.21.15.102:0/209449886 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df80cf860 con 0x7f8df8155710 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfcdfb640 1 --2- 172.21.15.102:0/209449886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8df80cbf50 0x7f8df81f5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:44.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dfddfd640 1 --2- 172.21.15.102:0/209449886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 0x7f8df81f55a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8df000c690 tx=0x7f8df000cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:44.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dedffb640 1 -- 172.21.15.102:0/209449886 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df0003b70 con 0x7f8df8155710 2024-04-25T13:15:44.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dedffb640 1 -- 172.21.15.102:0/209449886 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df0003d10 con 0x7f8df8155710 2024-04-25T13:15:44.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dff860640 1 -- 172.21.15.102:0/209449886 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df80d00c0 con 0x7f8df8155710 2024-04-25T13:15:44.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.303+0000 7f8dedffb640 1 -- 172.21.15.102:0/209449886 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df0005310 con 0x7f8df8155710 2024-04-25T13:15:44.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.304+0000 7f8dff860640 1 -- 172.21.15.102:0/209449886 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df80cfde0 con 0x7f8df8155710 2024-04-25T13:15:44.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.304+0000 7f8dedffb640 1 -- 172.21.15.102:0/209449886 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8df00054b0 con 0x7f8df8155710 2024-04-25T13:15:44.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.304+0000 7f8dedffb640 1 -- 172.21.15.102:0/209449886 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f8df000a920 con 0x7f8df8155710 2024-04-25T13:15:44.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.305+0000 7f8dff860640 1 -- 172.21.15.102:0/209449886 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df8068f50 con 0x7f8df8155710 2024-04-25T13:15:44.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.307+0000 7f8dedffb640 1 -- 172.21.15.102:0/209449886 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8df00057a0 con 0x7f8df8155710 2024-04-25T13:15:44.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.379+0000 7f8dff860640 1 -- 172.21.15.102:0/209449886 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ca31ab05-06c2-4777-8bfe-f23439eb52fc", "id": 0} v 0) -- 0x7f8df80c9f60 con 0x7f8df8155710 2024-04-25T13:15:44.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.382+0000 7f8dedffb640 1 -- 172.21.15.102:0/209449886 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca31ab05-06c2-4777-8bfe-f23439eb52fc", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f8df0012560 con 0x7f8df8155710 2024-04-25T13:15:44.383 INFO:teuthology.orchestra.run.smithi102.stdout:0 2024-04-25T13:15:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.383+0000 7f8dff860640 1 -- 172.21.15.102:0/209449886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 msgr2=0x7f8df81f55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.383+0000 7f8dff860640 1 --2- 172.21.15.102:0/209449886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 0x7f8df81f55a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8df000c690 tx=0x7f8df000cb50 comp rx=0 tx=0).stop 2024-04-25T13:15:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.383+0000 7f8dff860640 1 -- 172.21.15.102:0/209449886 shutdown_connections 2024-04-25T13:15:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.383+0000 7f8dff860640 1 --2- 172.21.15.102:0/209449886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8df8155710 0x7f8df81f55a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.383+0000 7f8dff860640 1 --2- 172.21.15.102:0/209449886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8df80cbf50 0x7f8df81f5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.383+0000 7f8dff860640 1 --2- 172.21.15.102:0/209449886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8df806cf90 0x7f8df81e7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.383+0000 7f8dff860640 1 -- 172.21.15.102:0/209449886 >> 172.21.15.102:0/209449886 conn(0x7f8df80731d0 msgr2=0x7f8df81e4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.383+0000 7f8dff860640 1 -- 172.21.15.102:0/209449886 shutdown_connections 2024-04-25T13:15:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.383+0000 7f8dff860640 1 -- 172.21.15.102:0/209449886 wait complete. 2024-04-25T13:15:44.394 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new d3fb4cbe-b222-4237-a827-2f02e823e380 1 2024-04-25T13:15:44.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.530+0000 7f5ae26cf640 1 Processor -- start 2024-04-25T13:15:44.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.530+0000 7f5ae26cf640 1 -- start start 2024-04-25T13:15:44.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.531+0000 7f5ae26cf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc152f20 0x7f5adc0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.531+0000 7f5ae26cf640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5adc0c7b20 con 0x7f5adc153300 2024-04-25T13:15:44.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.531+0000 7f5ae26cf640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5adc0cac60 con 0x7f5adc0ca3b0 2024-04-25T13:15:44.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.531+0000 7f5ae26cf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5adc0c9810 con 0x7f5adc152f20 2024-04-25T13:15:44.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.531+0000 7f5adbfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc152f20 0x7f5adc0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.531+0000 7f5ae0c6c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f5adc0ca3b0 0x7f5adc0c5a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:41600/0 (socket says 172.21.15.102:41600) 2024-04-25T13:15:44.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.531+0000 7f5ae0c6c640 1 -- 172.21.15.102:0/3988349163 learned_addr learned my addr 172.21.15.102:0/3988349163 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-04-25T13:15:44.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.532+0000 7f5adbfff640 1 -- 172.21.15.102:0/3988349163 >> v1:172.21.15.102:6789/0 conn(0x7f5adc0ca3b0 legacy=0x7f5adc0c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.532+0000 7f5adbfff640 1 -- 172.21.15.102:0/3988349163 >> v1:172.21.15.52:6789/0 conn(0x7f5adc153300 legacy=0x7f5adc0c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.532+0000 7f5adbfff640 1 -- 172.21.15.102:0/3988349163 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc0c7d90 con 0x7f5adc152f20 2024-04-25T13:15:44.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.532+0000 7f5adaffd640 1 -- 172.21.15.102:0/3988349163 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2856999872 0 0) 0x7f5adc0cac60 con 0x7f5adc0ca3b0 2024-04-25T13:15:44.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.532+0000 7f5adbfff640 1 --2- 172.21.15.102:0/3988349163 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc152f20 0x7f5adc0cb3c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0097d0 tx=0x7f5acc02a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89a3c26695d611b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:44.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.532+0000 7f5adaffd640 1 -- 172.21.15.102:0/3988349163 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc037070 con 0x7f5adc152f20 2024-04-25T13:15:44.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.532+0000 7f5adaffd640 1 -- 172.21.15.102:0/3988349163 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5acc032440 con 0x7f5adc152f20 2024-04-25T13:15:44.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.532+0000 7f5adaffd640 1 -- 172.21.15.102:0/3988349163 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0327f0 con 0x7f5adc152f20 2024-04-25T13:15:44.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.533+0000 7f5ae26cf640 1 -- 172.21.15.102:0/3988349163 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc152f20 msgr2=0x7f5adc0cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.533+0000 7f5ae26cf640 1 --2- 172.21.15.102:0/3988349163 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc152f20 0x7f5adc0cb3c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0097d0 tx=0x7f5acc02a290 comp rx=0 tx=0).stop 2024-04-25T13:15:44.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.533+0000 7f5ae26cf640 1 -- 172.21.15.102:0/3988349163 shutdown_connections 2024-04-25T13:15:44.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.533+0000 7f5ae26cf640 1 --2- 172.21.15.102:0/3988349163 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc152f20 0x7f5adc0cb3c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.533+0000 7f5ae26cf640 1 -- 172.21.15.102:0/3988349163 >> 172.21.15.102:0/3988349163 conn(0x7f5adc074f30 msgr2=0x7f5adc075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:44.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.533+0000 7f5ae26cf640 1 -- 172.21.15.102:0/3988349163 shutdown_connections 2024-04-25T13:15:44.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.533+0000 7f5ae26cf640 1 -- 172.21.15.102:0/3988349163 wait complete. 2024-04-25T13:15:44.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.534+0000 7f5ae26cf640 1 Processor -- start 2024-04-25T13:15:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.534+0000 7f5ae26cf640 1 -- start start 2024-04-25T13:15:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5ae26cf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc0ca3b0 0x7f5adc1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5ae26cf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc152f20 0x7f5adc14fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5ae26cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5adc153300 0x7f5adc1f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5ae26cf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc0c8630 con 0x7f5adc153300 2024-04-25T13:15:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5ae26cf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc0c8350 con 0x7f5adc152f20 2024-04-25T13:15:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5ae26cf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5adc0c8910 con 0x7f5adc0ca3b0 2024-04-25T13:15:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5adbfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc0ca3b0 0x7f5adc1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5adbfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc0ca3b0 0x7f5adc1584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:32808/0 (socket says 172.21.15.102:32808) 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5adb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc152f20 0x7f5adc14fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5adbfff640 1 -- 172.21.15.102:0/2770390316 learned_addr learned my addr 172.21.15.102:0/2770390316 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5ae0c6c640 1 --2- 172.21.15.102:0/2770390316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5adc153300 0x7f5adc1f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5adb7fe640 1 -- 172.21.15.102:0/2770390316 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc0ca3b0 msgr2=0x7f5adc1584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5adb7fe640 1 --2- 172.21.15.102:0/2770390316 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc0ca3b0 0x7f5adc1584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5adb7fe640 1 -- 172.21.15.102:0/2770390316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5adc153300 msgr2=0x7f5adc1f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5adb7fe640 1 --2- 172.21.15.102:0/2770390316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5adc153300 0x7f5adc1f2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5adb7fe640 1 -- 172.21.15.102:0/2770390316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc157890 con 0x7f5adc152f20 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.535+0000 7f5adbfff640 1 --2- 172.21.15.102:0/2770390316 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc0ca3b0 0x7f5adc1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.536+0000 7f5adb7fe640 1 --2- 172.21.15.102:0/2770390316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc152f20 0x7f5adc14fa10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000c390 tx=0x7f5ad000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.536+0000 7f5ad8ff9640 1 -- 172.21.15.102:0/2770390316 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0017070 con 0x7f5adc152f20 2024-04-25T13:15:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.536+0000 7f5ad8ff9640 1 -- 172.21.15.102:0/2770390316 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad00052d0 con 0x7f5adc152f20 2024-04-25T13:15:44.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.536+0000 7f5ae26cf640 1 -- 172.21.15.102:0/2770390316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5adc0cd810 con 0x7f5adc152f20 2024-04-25T13:15:44.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.536+0000 7f5ad8ff9640 1 -- 172.21.15.102:0/2770390316 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0003830 con 0x7f5adc152f20 2024-04-25T13:15:44.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.536+0000 7f5ae26cf640 1 -- 172.21.15.102:0/2770390316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5adc0cddd0 con 0x7f5adc152f20 2024-04-25T13:15:44.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.536+0000 7f5ad8ff9640 1 -- 172.21.15.102:0/2770390316 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ad001a070 con 0x7f5adc152f20 2024-04-25T13:15:44.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.536+0000 7f5ad8ff9640 1 -- 172.21.15.102:0/2770390316 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f5ad0011b30 con 0x7f5adc152f20 2024-04-25T13:15:44.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.537+0000 7f5ae26cf640 1 -- 172.21.15.102:0/2770390316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5adc068f50 con 0x7f5adc152f20 2024-04-25T13:15:44.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.539+0000 7f5ad8ff9640 1 -- 172.21.15.102:0/2770390316 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5ad0021070 con 0x7f5adc152f20 2024-04-25T13:15:44.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.611+0000 7f5ae26cf640 1 -- 172.21.15.102:0/2770390316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d3fb4cbe-b222-4237-a827-2f02e823e380", "id": 1} v 0) -- 0x7f5adc0ca020 con 0x7f5adc152f20 2024-04-25T13:15:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.614+0000 7f5ad8ff9640 1 -- 172.21.15.102:0/2770390316 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d3fb4cbe-b222-4237-a827-2f02e823e380", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f5ad0011d30 con 0x7f5adc152f20 2024-04-25T13:15:44.614 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-04-25T13:15:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.615+0000 7f5ae26cf640 1 -- 172.21.15.102:0/2770390316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc152f20 msgr2=0x7f5adc14fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.615+0000 7f5ae26cf640 1 --2- 172.21.15.102:0/2770390316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc152f20 0x7f5adc14fa10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000c390 tx=0x7f5ad000c850 comp rx=0 tx=0).stop 2024-04-25T13:15:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.615+0000 7f5ae26cf640 1 -- 172.21.15.102:0/2770390316 shutdown_connections 2024-04-25T13:15:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.615+0000 7f5ae26cf640 1 --2- 172.21.15.102:0/2770390316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5adc153300 0x7f5adc1f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.615+0000 7f5ae26cf640 1 --2- 172.21.15.102:0/2770390316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc152f20 0x7f5adc14fa10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.615+0000 7f5ae26cf640 1 --2- 172.21.15.102:0/2770390316 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5adc0ca3b0 0x7f5adc1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.615+0000 7f5ae26cf640 1 -- 172.21.15.102:0/2770390316 >> 172.21.15.102:0/2770390316 conn(0x7f5adc074f30 msgr2=0x7f5adc14d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.615+0000 7f5ae26cf640 1 -- 172.21.15.102:0/2770390316 shutdown_connections 2024-04-25T13:15:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.615+0000 7f5ae26cf640 1 -- 172.21.15.102:0/2770390316 wait complete. 2024-04-25T13:15:44.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new d1382850-2960-4354-8d63-d50bfbc36b86 2 2024-04-25T13:15:44.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.723+0000 7f520d807640 1 Processor -- start 2024-04-25T13:15:44.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.723+0000 7f520d807640 1 -- start start 2024-04-25T13:15:44.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f520d807640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f52081553b0 0x7f5208070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f520d807640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 0x7f5208070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f520d807640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52080754d0 con 0x7f5208074d50 2024-04-25T13:15:44.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f520d807640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f520815e920 con 0x7f52081553b0 2024-04-25T13:15:44.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f520d807640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f520815ec00 con 0x7f52080722a0 2024-04-25T13:15:44.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f5206ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f52081553b0 0x7f5208070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f52067fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 0x7f5208070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f5206ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f52081553b0 0x7f5208070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53898/0 (socket says 172.21.15.102:53898) 2024-04-25T13:15:44.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f5206ffd640 1 -- 172.21.15.102:0/4116588776 learned_addr learned my addr 172.21.15.102:0/4116588776 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-25T13:15:44.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f5206ffd640 1 -- 172.21.15.102:0/4116588776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 msgr2=0x7f5208070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:44.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f5206ffd640 1 --2- 172.21.15.102:0/4116588776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 0x7f5208070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f5206ffd640 1 -- 172.21.15.102:0/4116588776 >> v1:172.21.15.52:6789/0 conn(0x7f5208074d50 legacy=0x7f520815b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:44.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f5206ffd640 1 -- 172.21.15.102:0/4116588776 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520815eee0 con 0x7f52081553b0 2024-04-25T13:15:44.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.724+0000 7f52067fc640 1 --2- 172.21.15.102:0/4116588776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 0x7f5208070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:44.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.725+0000 7f5206ffd640 1 --2- 172.21.15.102:0/4116588776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52081553b0 0x7f5208070330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009870 tx=0x7f51fc02a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c8047eba1e34f94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:44.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.725+0000 7f5205ffb640 1 -- 172.21.15.102:0/4116588776 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc037070 con 0x7f52081553b0 2024-04-25T13:15:44.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.725+0000 7f5205ffb640 1 -- 172.21.15.102:0/4116588776 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51fc032440 con 0x7f52081553b0 2024-04-25T13:15:44.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.725+0000 7f5205ffb640 1 -- 172.21.15.102:0/4116588776 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc032810 con 0x7f52081553b0 2024-04-25T13:15:44.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.726+0000 7f520d807640 1 -- 172.21.15.102:0/4116588776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52081553b0 msgr2=0x7f5208070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.726+0000 7f520d807640 1 --2- 172.21.15.102:0/4116588776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52081553b0 0x7f5208070330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009870 tx=0x7f51fc02a200 comp rx=0 tx=0).stop 2024-04-25T13:15:44.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.726+0000 7f520d807640 1 -- 172.21.15.102:0/4116588776 shutdown_connections 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.726+0000 7f520d807640 1 --2- 172.21.15.102:0/4116588776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 0x7f5208070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.726+0000 7f520d807640 1 --2- 172.21.15.102:0/4116588776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52081553b0 0x7f5208070330 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.726+0000 7f520d807640 1 -- 172.21.15.102:0/4116588776 >> 172.21.15.102:0/4116588776 conn(0x7f520806e1a0 msgr2=0x7f520806e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.726+0000 7f520d807640 1 -- 172.21.15.102:0/4116588776 shutdown_connections 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.726+0000 7f520d807640 1 -- 172.21.15.102:0/4116588776 wait complete. 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.727+0000 7f520d807640 1 Processor -- start 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.727+0000 7f520d807640 1 -- start start 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f520d807640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 0x7f52080c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f520d807640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5208074d50 0x7f5208159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f520d807640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52081553b0 0x7f520814ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f520d807640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5208155790 con 0x7f5208074d50 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f520d807640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f520815f4a0 con 0x7f52081553b0 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f520d807640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f52080759d0 con 0x7f52080722a0 2024-04-25T13:15:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f5206ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 0x7f52080c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f52077fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52081553b0 0x7f520814ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f5206ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 0x7f52080c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:32824/0 (socket says 172.21.15.102:32824) 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f52077fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52081553b0 0x7f520814ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53914/0 (socket says 172.21.15.102:53914) 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f5206ffd640 1 -- 172.21.15.102:0/2983058573 learned_addr learned my addr 172.21.15.102:0/2983058573 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f52067fc640 1 --2- 172.21.15.102:0/2983058573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5208074d50 0x7f5208159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f52077fe640 1 -- 172.21.15.102:0/2983058573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 msgr2=0x7f52080c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f52077fe640 1 --2- 172.21.15.102:0/2983058573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 0x7f52080c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f52077fe640 1 -- 172.21.15.102:0/2983058573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5208074d50 msgr2=0x7f5208159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f52077fe640 1 --2- 172.21.15.102:0/2983058573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5208074d50 0x7f5208159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f52077fe640 1 -- 172.21.15.102:0/2983058573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52080c5560 con 0x7f52081553b0 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f5206ffd640 1 --2- 172.21.15.102:0/2983058573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 0x7f52080c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f52077fe640 1 --2- 172.21.15.102:0/2983058573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52081553b0 0x7f520814ab80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f520000c780 tx=0x7f520000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f51effff640 1 -- 172.21.15.102:0/2983058573 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200016020 con 0x7f52081553b0 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f51effff640 1 -- 172.21.15.102:0/2983058573 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f520000aa50 con 0x7f52081553b0 2024-04-25T13:15:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f520d807640 1 -- 172.21.15.102:0/2983058573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52080c4fa0 con 0x7f52081553b0 2024-04-25T13:15:44.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.728+0000 7f51effff640 1 -- 172.21.15.102:0/2983058573 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520000ae40 con 0x7f52081553b0 2024-04-25T13:15:44.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.729+0000 7f520d807640 1 -- 172.21.15.102:0/2983058573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52081f1000 con 0x7f52081553b0 2024-04-25T13:15:44.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.729+0000 7f51effff640 1 -- 172.21.15.102:0/2983058573 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5200019020 con 0x7f52081553b0 2024-04-25T13:15:44.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.729+0000 7f51effff640 1 -- 172.21.15.102:0/2983058573 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f5200012840 con 0x7f52081553b0 2024-04-25T13:15:44.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.729+0000 7f520d807640 1 -- 172.21.15.102:0/2983058573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5208068f50 con 0x7f52081553b0 2024-04-25T13:15:44.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.732+0000 7f51effff640 1 -- 172.21.15.102:0/2983058573 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5200020030 con 0x7f52081553b0 2024-04-25T13:15:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.802+0000 7f520d807640 1 -- 172.21.15.102:0/2983058573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d1382850-2960-4354-8d63-d50bfbc36b86", "id": 2} v 0) -- 0x7f5208073090 con 0x7f52081553b0 2024-04-25T13:15:44.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.805+0000 7f51effff640 1 -- 172.21.15.102:0/2983058573 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d1382850-2960-4354-8d63-d50bfbc36b86", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f5200012420 con 0x7f52081553b0 2024-04-25T13:15:44.806 INFO:teuthology.orchestra.run.smithi102.stdout:2 2024-04-25T13:15:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.806+0000 7f520d807640 1 -- 172.21.15.102:0/2983058573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52081553b0 msgr2=0x7f520814ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.806+0000 7f520d807640 1 --2- 172.21.15.102:0/2983058573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52081553b0 0x7f520814ab80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f520000c780 tx=0x7f520000cc40 comp rx=0 tx=0).stop 2024-04-25T13:15:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.806+0000 7f520d807640 1 -- 172.21.15.102:0/2983058573 shutdown_connections 2024-04-25T13:15:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.806+0000 7f520d807640 1 --2- 172.21.15.102:0/2983058573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52081553b0 0x7f520814ab80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.806+0000 7f520d807640 1 --2- 172.21.15.102:0/2983058573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5208074d50 0x7f5208159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.806+0000 7f520d807640 1 --2- 172.21.15.102:0/2983058573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52080722a0 0x7f52080c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.806+0000 7f520d807640 1 -- 172.21.15.102:0/2983058573 >> 172.21.15.102:0/2983058573 conn(0x7f520806e1a0 msgr2=0x7f52080c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.806+0000 7f520d807640 1 -- 172.21.15.102:0/2983058573 shutdown_connections 2024-04-25T13:15:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.806+0000 7f520d807640 1 -- 172.21.15.102:0/2983058573 wait complete. 2024-04-25T13:15:44.817 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 2c406eac-6c0c-4add-a5ca-f89d6ab21d68 3 2024-04-25T13:15:44.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.913+0000 7f63820a7640 1 Processor -- start 2024-04-25T13:15:44.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.913+0000 7f63820a7640 1 -- start start 2024-04-25T13:15:44.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.914+0000 7f63820a7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f637c144220 0x7f637c15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.914+0000 7f63820a7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144600 0x7f637c0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.914+0000 7f63820a7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f637c0cb8c0 0x7f637c0c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.914+0000 7f63820a7640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f637c15e780 con 0x7f637c0cb8c0 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.914+0000 7f63820a7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f637c15f570 con 0x7f637c144220 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.914+0000 7f63820a7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f637c15e9f0 con 0x7f637c144600 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.914+0000 7f637affd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144600 0x7f637c0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.914+0000 7f637b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f637c144220 0x7f637c15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.914+0000 7f637b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f637c144220 0x7f637c15bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53928/0 (socket says 172.21.15.102:53928) 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.914+0000 7f637affd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144600 0x7f637c0cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:32840/0 (socket says 172.21.15.102:32840) 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.914+0000 7f637b7fe640 1 -- 172.21.15.102:0/1017452573 learned_addr learned my addr 172.21.15.102:0/1017452573 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.914+0000 7f637bfff640 1 --2- 172.21.15.102:0/1017452573 >> v2:172.21.15.52:3300/0 conn(0x7f637c0cb8c0 0x7f637c0c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.915+0000 7f637affd640 1 -- 172.21.15.102:0/1017452573 >> v2:172.21.15.102:3300/0 conn(0x7f637c144220 msgr2=0x7f637c15bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.915+0000 7f637affd640 1 --2- 172.21.15.102:0/1017452573 >> v2:172.21.15.102:3300/0 conn(0x7f637c144220 0x7f637c15bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.915+0000 7f637affd640 1 -- 172.21.15.102:0/1017452573 >> v2:172.21.15.52:3300/0 conn(0x7f637c0cb8c0 msgr2=0x7f637c0c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.915+0000 7f637affd640 1 --2- 172.21.15.102:0/1017452573 >> v2:172.21.15.52:3300/0 conn(0x7f637c0cb8c0 0x7f637c0c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.915+0000 7f637affd640 1 -- 172.21.15.102:0/1017452573 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c15ecd0 con 0x7f637c144600 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.915+0000 7f637b7fe640 1 --2- 172.21.15.102:0/1017452573 >> v2:172.21.15.102:3300/0 conn(0x7f637c144220 0x7f637c15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.915+0000 7f637affd640 1 --2- 172.21.15.102:0/1017452573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144600 0x7f637c0cb380 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f637c075e00 tx=0x7f637002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d46843ebc0e8d096 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.915+0000 7f637a7fc640 1 -- 172.21.15.102:0/1017452573 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370037070 con 0x7f637c144600 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.915+0000 7f637a7fc640 1 -- 172.21.15.102:0/1017452573 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6370032440 con 0x7f637c144600 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.915+0000 7f637a7fc640 1 -- 172.21.15.102:0/1017452573 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370032810 con 0x7f637c144600 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.916+0000 7f63820a7640 1 -- 172.21.15.102:0/1017452573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144600 msgr2=0x7f637c0cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.916+0000 7f63820a7640 1 --2- 172.21.15.102:0/1017452573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144600 0x7f637c0cb380 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f637c075e00 tx=0x7f637002a1a0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.916+0000 7f63820a7640 1 -- 172.21.15.102:0/1017452573 shutdown_connections 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.916+0000 7f63820a7640 1 --2- 172.21.15.102:0/1017452573 >> v2:172.21.15.52:3300/0 conn(0x7f637c0cb8c0 0x7f637c0c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.916+0000 7f63820a7640 1 --2- 172.21.15.102:0/1017452573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144600 0x7f637c0cb380 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.916+0000 7f63820a7640 1 --2- 172.21.15.102:0/1017452573 >> v2:172.21.15.102:3300/0 conn(0x7f637c144220 0x7f637c15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.916+0000 7f63820a7640 1 -- 172.21.15.102:0/1017452573 >> 172.21.15.102:0/1017452573 conn(0x7f637c06b920 msgr2=0x7f637c06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:44.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.916+0000 7f63820a7640 1 -- 172.21.15.102:0/1017452573 shutdown_connections 2024-04-25T13:15:44.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.916+0000 7f63820a7640 1 -- 172.21.15.102:0/1017452573 wait complete. 2024-04-25T13:15:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.917+0000 7f63820a7640 1 Processor -- start 2024-04-25T13:15:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.917+0000 7f63820a7640 1 -- start start 2024-04-25T13:15:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f63820a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f637c0cb8c0 0x7f637c142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f63820a7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144220 0x7f637c0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f63820a7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f637c144600 0x7f637c0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f63820a7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f637c0ca530 con 0x7f637c144600 2024-04-25T13:15:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f63820a7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f637c15f290 con 0x7f637c0cb8c0 2024-04-25T13:15:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f63820a7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f637c0ca6b0 con 0x7f637c144220 2024-04-25T13:15:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f637affd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144220 0x7f637c0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f637c0cb8c0 0x7f637c142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f637affd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144220 0x7f637c0c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:32856/0 (socket says 172.21.15.102:32856) 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f637affd640 1 -- 172.21.15.102:0/3139200097 learned_addr learned my addr 172.21.15.102:0/3139200097 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f637bfff640 1 --2- 172.21.15.102:0/3139200097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f637c144600 0x7f637c0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f637b7fe640 1 -- 172.21.15.102:0/3139200097 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144220 msgr2=0x7f637c0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f637b7fe640 1 --2- 172.21.15.102:0/3139200097 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144220 0x7f637c0c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f637b7fe640 1 -- 172.21.15.102:0/3139200097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f637c144600 msgr2=0x7f637c0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.918+0000 7f637b7fe640 1 --2- 172.21.15.102:0/3139200097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f637c144600 0x7f637c0c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.919+0000 7f637b7fe640 1 -- 172.21.15.102:0/3139200097 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c1f1970 con 0x7f637c0cb8c0 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.919+0000 7f637b7fe640 1 --2- 172.21.15.102:0/3139200097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f637c0cb8c0 0x7f637c142390 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f636c00e900 tx=0x7f636c00edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.919+0000 7f6363fff640 1 -- 172.21.15.102:0/3139200097 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c004030 con 0x7f637c0cb8c0 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.919+0000 7f6363fff640 1 -- 172.21.15.102:0/3139200097 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636c0041d0 con 0x7f637c0cb8c0 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.919+0000 7f63820a7640 1 -- 172.21.15.102:0/3139200097 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637c1f0b30 con 0x7f637c0cb8c0 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.919+0000 7f6363fff640 1 -- 172.21.15.102:0/3139200097 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c00c9a0 con 0x7f637c0cb8c0 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.919+0000 7f63820a7640 1 -- 172.21.15.102:0/3139200097 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f637c1f10d0 con 0x7f637c0cb8c0 2024-04-25T13:15:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.919+0000 7f6363fff640 1 -- 172.21.15.102:0/3139200097 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f636c003610 con 0x7f637c0cb8c0 2024-04-25T13:15:44.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.919+0000 7f6363fff640 1 -- 172.21.15.102:0/3139200097 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f636c013c20 con 0x7f637c0cb8c0 2024-04-25T13:15:44.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.920+0000 7f63820a7640 1 -- 172.21.15.102:0/3139200097 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f637c068f50 con 0x7f637c0cb8c0 2024-04-25T13:15:44.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.922+0000 7f6363fff640 1 -- 172.21.15.102:0/3139200097 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f636c017020 con 0x7f637c0cb8c0 2024-04-25T13:15:44.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.994+0000 7f63820a7640 1 -- 172.21.15.102:0/3139200097 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2c406eac-6c0c-4add-a5ca-f89d6ab21d68", "id": 3} v 0) -- 0x7f637c0ce3f0 con 0x7f637c0cb8c0 2024-04-25T13:15:44.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.997+0000 7f6363fff640 1 -- 172.21.15.102:0/3139200097 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c406eac-6c0c-4add-a5ca-f89d6ab21d68", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f636c0093b0 con 0x7f637c0cb8c0 2024-04-25T13:15:44.997 INFO:teuthology.orchestra.run.smithi102.stdout:3 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.998+0000 7f63820a7640 1 -- 172.21.15.102:0/3139200097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f637c0cb8c0 msgr2=0x7f637c142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:44.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.998+0000 7f63820a7640 1 --2- 172.21.15.102:0/3139200097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f637c0cb8c0 0x7f637c142390 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f636c00e900 tx=0x7f636c00edc0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.998+0000 7f63820a7640 1 -- 172.21.15.102:0/3139200097 shutdown_connections 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.998+0000 7f63820a7640 1 --2- 172.21.15.102:0/3139200097 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f637c144220 0x7f637c0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.998+0000 7f63820a7640 1 --2- 172.21.15.102:0/3139200097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f637c144600 0x7f637c0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.998+0000 7f63820a7640 1 --2- 172.21.15.102:0/3139200097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f637c0cb8c0 0x7f637c142390 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.998+0000 7f63820a7640 1 -- 172.21.15.102:0/3139200097 >> 172.21.15.102:0/3139200097 conn(0x7f637c06b920 msgr2=0x7f637c15a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.998+0000 7f63820a7640 1 -- 172.21.15.102:0/3139200097 shutdown_connections 2024-04-25T13:15:44.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:44.998+0000 7f63820a7640 1 -- 172.21.15.102:0/3139200097 wait complete. 2024-04-25T13:15:45.008 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 7eac025d-b6de-4c2e-a98d-f134954db46e 4 2024-04-25T13:15:45.013 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:45.013+0000 7f060200d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:15:45.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.105+0000 7f9d7de7b640 1 Processor -- start 2024-04-25T13:15:45.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.105+0000 7f9d7de7b640 1 -- start start 2024-04-25T13:15:45.106 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:45.105+0000 7f060200d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:15:45.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d7de7b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d7815c460 0x7f9d780ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d7de7b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9d780c92d0 0x7f9d78074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d7de7b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d780c97e0 con 0x7f9d7814fe30 2024-04-25T13:15:45.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d7de7b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9d781593f0 con 0x7f9d780c92d0 2024-04-25T13:15:45.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d7de7b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9d780c9ac0 con 0x7f9d7815c460 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d6ffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d7815c460 0x7f9d780ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d777fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f9d7814fe30 0x7f9d78159880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:41604/0 (socket says 172.21.15.102:41604) 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d777fe640 1 -- 172.21.15.102:0/1540190957 learned_addr learned my addr 172.21.15.102:0/1540190957 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d77fff640 1 --2- 172.21.15.102:0/1540190957 >> v2:172.21.15.52:3300/0 conn(0x7f9d780c92d0 0x7f9d78074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d76ffd640 1 -- 172.21.15.102:0/1540190957 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 102205747 0 0) 0x7f9d780c97e0 con 0x7f9d7814fe30 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d76ffd640 1 -- 172.21.15.102:0/1540190957 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d64003520 con 0x7f9d7814fe30 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d6ffff640 1 -- 172.21.15.102:0/1540190957 >> v2:172.21.15.52:3300/0 conn(0x7f9d780c92d0 msgr2=0x7f9d78074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d6ffff640 1 --2- 172.21.15.102:0/1540190957 >> v2:172.21.15.52:3300/0 conn(0x7f9d780c92d0 0x7f9d78074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d6ffff640 1 -- 172.21.15.102:0/1540190957 >> v1:172.21.15.102:6789/0 conn(0x7f9d7814fe30 legacy=0x7f9d78159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.106+0000 7f9d6ffff640 1 -- 172.21.15.102:0/1540190957 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d780c9da0 con 0x7f9d7815c460 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.107+0000 7f9d6ffff640 1 --2- 172.21.15.102:0/1540190957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d7815c460 0x7f9d780ca2f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d600097a0 tx=0x7f9d6002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4145e9d9a4e12eec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.107+0000 7f9d76ffd640 1 -- 172.21.15.102:0/1540190957 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60037070 con 0x7f9d7815c460 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.107+0000 7f9d76ffd640 1 -- 172.21.15.102:0/1540190957 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6002ae50 con 0x7f9d7815c460 2024-04-25T13:15:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.107+0000 7f9d76ffd640 1 -- 172.21.15.102:0/1540190957 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60032660 con 0x7f9d7815c460 2024-04-25T13:15:45.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.108+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1540190957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d7815c460 msgr2=0x7f9d780ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.108+0000 7f9d7de7b640 1 --2- 172.21.15.102:0/1540190957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d7815c460 0x7f9d780ca2f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d600097a0 tx=0x7f9d6002a100 comp rx=0 tx=0).stop 2024-04-25T13:15:45.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.108+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1540190957 shutdown_connections 2024-04-25T13:15:45.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.108+0000 7f9d7de7b640 1 --2- 172.21.15.102:0/1540190957 >> v2:172.21.15.52:3300/0 conn(0x7f9d780c92d0 0x7f9d78074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.108+0000 7f9d7de7b640 1 --2- 172.21.15.102:0/1540190957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d7815c460 0x7f9d780ca2f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.108+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1540190957 >> 172.21.15.102:0/1540190957 conn(0x7f9d7806e1a0 msgr2=0x7f9d7806e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.108+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1540190957 shutdown_connections 2024-04-25T13:15:45.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.108+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1540190957 wait complete. 2024-04-25T13:15:45.111 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:45.109+0000 7f94bd3dc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:15:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.109+0000 7f9d7de7b640 1 Processor -- start 2024-04-25T13:15:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.109+0000 7f9d7de7b640 1 -- start start 2024-04-25T13:15:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d7de7b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d780c92d0 0x7f9d78151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d7de7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d7814fe30 0x7f9d780cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d7de7b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d7815c460 0x7f9d7814a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d7de7b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9d780cb0b0 con 0x7f9d7814fe30 2024-04-25T13:15:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d7de7b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d780caf30 con 0x7f9d7815c460 2024-04-25T13:15:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d7de7b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9d780ca830 con 0x7f9d780c92d0 2024-04-25T13:15:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d777fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d780c92d0 0x7f9d78151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d77fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d7815c460 0x7f9d7814a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d777fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d780c92d0 0x7f9d78151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:32860/0 (socket says 172.21.15.102:32860) 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d777fe640 1 -- 172.21.15.102:0/1610201172 learned_addr learned my addr 172.21.15.102:0/1610201172 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d6ffff640 1 --2- 172.21.15.102:0/1610201172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d7814fe30 0x7f9d780cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d777fe640 1 -- 172.21.15.102:0/1610201172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d7815c460 msgr2=0x7f9d7814a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d777fe640 1 --2- 172.21.15.102:0/1610201172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d7815c460 0x7f9d7814a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d777fe640 1 -- 172.21.15.102:0/1610201172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d7814fe30 msgr2=0x7f9d780cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d777fe640 1 --2- 172.21.15.102:0/1610201172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d7814fe30 0x7f9d780cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d777fe640 1 -- 172.21.15.102:0/1610201172 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d781e5d50 con 0x7f9d780c92d0 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.110+0000 7f9d777fe640 1 --2- 172.21.15.102:0/1610201172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d780c92d0 0x7f9d78151a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800c460 tx=0x7f9d6800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.111+0000 7f9d74ff9640 1 -- 172.21.15.102:0/1610201172 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68017070 con 0x7f9d780c92d0 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.111+0000 7f9d74ff9640 1 -- 172.21.15.102:0/1610201172 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d68005ce0 con 0x7f9d780c92d0 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.111+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1610201172 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d781f28a0 con 0x7f9d780c92d0 2024-04-25T13:15:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.111+0000 7f9d74ff9640 1 -- 172.21.15.102:0/1610201172 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68007290 con 0x7f9d780c92d0 2024-04-25T13:15:45.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.111+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1610201172 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d781f25c0 con 0x7f9d780c92d0 2024-04-25T13:15:45.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.111+0000 7f9d74ff9640 1 -- 172.21.15.102:0/1610201172 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9d6801a070 con 0x7f9d780c92d0 2024-04-25T13:15:45.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.111+0000 7f9d74ff9640 1 -- 172.21.15.102:0/1610201172 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f9d68012910 con 0x7f9d780c92d0 2024-04-25T13:15:45.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.112+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1610201172 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d78068f50 con 0x7f9d780c92d0 2024-04-25T13:15:45.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.114+0000 7f9d74ff9640 1 -- 172.21.15.102:0/1610201172 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9d68021070 con 0x7f9d780c92d0 2024-04-25T13:15:45.165 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:45.165+0000 7f060200d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:15:45.201 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:45.201+0000 7f94bd3dc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:15:45.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.205+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1610201172 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7eac025d-b6de-4c2e-a98d-f134954db46e", "id": 4} v 0) -- 0x7f9d780736c0 con 0x7f9d780c92d0 2024-04-25T13:15:45.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.208+0000 7f9d74ff9640 1 -- 172.21.15.102:0/1610201172 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7eac025d-b6de-4c2e-a98d-f134954db46e", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f9d781e5d50 con 0x7f9d780c92d0 2024-04-25T13:15:45.208 INFO:teuthology.orchestra.run.smithi102.stdout:4 2024-04-25T13:15:45.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.209+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1610201172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d780c92d0 msgr2=0x7f9d78151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.209+0000 7f9d7de7b640 1 --2- 172.21.15.102:0/1610201172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d780c92d0 0x7f9d78151a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800c460 tx=0x7f9d6800c920 comp rx=0 tx=0).stop 2024-04-25T13:15:45.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.209+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1610201172 shutdown_connections 2024-04-25T13:15:45.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.209+0000 7f9d7de7b640 1 --2- 172.21.15.102:0/1610201172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d7815c460 0x7f9d7814a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.209+0000 7f9d7de7b640 1 --2- 172.21.15.102:0/1610201172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d7814fe30 0x7f9d780cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.209+0000 7f9d7de7b640 1 --2- 172.21.15.102:0/1610201172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d780c92d0 0x7f9d78151a30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.209+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1610201172 >> 172.21.15.102:0/1610201172 conn(0x7f9d7806e1a0 msgr2=0x7f9d78159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.209+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1610201172 shutdown_connections 2024-04-25T13:15:45.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.209+0000 7f9d7de7b640 1 -- 172.21.15.102:0/1610201172 wait complete. 2024-04-25T13:15:45.220 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new f43af6a1-c5e6-4f01-9012-8ea601776eb9 5 2024-04-25T13:15:45.246 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:45.246+0000 7f94bd3dc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:15:45.338 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:45.338+0000 7f060200d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:15:45.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.357+0000 7fe92d820640 1 Processor -- start 2024-04-25T13:15:45.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.357+0000 7fe92d820640 1 -- start start 2024-04-25T13:15:45.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.357+0000 7fe92d820640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe928155330 0x7fe9280d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.357+0000 7fe92d820640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9280c8960 con 0x7fe92815cca0 2024-04-25T13:15:45.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.357+0000 7fe92d820640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9280c8c40 con 0x7fe92815b200 2024-04-25T13:15:45.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.357+0000 7fe92d820640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe9280c8f20 con 0x7fe928155330 2024-04-25T13:15:45.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.357+0000 7fe9267fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe92815b200 0x7fe92815c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:41620/0 (socket says 172.21.15.102:41620) 2024-04-25T13:15:45.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.358+0000 7fe9267fc640 1 -- 172.21.15.102:0/1552980744 learned_addr learned my addr 172.21.15.102:0/1552980744 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-04-25T13:15:45.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.358+0000 7fe926ffd640 1 --2- 172.21.15.102:0/1552980744 >> v2:172.21.15.52:3300/0 conn(0x7fe928155330 0x7fe9280d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.358+0000 7fe925ffb640 1 -- 172.21.15.102:0/1552980744 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802220775 0 0) 0x7fe9280c8c40 con 0x7fe92815b200 2024-04-25T13:15:45.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.358+0000 7fe925ffb640 1 -- 172.21.15.102:0/1552980744 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe910003520 con 0x7fe92815b200 2024-04-25T13:15:45.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.358+0000 7fe926ffd640 1 -- 172.21.15.102:0/1552980744 >> v1:172.21.15.102:6789/0 conn(0x7fe92815b200 legacy=0x7fe92815c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.358+0000 7fe925ffb640 1 -- 172.21.15.102:0/1552980744 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2486453968 0 0) 0x7fe910003520 con 0x7fe92815b200 2024-04-25T13:15:45.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.358+0000 7fe926ffd640 1 -- 172.21.15.102:0/1552980744 >> v1:172.21.15.52:6789/0 conn(0x7fe92815cca0 legacy=0x7fe9280c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.358+0000 7fe926ffd640 1 -- 172.21.15.102:0/1552980744 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9280c9200 con 0x7fe928155330 2024-04-25T13:15:45.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.359+0000 7fe926ffd640 1 --2- 172.21.15.102:0/1552980744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe928155330 0x7fe9280d0800 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9180097a0 tx=0x7fe91802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55481f308ed03398 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.359+0000 7fe925ffb640 1 -- 172.21.15.102:0/1552980744 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918037070 con 0x7fe928155330 2024-04-25T13:15:45.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.359+0000 7fe925ffb640 1 -- 172.21.15.102:0/1552980744 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91802abf0 con 0x7fe928155330 2024-04-25T13:15:45.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.359+0000 7fe925ffb640 1 -- 172.21.15.102:0/1552980744 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c001670 con 0x7fe928155330 2024-04-25T13:15:45.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.360+0000 7fe92d820640 1 -- 172.21.15.102:0/1552980744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe928155330 msgr2=0x7fe9280d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.360+0000 7fe92d820640 1 --2- 172.21.15.102:0/1552980744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe928155330 0x7fe9280d0800 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9180097a0 tx=0x7fe91802a160 comp rx=0 tx=0).stop 2024-04-25T13:15:45.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.360+0000 7fe92d820640 1 -- 172.21.15.102:0/1552980744 shutdown_connections 2024-04-25T13:15:45.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.360+0000 7fe92d820640 1 --2- 172.21.15.102:0/1552980744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe928155330 0x7fe9280d0800 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.360+0000 7fe92d820640 1 -- 172.21.15.102:0/1552980744 >> 172.21.15.102:0/1552980744 conn(0x7fe928072570 msgr2=0x7fe928074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.360+0000 7fe92d820640 1 -- 172.21.15.102:0/1552980744 shutdown_connections 2024-04-25T13:15:45.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.360+0000 7fe92d820640 1 -- 172.21.15.102:0/1552980744 wait complete. 2024-04-25T13:15:45.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.361+0000 7fe92d820640 1 Processor -- start 2024-04-25T13:15:45.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.361+0000 7fe92d820640 1 -- start start 2024-04-25T13:15:45.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe92d820640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe928155330 0x7fe9280cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe92d820640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92815b200 0x7fe9280c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe92d820640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe92815cca0 0x7fe9281502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe92d820640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe928155710 con 0x7fe92815b200 2024-04-25T13:15:45.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe92d820640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe9280c97c0 con 0x7fe928155330 2024-04-25T13:15:45.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe92d820640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe9280c6af0 con 0x7fe92815cca0 2024-04-25T13:15:45.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe926ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe928155330 0x7fe9280cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe926ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe928155330 0x7fe9280cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53958/0 (socket says 172.21.15.102:53958) 2024-04-25T13:15:45.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe926ffd640 1 -- 172.21.15.102:0/2972757073 learned_addr learned my addr 172.21.15.102:0/2972757073 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-25T13:15:45.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe9277fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe92815cca0 0x7fe9281502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe9267fc640 1 --2- 172.21.15.102:0/2972757073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92815b200 0x7fe9280c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe926ffd640 1 -- 172.21.15.102:0/2972757073 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe92815cca0 msgr2=0x7fe9281502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe926ffd640 1 --2- 172.21.15.102:0/2972757073 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe92815cca0 0x7fe9281502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe926ffd640 1 -- 172.21.15.102:0/2972757073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92815b200 msgr2=0x7fe9280c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe926ffd640 1 --2- 172.21.15.102:0/2972757073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92815b200 0x7fe9280c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe926ffd640 1 -- 172.21.15.102:0/2972757073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9280c6e70 con 0x7fe928155330 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe9277fe640 1 --2- 172.21.15.102:0/2972757073 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe92815cca0 0x7fe9281502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe926ffd640 1 --2- 172.21.15.102:0/2972757073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe928155330 0x7fe9280cb960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe918035040 tx=0x7fe9180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe90ffff640 1 -- 172.21.15.102:0/2972757073 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918037040 con 0x7fe928155330 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe90ffff640 1 -- 172.21.15.102:0/2972757073 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe918004030 con 0x7fe928155330 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe92d820640 1 -- 172.21.15.102:0/2972757073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9280c7150 con 0x7fe928155330 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe90ffff640 1 -- 172.21.15.102:0/2972757073 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918004400 con 0x7fe928155330 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.362+0000 7fe92d820640 1 -- 172.21.15.102:0/2972757073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9280c14b0 con 0x7fe928155330 2024-04-25T13:15:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.363+0000 7fe90ffff640 1 -- 172.21.15.102:0/2972757073 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe91803a040 con 0x7fe928155330 2024-04-25T13:15:45.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.363+0000 7fe90ffff640 1 -- 172.21.15.102:0/2972757073 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe91803eb20 con 0x7fe928155330 2024-04-25T13:15:45.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.363+0000 7fe92d820640 1 -- 172.21.15.102:0/2972757073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe928154b90 con 0x7fe928155330 2024-04-25T13:15:45.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.365+0000 7fe90ffff640 1 -- 172.21.15.102:0/2972757073 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe928154b90 con 0x7fe928155330 2024-04-25T13:15:45.396 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:45.396+0000 7f060200d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:15:45.421 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:45.421+0000 7f94bd3dc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:15:45.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.437+0000 7fe92d820640 1 -- 172.21.15.102:0/2972757073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f43af6a1-c5e6-4f01-9012-8ea601776eb9", "id": 5} v 0) -- 0x7fe928068f50 con 0x7fe928155330 2024-04-25T13:15:45.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.440+0000 7fe90ffff640 1 -- 172.21.15.102:0/2972757073 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f43af6a1-c5e6-4f01-9012-8ea601776eb9", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe918042020 con 0x7fe928155330 2024-04-25T13:15:45.440 INFO:teuthology.orchestra.run.smithi102.stdout:5 2024-04-25T13:15:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.441+0000 7fe92d820640 1 -- 172.21.15.102:0/2972757073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe928155330 msgr2=0x7fe9280cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.441+0000 7fe92d820640 1 --2- 172.21.15.102:0/2972757073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe928155330 0x7fe9280cb960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe918035040 tx=0x7fe9180046c0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.441+0000 7fe92d820640 1 -- 172.21.15.102:0/2972757073 shutdown_connections 2024-04-25T13:15:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.441+0000 7fe92d820640 1 --2- 172.21.15.102:0/2972757073 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe92815cca0 0x7fe9281502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.441+0000 7fe92d820640 1 --2- 172.21.15.102:0/2972757073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe92815b200 0x7fe9280c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.441+0000 7fe92d820640 1 --2- 172.21.15.102:0/2972757073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe928155330 0x7fe9280cb960 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.441+0000 7fe92d820640 1 -- 172.21.15.102:0/2972757073 >> 172.21.15.102:0/2972757073 conn(0x7fe928072570 msgr2=0x7fe9281530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.441+0000 7fe92d820640 1 -- 172.21.15.102:0/2972757073 shutdown_connections 2024-04-25T13:15:45.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.441+0000 7fe92d820640 1 -- 172.21.15.102:0/2972757073 wait complete. 2024-04-25T13:15:45.451 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:45.451+0000 7f060200d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:15:45.452 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 7aa8935f-7f89-4803-b248-8e7c2a314e24 6 2024-04-25T13:15:45.481 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:45.481+0000 7f94bd3dc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:15:45.536 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:45.536+0000 7f94bd3dc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:15:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.549+0000 7f45feeae640 1 Processor -- start 2024-04-25T13:15:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.549+0000 7f45feeae640 1 -- start start 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.549+0000 7f45feeae640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f45f814fe30 0x7f45f8159880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.549+0000 7f45feeae640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f45f815c460 0x7f45f80ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.549+0000 7f45feeae640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f80c97e0 con 0x7f45f80c92d0 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.549+0000 7f45feeae640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f45f81593f0 con 0x7f45f815c460 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.549+0000 7f45feeae640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f45f80c9ac0 con 0x7f45f814fe30 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.550+0000 7f45fcc4a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f45f814fe30 0x7f45f8159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.550+0000 7f45fcc4a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f45f814fe30 0x7f45f8159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53964/0 (socket says 172.21.15.102:53964) 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.550+0000 7f45fcc4a640 1 -- 172.21.15.102:0/1780678891 learned_addr learned my addr 172.21.15.102:0/1780678891 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.550+0000 7f45f7fff640 1 --2- 172.21.15.102:0/1780678891 >> v2:172.21.15.52:3300/0 conn(0x7f45f815c460 0x7f45f80ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.550+0000 7f45fcc4a640 1 -- 172.21.15.102:0/1780678891 >> v2:172.21.15.52:3300/0 conn(0x7f45f815c460 msgr2=0x7f45f80ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.550+0000 7f45fcc4a640 1 --2- 172.21.15.102:0/1780678891 >> v2:172.21.15.52:3300/0 conn(0x7f45f815c460 0x7f45f80ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.550+0000 7f45fcc4a640 1 -- 172.21.15.102:0/1780678891 >> v1:172.21.15.52:6789/0 conn(0x7f45f80c92d0 legacy=0x7f45f8074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.550+0000 7f45fcc4a640 1 -- 172.21.15.102:0/1780678891 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f80c9da0 con 0x7f45f814fe30 2024-04-25T13:15:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.550+0000 7f45f7fff640 1 --2- 172.21.15.102:0/1780678891 >> v2:172.21.15.52:3300/0 conn(0x7f45f815c460 0x7f45f80ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:15:45.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.550+0000 7f45fcc4a640 1 --2- 172.21.15.102:0/1780678891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45f814fe30 0x7f45f8159880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f45f8072470 tx=0x7f45ec02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65030e38432a740b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.551+0000 7f45f77fe640 1 -- 172.21.15.102:0/1780678891 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec037070 con 0x7f45f814fe30 2024-04-25T13:15:45.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.551+0000 7f45f77fe640 1 -- 172.21.15.102:0/1780678891 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec032440 con 0x7f45f814fe30 2024-04-25T13:15:45.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.551+0000 7f45f77fe640 1 -- 172.21.15.102:0/1780678891 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec032810 con 0x7f45f814fe30 2024-04-25T13:15:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.551+0000 7f45feeae640 1 -- 172.21.15.102:0/1780678891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45f814fe30 msgr2=0x7f45f8159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.551+0000 7f45feeae640 1 --2- 172.21.15.102:0/1780678891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45f814fe30 0x7f45f8159880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f45f8072470 tx=0x7f45ec02a1e0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.551+0000 7f45feeae640 1 -- 172.21.15.102:0/1780678891 shutdown_connections 2024-04-25T13:15:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.551+0000 7f45feeae640 1 --2- 172.21.15.102:0/1780678891 >> v2:172.21.15.52:3300/0 conn(0x7f45f815c460 0x7f45f80ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.551+0000 7f45feeae640 1 --2- 172.21.15.102:0/1780678891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45f814fe30 0x7f45f8159880 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.551+0000 7f45feeae640 1 -- 172.21.15.102:0/1780678891 >> 172.21.15.102:0/1780678891 conn(0x7f45f806e1a0 msgr2=0x7f45f806e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.551+0000 7f45feeae640 1 -- 172.21.15.102:0/1780678891 shutdown_connections 2024-04-25T13:15:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.551+0000 7f45feeae640 1 -- 172.21.15.102:0/1780678891 wait complete. 2024-04-25T13:15:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.552+0000 7f45feeae640 1 Processor -- start 2024-04-25T13:15:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.552+0000 7f45feeae640 1 -- start start 2024-04-25T13:15:45.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.553+0000 7f45feeae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f80c92d0 0x7f45f815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.553+0000 7f45feeae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45f814fe30 0x7f45f806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.553+0000 7f45feeae640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f45f815c460 0x7f45f81f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.553+0000 7f45feeae640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f45f80caf30 con 0x7f45f80c92d0 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.553+0000 7f45feeae640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8159dc0 con 0x7f45f814fe30 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.553+0000 7f45feeae640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f45f80cb0b0 con 0x7f45f815c460 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.553+0000 7f45f7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45f814fe30 0x7f45f806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.553+0000 7f45f7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45f814fe30 0x7f45f806bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53968/0 (socket says 172.21.15.102:53968) 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.553+0000 7f45f7fff640 1 -- 172.21.15.102:0/1917989561 learned_addr learned my addr 172.21.15.102:0/1917989561 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.553+0000 7f45fd44b640 1 --2- 172.21.15.102:0/1917989561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f45f815c460 0x7f45f81f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.553+0000 7f45fcc4a640 1 --2- 172.21.15.102:0/1917989561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f80c92d0 0x7f45f815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45fd44b640 1 -- 172.21.15.102:0/1917989561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45f814fe30 msgr2=0x7f45f806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45fd44b640 1 --2- 172.21.15.102:0/1917989561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45f814fe30 0x7f45f806bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45fd44b640 1 -- 172.21.15.102:0/1917989561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f80c92d0 msgr2=0x7f45f815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45fd44b640 1 --2- 172.21.15.102:0/1917989561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f80c92d0 0x7f45f815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45fd44b640 1 -- 172.21.15.102:0/1917989561 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f81e43b0 con 0x7f45f815c460 2024-04-25T13:15:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45f7fff640 1 --2- 172.21.15.102:0/1917989561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45f814fe30 0x7f45f806bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45fd44b640 1 --2- 172.21.15.102:0/1917989561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f45f815c460 0x7f45f81f20d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f45f000c690 tx=0x7f45f000cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45f57fa640 1 -- 172.21.15.102:0/1917989561 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0003b70 con 0x7f45f815c460 2024-04-25T13:15:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45f57fa640 1 -- 172.21.15.102:0/1917989561 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f0003d10 con 0x7f45f815c460 2024-04-25T13:15:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45feeae640 1 -- 172.21.15.102:0/1917989561 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f815bd00 con 0x7f45f815c460 2024-04-25T13:15:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45f57fa640 1 -- 172.21.15.102:0/1917989561 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0005310 con 0x7f45f815c460 2024-04-25T13:15:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45feeae640 1 -- 172.21.15.102:0/1917989561 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f81e4930 con 0x7f45f815c460 2024-04-25T13:15:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45f57fa640 1 -- 172.21.15.102:0/1917989561 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f45f00054b0 con 0x7f45f815c460 2024-04-25T13:15:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.554+0000 7f45f57fa640 1 -- 172.21.15.102:0/1917989561 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f45f0012a60 con 0x7f45f815c460 2024-04-25T13:15:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.555+0000 7f45feeae640 1 -- 172.21.15.102:0/1917989561 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f815ce10 con 0x7f45f815c460 2024-04-25T13:15:45.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.557+0000 7f45f57fa640 1 -- 172.21.15.102:0/1917989561 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f45f815ce10 con 0x7f45f815c460 2024-04-25T13:15:45.571 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:45.571+0000 7f060200d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:15:45.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.630+0000 7f45feeae640 1 -- 172.21.15.102:0/1917989561 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7aa8935f-7f89-4803-b248-8e7c2a314e24", "id": 6} v 0) -- 0x7f45f806f3a0 con 0x7f45f815c460 2024-04-25T13:15:45.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.633+0000 7f45f57fa640 1 -- 172.21.15.102:0/1917989561 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7aa8935f-7f89-4803-b248-8e7c2a314e24", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f45f806f3a0 con 0x7f45f815c460 2024-04-25T13:15:45.634 INFO:teuthology.orchestra.run.smithi102.stdout:6 2024-04-25T13:15:45.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.634+0000 7f45feeae640 1 -- 172.21.15.102:0/1917989561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f45f815c460 msgr2=0x7f45f81f20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.635+0000 7f45feeae640 1 --2- 172.21.15.102:0/1917989561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f45f815c460 0x7f45f81f20d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f45f000c690 tx=0x7f45f000cb50 comp rx=0 tx=0).stop 2024-04-25T13:15:45.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.635+0000 7f45feeae640 1 -- 172.21.15.102:0/1917989561 shutdown_connections 2024-04-25T13:15:45.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.635+0000 7f45feeae640 1 --2- 172.21.15.102:0/1917989561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f45f815c460 0x7f45f81f20d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.635+0000 7f45feeae640 1 --2- 172.21.15.102:0/1917989561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f45f814fe30 0x7f45f806bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.635+0000 7f45feeae640 1 --2- 172.21.15.102:0/1917989561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45f80c92d0 0x7f45f815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.635+0000 7f45feeae640 1 -- 172.21.15.102:0/1917989561 >> 172.21.15.102:0/1917989561 conn(0x7f45f806e1a0 msgr2=0x7f45f80c41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.635+0000 7f45feeae640 1 -- 172.21.15.102:0/1917989561 shutdown_connections 2024-04-25T13:15:45.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.635+0000 7f45feeae640 1 -- 172.21.15.102:0/1917989561 wait complete. 2024-04-25T13:15:45.648 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new a67c52c4-5c3f-42d0-8c8e-61db85223666 7 2024-04-25T13:15:45.654 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:45.655+0000 7f94bd3dc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:15:45.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.744+0000 7f447cbb4640 1 Processor -- start 2024-04-25T13:15:45.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.745+0000 7f447cbb4640 1 -- start start 2024-04-25T13:15:45.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.745+0000 7f447cbb4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4478152280 0x7f44780cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.745+0000 7f447cbb4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f44780724d0 0x7f44780c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.745+0000 7f447cbb4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f447815c2a0 con 0x7f44780ca4c0 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.745+0000 7f447cbb4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f44780cdc80 con 0x7f4478152280 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.745+0000 7f447cbb4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f44780c8530 con 0x7f44780724d0 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.745+0000 7f446ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f44780724d0 0x7f44780c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.745+0000 7f446ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f44780724d0 0x7f44780c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53976/0 (socket says 172.21.15.102:53976) 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.745+0000 7f446ffff640 1 -- 172.21.15.102:0/764300502 learned_addr learned my addr 172.21.15.102:0/764300502 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.746+0000 7f447659c640 1 --2- 172.21.15.102:0/764300502 >> v2:172.21.15.52:3300/0 conn(0x7f4478152280 0x7f44780cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.746+0000 7f446ffff640 1 -- 172.21.15.102:0/764300502 >> v2:172.21.15.52:3300/0 conn(0x7f4478152280 msgr2=0x7f44780cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.746+0000 7f446ffff640 1 --2- 172.21.15.102:0/764300502 >> v2:172.21.15.52:3300/0 conn(0x7f4478152280 0x7f44780cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.746+0000 7f446ffff640 1 -- 172.21.15.102:0/764300502 >> v1:172.21.15.102:6789/0 conn(0x7f44780ca4c0 legacy=0x7f44780733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.746+0000 7f446ffff640 1 -- 172.21.15.102:0/764300502 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44780cdea0 con 0x7f44780724d0 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.746+0000 7f446ffff640 1 --2- 172.21.15.102:0/764300502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780724d0 0x7f44780c9f80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4478158ec0 tx=0x7f446002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3f5bbc46420ec26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.747+0000 7f4475d9b640 1 -- 172.21.15.102:0/764300502 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460037070 con 0x7f44780724d0 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.747+0000 7f4475d9b640 1 -- 172.21.15.102:0/764300502 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446002ae50 con 0x7f44780724d0 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.747+0000 7f4475d9b640 1 -- 172.21.15.102:0/764300502 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460032860 con 0x7f44780724d0 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.747+0000 7f447cbb4640 1 -- 172.21.15.102:0/764300502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780724d0 msgr2=0x7f44780c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.747+0000 7f447cbb4640 1 --2- 172.21.15.102:0/764300502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780724d0 0x7f44780c9f80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4478158ec0 tx=0x7f446002a300 comp rx=0 tx=0).stop 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.747+0000 7f447cbb4640 1 -- 172.21.15.102:0/764300502 shutdown_connections 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.747+0000 7f447cbb4640 1 --2- 172.21.15.102:0/764300502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780724d0 0x7f44780c9f80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.747+0000 7f447cbb4640 1 --2- 172.21.15.102:0/764300502 >> v2:172.21.15.52:3300/0 conn(0x7f4478152280 0x7f44780cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.747+0000 7f447cbb4640 1 -- 172.21.15.102:0/764300502 >> 172.21.15.102:0/764300502 conn(0x7f447806e1a0 msgr2=0x7f447806e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.747+0000 7f447cbb4640 1 -- 172.21.15.102:0/764300502 shutdown_connections 2024-04-25T13:15:45.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.747+0000 7f447cbb4640 1 -- 172.21.15.102:0/764300502 wait complete. 2024-04-25T13:15:45.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f447cbb4640 1 Processor -- start 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f447cbb4640 1 -- start start 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f447cbb4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44780724d0 0x7f44780c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f447cbb4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780ca4c0 0x7f4478074d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f447cbb4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478152280 0x7f4478075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f447cbb4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f447815baa0 con 0x7f4478152280 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f447cbb4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f447815b7c0 con 0x7f44780ca4c0 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f447cbb4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f447815bd80 con 0x7f44780724d0 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f446ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780ca4c0 0x7f4478074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f447659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44780724d0 0x7f44780c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f447659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44780724d0 0x7f44780c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:32882/0 (socket says 172.21.15.102:32882) 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f446ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780ca4c0 0x7f4478074d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53990/0 (socket says 172.21.15.102:53990) 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f447659c640 1 -- 172.21.15.102:0/1671383054 learned_addr learned my addr 172.21.15.102:0/1671383054 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.749+0000 7f4476d9d640 1 --2- 172.21.15.102:0/1671383054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478152280 0x7f4478075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f447659c640 1 -- 172.21.15.102:0/1671383054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780ca4c0 msgr2=0x7f4478074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f447659c640 1 --2- 172.21.15.102:0/1671383054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780ca4c0 0x7f4478074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f447659c640 1 -- 172.21.15.102:0/1671383054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478152280 msgr2=0x7f4478075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f447659c640 1 --2- 172.21.15.102:0/1671383054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478152280 0x7f4478075290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f447659c640 1 -- 172.21.15.102:0/1671383054 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44780c42b0 con 0x7f44780724d0 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f446ffff640 1 --2- 172.21.15.102:0/1671383054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780ca4c0 0x7f4478074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f447659c640 1 --2- 172.21.15.102:0/1671383054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44780724d0 0x7f44780c7a70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f446800e8a0 tx=0x7f446800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f446effd640 1 -- 172.21.15.102:0/1671383054 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468017070 con 0x7f44780724d0 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f446effd640 1 -- 172.21.15.102:0/1671383054 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446800c940 con 0x7f44780724d0 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f447cbb4640 1 -- 172.21.15.102:0/1671383054 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4478158a60 con 0x7f44780724d0 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f446effd640 1 -- 172.21.15.102:0/1671383054 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446800cd30 con 0x7f44780724d0 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f447cbb4640 1 -- 172.21.15.102:0/1671383054 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f44781f1480 con 0x7f44780724d0 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f446effd640 1 -- 172.21.15.102:0/1671383054 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f446801a070 con 0x7f44780724d0 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.750+0000 7f446effd640 1 -- 172.21.15.102:0/1671383054 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f446801cab0 con 0x7f44780724d0 2024-04-25T13:15:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.751+0000 7f447cbb4640 1 -- 172.21.15.102:0/1671383054 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4478068f50 con 0x7f44780724d0 2024-04-25T13:15:45.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.753+0000 7f446effd640 1 -- 172.21.15.102:0/1671383054 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f446801c450 con 0x7f44780724d0 2024-04-25T13:15:45.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.825+0000 7f447cbb4640 1 -- 172.21.15.102:0/1671383054 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a67c52c4-5c3f-42d0-8c8e-61db85223666", "id": 7} v 0) -- 0x7f44780cb660 con 0x7f44780724d0 2024-04-25T13:15:45.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.831+0000 7f446effd640 1 -- 172.21.15.102:0/1671383054 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a67c52c4-5c3f-42d0-8c8e-61db85223666", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f446801c630 con 0x7f44780724d0 2024-04-25T13:15:45.831 INFO:teuthology.orchestra.run.smithi102.stdout:7 2024-04-25T13:15:45.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.832+0000 7f447cbb4640 1 -- 172.21.15.102:0/1671383054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44780724d0 msgr2=0x7f44780c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:45.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.832+0000 7f447cbb4640 1 --2- 172.21.15.102:0/1671383054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44780724d0 0x7f44780c7a70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f446800e8a0 tx=0x7f446800ed60 comp rx=0 tx=0).stop 2024-04-25T13:15:45.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.832+0000 7f447cbb4640 1 -- 172.21.15.102:0/1671383054 shutdown_connections 2024-04-25T13:15:45.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.832+0000 7f447cbb4640 1 --2- 172.21.15.102:0/1671383054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478152280 0x7f4478075290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.832+0000 7f447cbb4640 1 --2- 172.21.15.102:0/1671383054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780ca4c0 0x7f4478074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.832+0000 7f447cbb4640 1 --2- 172.21.15.102:0/1671383054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44780724d0 0x7f44780c7a70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:45.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.832+0000 7f447cbb4640 1 -- 172.21.15.102:0/1671383054 >> 172.21.15.102:0/1671383054 conn(0x7f447806e1a0 msgr2=0x7f44780c94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:45.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.832+0000 7f447cbb4640 1 -- 172.21.15.102:0/1671383054 shutdown_connections 2024-04-25T13:15:45.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-25T13:15:45.832+0000 7f447cbb4640 1 -- 172.21.15.102:0/1671383054 wait complete. 2024-04-25T13:15:45.846 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T13:15:45.847 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T13:15:45.849 INFO:tasks.ceph.osd.0:Started 2024-04-25T13:15:45.849 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T13:15:45.849 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T13:15:45.853 INFO:tasks.ceph.osd.1:Started 2024-04-25T13:15:45.853 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T13:15:45.853 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T13:15:45.855 INFO:tasks.ceph.osd.2:Started 2024-04-25T13:15:45.856 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T13:15:45.856 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T13:15:45.858 INFO:tasks.ceph.osd.3:Started 2024-04-25T13:15:45.858 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T13:15:45.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T13:15:45.860 INFO:tasks.ceph.osd.4:Started 2024-04-25T13:15:45.861 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T13:15:45.861 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T13:15:45.863 INFO:tasks.ceph.osd.5:Started 2024-04-25T13:15:45.863 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T13:15:45.863 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T13:15:45.865 INFO:tasks.ceph.osd.6:Started 2024-04-25T13:15:45.865 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T13:15:45.866 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T13:15:45.868 INFO:tasks.ceph.osd.7:Started 2024-04-25T13:15:45.868 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:15:46.010 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:46.010+0000 7f060200d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:15:46.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.017+0000 7fb9c40fa640 1 Processor -- start 2024-04-25T13:15:46.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.017+0000 7fb9c40fa640 1 -- start start 2024-04-25T13:15:46.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.017+0000 7fb9c40fa640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9bc1554e0 0x7fb9bc15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c40fa640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb9bc0b3c00 0x7fb9bc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c40fa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9bc0b5450 0x7fb9bc0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c40fa640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb9bc0b4a80 con 0x7fb9bc1554e0 2024-04-25T13:15:46.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c40fa640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb9bc1558c0 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c40fa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb9bc15f630 con 0x7fb9bc0b5450 2024-04-25T13:15:46.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c1e96640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9bc1554e0 0x7fb9bc15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c1e96640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9bc1554e0 0x7fb9bc15f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52324/0 (socket says 172.21.15.52:52324) 2024-04-25T13:15:46.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c1e96640 1 -- 172.21.15.52:0/3768386067 learned_addr learned my addr 172.21.15.52:0/3768386067 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:15:46.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c1695640 1 --2- 172.21.15.52:0/3768386067 >> v2:172.21.15.102:3300/0 conn(0x7fb9bc0b3c00 0x7fb9bc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c2697640 1 --2- 172.21.15.52:0/3768386067 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9bc0b5450 0x7fb9bc0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c1e96640 1 -- 172.21.15.52:0/3768386067 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9bc0b5450 msgr2=0x7fb9bc0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:46.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c1e96640 1 --2- 172.21.15.52:0/3768386067 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9bc0b5450 0x7fb9bc0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c1e96640 1 -- 172.21.15.52:0/3768386067 >> v2:172.21.15.102:3300/0 conn(0x7fb9bc0b3c00 msgr2=0x7fb9bc0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:46.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c1e96640 1 --2- 172.21.15.52:0/3768386067 >> v2:172.21.15.102:3300/0 conn(0x7fb9bc0b3c00 0x7fb9bc0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.018+0000 7fb9c1e96640 1 -- 172.21.15.52:0/3768386067 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc0cb8c0 con 0x7fb9bc1554e0 2024-04-25T13:15:46.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.019+0000 7fb9c1e96640 1 --2- 172.21.15.52:0/3768386067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9bc1554e0 0x7fb9bc15f0f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0ce7e0 tx=0x7fb9b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f3796bef84bbfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:46.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.019+0000 7fb9c0e94640 1 -- 172.21.15.52:0/3768386067 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0037070 con 0x7fb9bc1554e0 2024-04-25T13:15:46.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.019+0000 7fb9c0e94640 1 -- 172.21.15.52:0/3768386067 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b0032440 con 0x7fb9bc1554e0 2024-04-25T13:15:46.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.019+0000 7fb9c0e94640 1 -- 172.21.15.52:0/3768386067 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0032810 con 0x7fb9bc1554e0 2024-04-25T13:15:46.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.020+0000 7fb9c40fa640 1 -- 172.21.15.52:0/3768386067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9bc1554e0 msgr2=0x7fb9bc15f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.020+0000 7fb9c40fa640 1 --2- 172.21.15.52:0/3768386067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9bc1554e0 0x7fb9bc15f0f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0ce7e0 tx=0x7fb9b002a270 comp rx=0 tx=0).stop 2024-04-25T13:15:46.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.020+0000 7fb9c40fa640 1 -- 172.21.15.52:0/3768386067 shutdown_connections 2024-04-25T13:15:46.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.020+0000 7fb9c40fa640 1 --2- 172.21.15.52:0/3768386067 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9bc0b5450 0x7fb9bc0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.020+0000 7fb9c40fa640 1 --2- 172.21.15.52:0/3768386067 >> v2:172.21.15.102:3300/0 conn(0x7fb9bc0b3c00 0x7fb9bc0b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.020+0000 7fb9c40fa640 1 --2- 172.21.15.52:0/3768386067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9bc1554e0 0x7fb9bc15f0f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.020+0000 7fb9c40fa640 1 -- 172.21.15.52:0/3768386067 >> 172.21.15.52:0/3768386067 conn(0x7fb9bc074d50 msgr2=0x7fb9bc075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:46.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.020+0000 7fb9c40fa640 1 -- 172.21.15.52:0/3768386067 shutdown_connections 2024-04-25T13:15:46.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.020+0000 7fb9c40fa640 1 -- 172.21.15.52:0/3768386067 wait complete. 2024-04-25T13:15:46.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.022+0000 7fb9c40fa640 1 Processor -- start 2024-04-25T13:15:46.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.022+0000 7fb9c40fa640 1 -- start start 2024-04-25T13:15:46.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c40fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9bc0b3c00 0x7fb9bc1f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c40fa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9bc0b5450 0x7fb9bc1e52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c40fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9bc1554e0 0x7fb9bc15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:46.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c40fa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc0b4430 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c40fa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc0b4150 con 0x7fb9bc1554e0 2024-04-25T13:15:46.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c40fa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb9bc0b4710 con 0x7fb9bc0b5450 2024-04-25T13:15:46.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c1e96640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9bc0b3c00 0x7fb9bc1f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c1e96640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9bc0b3c00 0x7fb9bc1f1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52328/0 (socket says 172.21.15.52:52328) 2024-04-25T13:15:46.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c1e96640 1 -- 172.21.15.52:0/2241958123 learned_addr learned my addr 172.21.15.52:0/2241958123 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:15:46.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c1695640 1 --2- 172.21.15.52:0/2241958123 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9bc0b5450 0x7fb9bc1e52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c2697640 1 --2- 172.21.15.52:0/2241958123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9bc1554e0 0x7fb9bc15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:46.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c1e96640 1 -- 172.21.15.52:0/2241958123 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9bc0b5450 msgr2=0x7fb9bc1e52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c1e96640 1 --2- 172.21.15.52:0/2241958123 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9bc0b5450 0x7fb9bc1e52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c1e96640 1 -- 172.21.15.52:0/2241958123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9bc1554e0 msgr2=0x7fb9bc15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c1e96640 1 --2- 172.21.15.52:0/2241958123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9bc1554e0 0x7fb9bc15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c1e96640 1 -- 172.21.15.52:0/2241958123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc1f1550 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.023+0000 7fb9c1e96640 1 --2- 172.21.15.52:0/2241958123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9bc0b3c00 0x7fb9bc1f1010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb9b002a2b0 tx=0x7fb9b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.024+0000 7fb9ae7fc640 1 -- 172.21.15.52:0/2241958123 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0041020 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.024+0000 7fb9ae7fc640 1 -- 172.21.15.52:0/2241958123 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b003d620 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.024+0000 7fb9c40fa640 1 -- 172.21.15.52:0/2241958123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9bc1e5c80 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.024+0000 7fb9ae7fc640 1 -- 172.21.15.52:0/2241958123 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0037040 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.024+0000 7fb9c40fa640 1 -- 172.21.15.52:0/2241958123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9bc1f1a80 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.024+0000 7fb9ae7fc640 1 -- 172.21.15.52:0/2241958123 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb9b0044020 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.024+0000 7fb9ae7fc640 1 -- 172.21.15.52:0/2241958123 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb9b003dda0 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.025+0000 7fb9c40fa640 1 -- 172.21.15.52:0/2241958123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9bc0cd3e0 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.029+0000 7fb9ae7fc640 1 -- 172.21.15.52:0/2241958123 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb9b004b030 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.091+0000 7fb9c40fa640 1 -- 172.21.15.52:0/2241958123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9bc068e20 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.091+0000 7fb9ae7fc640 1 -- 172.21.15.52:0/2241958123 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb9b0046400 con 0x7fb9bc0b3c00 2024-04-25T13:15:46.092 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:15:46.092 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":10,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:15:45.827611+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:15:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.092+0000 7fb9c40fa640 1 -- 172.21.15.52:0/2241958123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9bc0b3c00 msgr2=0x7fb9bc1f1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.092+0000 7fb9c40fa640 1 --2- 172.21.15.52:0/2241958123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9bc0b3c00 0x7fb9bc1f1010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb9b002a2b0 tx=0x7fb9b00046c0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.092+0000 7fb9c40fa640 1 -- 172.21.15.52:0/2241958123 shutdown_connections 2024-04-25T13:15:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.092+0000 7fb9c40fa640 1 --2- 172.21.15.52:0/2241958123 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9bc0b5450 0x7fb9bc1e52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.092+0000 7fb9c40fa640 1 --2- 172.21.15.52:0/2241958123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9bc1554e0 0x7fb9bc15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.092+0000 7fb9c40fa640 1 --2- 172.21.15.52:0/2241958123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9bc0b3c00 0x7fb9bc1f1010 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.092+0000 7fb9c40fa640 1 -- 172.21.15.52:0/2241958123 >> 172.21.15.52:0/2241958123 conn(0x7fb9bc074d50 msgr2=0x7fb9bc0cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.092+0000 7fb9c40fa640 1 -- 172.21.15.52:0/2241958123 shutdown_connections 2024-04-25T13:15:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:15:46.092+0000 7fb9c40fa640 1 -- 172.21.15.52:0/2241958123 wait complete. 2024-04-25T13:15:46.103 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T13:15:46.103 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T13:15:46.113 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:46.113+0000 7f94bd3dc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:15:46.269 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:46.269+0000 7f060200d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:15:46.320 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:46.320+0000 7f060200d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:15:46.384 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:46.384+0000 7f94bd3dc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:15:46.435 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:46.435+0000 7f060200d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:15:46.438 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:46.439+0000 7f94bd3dc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:15:46.467 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-04-25T13:15:46.467+0000 7f814be0e640 -1 Falling back to public interface 2024-04-25T13:15:46.475 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-04-25T13:15:46.475+0000 7f8343dfc640 -1 Falling back to public interface 2024-04-25T13:15:46.476 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-04-25T13:15:46.475+0000 7fdbe99cb640 -1 Falling back to public interface 2024-04-25T13:15:46.476 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-04-25T13:15:46.476+0000 7fef6d6f0640 -1 Falling back to public interface 2024-04-25T13:15:46.478 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-04-25T13:15:46.478+0000 7f25b8a2c640 -1 Falling back to public interface 2024-04-25T13:15:46.479 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-04-25T13:15:46.478+0000 7f3dc6ce3640 -1 Falling back to public interface 2024-04-25T13:15:46.479 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-04-25T13:15:46.479+0000 7fd1e9d33640 -1 Falling back to public interface 2024-04-25T13:15:46.483 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-04-25T13:15:46.483+0000 7fd52bc9b640 -1 Falling back to public interface 2024-04-25T13:15:46.564 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:46.564+0000 7f94bd3dc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:15:46.718 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:46.718+0000 7f060200d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:15:46.766 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:46.766+0000 7f060200d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:15:46.858 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:46.858+0000 7f94bd3dc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:15:46.910 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:15:46.911 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:46.908+0000 7f94bd3dc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:15:46.920 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:46.920+0000 7f060200d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:15:47.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.003+0000 7f06c14bb640 1 Processor -- start 2024-04-25T13:15:47.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.003+0000 7f06c14bb640 1 -- start start 2024-04-25T13:15:47.004 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.004+0000 7f06c14bb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06bc0ce980 0x7f06bc158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.004 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.004+0000 7f06c14bb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06bc0c93b0 con 0x7f06bc0c56f0 2024-04-25T13:15:47.004 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.004+0000 7f06c14bb640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06bc0c9670 con 0x7f06bc0cbe20 2024-04-25T13:15:47.005 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.004+0000 7f06c14bb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f06bc0c9180 con 0x7f06bc0ce980 2024-04-25T13:15:47.005 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.004+0000 7f06baffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06bc0ce980 0x7f06bc158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.005 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.004+0000 7f06baffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06bc0ce980 0x7f06bc158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52336/0 (socket says 172.21.15.52:52336) 2024-04-25T13:15:47.005 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.004+0000 7f06baffd640 1 -- 172.21.15.52:0/2906738488 learned_addr learned my addr 172.21.15.52:0/2906738488 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:15:47.005 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.004+0000 7f06bb7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f06bc0c56f0 0x7f06bc1636b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40498/0 (socket says 172.21.15.52:40498) 2024-04-25T13:15:47.005 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.004+0000 7f06baffd640 1 -- 172.21.15.52:0/2906738488 >> v1:172.21.15.102:6789/0 conn(0x7f06bc0cbe20 legacy=0x7f06bc152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.005 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.004+0000 7f06baffd640 1 -- 172.21.15.52:0/2906738488 >> v1:172.21.15.52:6789/0 conn(0x7f06bc0c56f0 legacy=0x7f06bc1636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.005 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.004+0000 7f06baffd640 1 -- 172.21.15.52:0/2906738488 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06bc0cb340 con 0x7f06bc0ce980 2024-04-25T13:15:47.007 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.005+0000 7f06baffd640 1 --2- 172.21.15.52:0/2906738488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06bc0ce980 0x7f06bc158d30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009870 tx=0x7f06ac02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efaaaed39ef5fc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:47.007 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.005+0000 7f06b9ffb640 1 -- 172.21.15.52:0/2906738488 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac037070 con 0x7f06bc0ce980 2024-04-25T13:15:47.007 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.005+0000 7f06b9ffb640 1 -- 172.21.15.52:0/2906738488 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac02ae50 con 0x7f06bc0ce980 2024-04-25T13:15:47.007 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.005+0000 7f06b9ffb640 1 -- 172.21.15.52:0/2906738488 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac032860 con 0x7f06bc0ce980 2024-04-25T13:15:47.007 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.005+0000 7f06c14bb640 1 -- 172.21.15.52:0/2906738488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06bc0ce980 msgr2=0x7f06bc158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.007 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.005+0000 7f06c14bb640 1 --2- 172.21.15.52:0/2906738488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06bc0ce980 0x7f06bc158d30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009870 tx=0x7f06ac02a300 comp rx=0 tx=0).stop 2024-04-25T13:15:47.007 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.006+0000 7f06c14bb640 1 -- 172.21.15.52:0/2906738488 shutdown_connections 2024-04-25T13:15:47.007 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.006+0000 7f06c14bb640 1 --2- 172.21.15.52:0/2906738488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06bc0ce980 0x7f06bc158d30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.007 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.006+0000 7f06c14bb640 1 -- 172.21.15.52:0/2906738488 >> 172.21.15.52:0/2906738488 conn(0x7f06bc073830 msgr2=0x7f06bc06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:47.007 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.006+0000 7f06c14bb640 1 -- 172.21.15.52:0/2906738488 shutdown_connections 2024-04-25T13:15:47.008 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.006+0000 7f06c14bb640 1 -- 172.21.15.52:0/2906738488 wait complete. 2024-04-25T13:15:47.008 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.007+0000 7f06c14bb640 1 Processor -- start 2024-04-25T13:15:47.008 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.007+0000 7f06c14bb640 1 -- start start 2024-04-25T13:15:47.010 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06c14bb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06bc0c56f0 0x7f06bc157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.010 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06c14bb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06bc0cbe20 0x7f06bc158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.010 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06c14bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06bc0ce980 0x7f06bc1eee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.011 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06c14bb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06bc0cb900 con 0x7f06bc0c56f0 2024-04-25T13:15:47.011 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06c14bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f06bc0c9950 con 0x7f06bc0ce980 2024-04-25T13:15:47.011 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06c14bb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f06bc159270 con 0x7f06bc0cbe20 2024-04-25T13:15:47.011 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06bc0c56f0 0x7f06bc157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.011 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06bc0c56f0 0x7f06bc157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52340/0 (socket says 172.21.15.52:52340) 2024-04-25T13:15:47.011 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06baffd640 1 -- 172.21.15.52:0/966980061 learned_addr learned my addr 172.21.15.52:0/966980061 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:15:47.011 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06bb7fe640 1 --2- 172.21.15.52:0/966980061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06bc0ce980 0x7f06bc1eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.011 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06ba7fc640 1 --2- 172.21.15.52:0/966980061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06bc0cbe20 0x7f06bc158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.011 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06baffd640 1 -- 172.21.15.52:0/966980061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06bc0cbe20 msgr2=0x7f06bc158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.011 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06baffd640 1 --2- 172.21.15.52:0/966980061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06bc0cbe20 0x7f06bc158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.011 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06baffd640 1 -- 172.21.15.52:0/966980061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06bc0ce980 msgr2=0x7f06bc1eee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.011 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06baffd640 1 --2- 172.21.15.52:0/966980061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06bc0ce980 0x7f06bc1eee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.012 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06baffd640 1 -- 172.21.15.52:0/966980061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06bc0ce270 con 0x7f06bc0c56f0 2024-04-25T13:15:47.012 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06bb7fe640 1 --2- 172.21.15.52:0/966980061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06bc0ce980 0x7f06bc1eee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:47.012 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06baffd640 1 --2- 172.21.15.52:0/966980061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06bc0c56f0 0x7f06bc157b30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009870 tx=0x7f06ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:47.012 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06a37fe640 1 -- 172.21.15.52:0/966980061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac041070 con 0x7f06bc0c56f0 2024-04-25T13:15:47.012 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06a37fe640 1 -- 172.21.15.52:0/966980061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac03c870 con 0x7f06bc0c56f0 2024-04-25T13:15:47.012 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06a37fe640 1 -- 172.21.15.52:0/966980061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac037040 con 0x7f06bc0c56f0 2024-04-25T13:15:47.012 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.008+0000 7f06c14bb640 1 -- 172.21.15.52:0/966980061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06bc14ca60 con 0x7f06bc0c56f0 2024-04-25T13:15:47.012 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.009+0000 7f06c14bb640 1 -- 172.21.15.52:0/966980061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06bc158d30 con 0x7f06bc0c56f0 2024-04-25T13:15:47.012 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.009+0000 7f06a37fe640 1 -- 172.21.15.52:0/966980061 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f06ac044070 con 0x7f06bc0c56f0 2024-04-25T13:15:47.012 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.009+0000 7f06a37fe640 1 -- 172.21.15.52:0/966980061 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f06ac046db0 con 0x7f06bc0c56f0 2024-04-25T13:15:47.012 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.009+0000 7f06c14bb640 1 -- 172.21.15.52:0/966980061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06bc04fdc0 con 0x7f06bc0c56f0 2024-04-25T13:15:47.013 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.012+0000 7f06a37fe640 1 -- 172.21.15.52:0/966980061 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f06ac03cd00 con 0x7f06bc0c56f0 2024-04-25T13:15:47.057 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:47.057+0000 7f060200d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:15:47.076 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.076+0000 7f06c14bb640 1 -- 172.21.15.52:0/966980061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06bc0ca260 con 0x7f06bc0c56f0 2024-04-25T13:15:47.076 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:47.076+0000 7f94bd3dc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:15:47.076 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.076+0000 7f06a37fe640 1 -- 172.21.15.52:0/966980061 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f06ac046450 con 0x7f06bc0c56f0 2024-04-25T13:15:47.077 INFO:teuthology.misc.health.smithi052.stdout: 2024-04-25T13:15:47.077 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:15:45.827611+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:15:47.078 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.077+0000 7f06c14bb640 1 -- 172.21.15.52:0/966980061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06bc0c56f0 msgr2=0x7f06bc157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:47.078 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.077+0000 7f06c14bb640 1 --2- 172.21.15.52:0/966980061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06bc0c56f0 0x7f06bc157b30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009870 tx=0x7f06ac0046c0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.078 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.077+0000 7f06c14bb640 1 -- 172.21.15.52:0/966980061 shutdown_connections 2024-04-25T13:15:47.078 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.077+0000 7f06c14bb640 1 --2- 172.21.15.52:0/966980061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06bc0cbe20 0x7f06bc158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.078 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.077+0000 7f06c14bb640 1 --2- 172.21.15.52:0/966980061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06bc0ce980 0x7f06bc1eee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.078 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.077+0000 7f06c14bb640 1 --2- 172.21.15.52:0/966980061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06bc0c56f0 0x7f06bc157b30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:47.079 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.077+0000 7f06c14bb640 1 -- 172.21.15.52:0/966980061 >> 172.21.15.52:0/966980061 conn(0x7f06bc073830 msgr2=0x7f06bc150f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:47.079 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.077+0000 7f06c14bb640 1 -- 172.21.15.52:0/966980061 shutdown_connections 2024-04-25T13:15:47.079 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:47.077+0000 7f06c14bb640 1 -- 172.21.15.52:0/966980061 wait complete. 2024-04-25T13:15:47.087 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T13:15:47.105 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:47.105+0000 7f060200d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:15:47.173 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:47.173+0000 7f060200d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:15:47.218 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:47.218+0000 7f060200d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:15:47.220 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:47.220+0000 7f94bd3dc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:15:47.272 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:47.272+0000 7f94bd3dc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:15:47.346 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:47.346+0000 7f94bd3dc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:15:47.393 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:47.393+0000 7f94bd3dc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:15:47.695 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:47.694+0000 7f060200d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:15:47.808 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:47.807+0000 7f060200d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:15:47.902 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:47.902+0000 7f94bd3dc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:15:48.024 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T13:15:48.023+0000 7f94bd3dc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:15:48.823 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:48.822+0000 7f05a26f5640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T13:15:48.823 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-25T13:15:48.823+0000 7f05a26f5640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T13:15:49.936 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-04-25T13:15:49.936+0000 7f8343dfc640 -1 osd.2 0 log_to_monitors true 2024-04-25T13:15:49.976 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-04-25T13:15:49.976+0000 7f3dc6ce3640 -1 osd.3 0 log_to_monitors true 2024-04-25T13:15:49.980 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-04-25T13:15:49.980+0000 7f814be0e640 -1 osd.1 0 log_to_monitors true 2024-04-25T13:15:49.985 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-04-25T13:15:49.985+0000 7fdbe99cb640 -1 osd.6 0 log_to_monitors true 2024-04-25T13:15:50.004 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-04-25T13:15:50.004+0000 7f25b8a2c640 -1 osd.0 0 log_to_monitors true 2024-04-25T13:15:50.009 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-04-25T13:15:50.009+0000 7fd1e9d33640 -1 osd.7 0 log_to_monitors true 2024-04-25T13:15:50.021 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-04-25T13:15:50.021+0000 7fef6d6f0640 -1 osd.4 0 log_to_monitors true 2024-04-25T13:15:50.032 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-04-25T13:15:50.033+0000 7fd52bc9b640 -1 osd.5 0 log_to_monitors true 2024-04-25T13:15:53.250 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-04-25T13:15:53.247+0000 7f25b49c2640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T13:15:53.257 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-04-25T13:15:53.257+0000 7f25ac7e2640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:53.274 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-04-25T13:15:53.274+0000 7f3dc2c79640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T13:15:53.287 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-04-25T13:15:53.287+0000 7f3dbaa99640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:53.302 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-04-25T13:15:53.302+0000 7f8147704640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T13:15:53.310 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-04-25T13:15:53.310+0000 7f833fd92640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T13:15:53.318 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-04-25T13:15:53.318+0000 7f813f524640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:53.322 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-04-25T13:15:53.322+0000 7f8337bb2640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:53.892 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:15:53.939 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-04-25T13:15:53.939+0000 7fd527c31640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T13:15:53.940 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-04-25T13:15:53.940+0000 7fdbe5961640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T13:15:53.953 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-04-25T13:15:53.953+0000 7fd1e5cc9640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T13:15:53.953 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-04-25T13:15:53.953+0000 7fd51fa51640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:53.954 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-04-25T13:15:53.953+0000 7fdbdd781640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:53.971 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-04-25T13:15:53.971+0000 7fd1ddae9640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:53.971 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-04-25T13:15:53.972+0000 7fef69686640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T13:15:53.989 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-04-25T13:15:53.989+0000 7fef614a6640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:15:53.996 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.996+0000 7f4fff243640 1 Processor -- start 2024-04-25T13:15:53.996 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.996+0000 7f4fff243640 1 -- start start 2024-04-25T13:15:53.997 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.996+0000 7f4fff243640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ff81552b0 0x7f4ff80ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:53.997 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.996+0000 7f4fff243640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ff8155690 0x7f4ff80cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:53.997 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.997+0000 7f4fff243640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff80cdc90 con 0x7f4ff806df80 2024-04-25T13:15:53.997 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.997+0000 7f4fff243640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4ff815bbd0 con 0x7f4ff81552b0 2024-04-25T13:15:53.997 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.997+0000 7f4fff243640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff815c100 con 0x7f4ff8155690 2024-04-25T13:15:53.997 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.997+0000 7f4ffcfdf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ff81552b0 0x7f4ff80ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:53.997 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.997+0000 7f4ffcfdf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ff81552b0 0x7f4ff80ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48360/0 (socket says 172.21.15.52:48360) 2024-04-25T13:15:53.997 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.997+0000 7f4ffcfdf640 1 -- 172.21.15.52:0/1015151221 learned_addr learned my addr 172.21.15.52:0/1015151221 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:15:53.997 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.997+0000 7f4ff7fff640 1 --2- 172.21.15.52:0/1015151221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ff8155690 0x7f4ff80cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:53.998 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.997+0000 7f4ffcfdf640 1 -- 172.21.15.52:0/1015151221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ff8155690 msgr2=0x7f4ff80cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:53.998 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.997+0000 7f4ffcfdf640 1 --2- 172.21.15.52:0/1015151221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ff8155690 0x7f4ff80cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:53.998 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.997+0000 7f4ffcfdf640 1 -- 172.21.15.52:0/1015151221 >> v1:172.21.15.102:6789/0 conn(0x7f4ff806df80 legacy=0x7f4ff806bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:53.998 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.997+0000 7f4ff77fe640 1 -- 172.21.15.52:0/1015151221 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1979574099 0 0) 0x7f4ff80cdc90 con 0x7f4ff806df80 2024-04-25T13:15:53.998 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.997+0000 7f4ffcfdf640 1 -- 172.21.15.52:0/1015151221 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff815be20 con 0x7f4ff81552b0 2024-04-25T13:15:53.999 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.998+0000 7f4ffcfdf640 1 --2- 172.21.15.52:0/1015151221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ff81552b0 0x7f4ff80ccf60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009870 tx=0x7f4fec02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0a4f0a616e9d8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:53.999 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.998+0000 7f4ff77fe640 1 -- 172.21.15.52:0/1015151221 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec037070 con 0x7f4ff81552b0 2024-04-25T13:15:53.999 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.998+0000 7f4ff77fe640 1 -- 172.21.15.52:0/1015151221 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec032440 con 0x7f4ff81552b0 2024-04-25T13:15:53.999 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.998+0000 7f4ff77fe640 1 -- 172.21.15.52:0/1015151221 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec032810 con 0x7f4ff81552b0 2024-04-25T13:15:53.999 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.999+0000 7f4fff243640 1 -- 172.21.15.52:0/1015151221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ff81552b0 msgr2=0x7f4ff80ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:54.000 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.999+0000 7f4fff243640 1 --2- 172.21.15.52:0/1015151221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ff81552b0 0x7f4ff80ccf60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009870 tx=0x7f4fec02a1c0 comp rx=0 tx=0).stop 2024-04-25T13:15:54.000 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.999+0000 7f4fff243640 1 -- 172.21.15.52:0/1015151221 shutdown_connections 2024-04-25T13:15:54.000 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.999+0000 7f4fff243640 1 --2- 172.21.15.52:0/1015151221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ff8155690 0x7f4ff80cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:54.000 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.999+0000 7f4fff243640 1 --2- 172.21.15.52:0/1015151221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ff81552b0 0x7f4ff80ccf60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:54.000 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.999+0000 7f4fff243640 1 -- 172.21.15.52:0/1015151221 >> 172.21.15.52:0/1015151221 conn(0x7f4ff8073690 msgr2=0x7f4ff806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:54.000 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.999+0000 7f4fff243640 1 -- 172.21.15.52:0/1015151221 shutdown_connections 2024-04-25T13:15:54.000 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:53.999+0000 7f4fff243640 1 -- 172.21.15.52:0/1015151221 wait complete. 2024-04-25T13:15:54.002 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.000+0000 7f4fff243640 1 Processor -- start 2024-04-25T13:15:54.002 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.000+0000 7f4fff243640 1 -- start start 2024-04-25T13:15:54.002 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4fff243640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ff806df80 0x7f4ff815a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:54.002 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4fff243640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff81552b0 0x7f4ff81e5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4fff243640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ff8155690 0x7f4ff81e5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4fff243640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff806c420 con 0x7f4ff8155690 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4fff243640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff80cb730 con 0x7f4ff81552b0 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4fff243640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff806c5a0 con 0x7f4ff806df80 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4ffd7e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ff8155690 0x7f4ff81e5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4ffcfdf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ff806df80 0x7f4ff815a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4ff7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff81552b0 0x7f4ff81e5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4ffd7e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ff8155690 0x7f4ff81e5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48366/0 (socket says 172.21.15.52:48366) 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4ffd7e0640 1 -- 172.21.15.52:0/1283158401 learned_addr learned my addr 172.21.15.52:0/1283158401 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4ffcfdf640 1 -- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff81552b0 msgr2=0x7f4ff81e5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4ffcfdf640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff81552b0 0x7f4ff81e5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4ffcfdf640 1 -- 172.21.15.52:0/1283158401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ff8155690 msgr2=0x7f4ff81e5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:54.003 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4ffcfdf640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ff8155690 0x7f4ff81e5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:54.004 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4ffcfdf640 1 -- 172.21.15.52:0/1283158401 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff81f0bf0 con 0x7f4ff806df80 2024-04-25T13:15:54.004 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4ffd7e0640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ff8155690 0x7f4ff81e5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:54.004 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.001+0000 7f4ffcfdf640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ff806df80 0x7f4ff815a280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4fec031000 tx=0x7f4fec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:54.004 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.002+0000 7f4ff57fa640 1 -- 172.21.15.52:0/1283158401 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec041070 con 0x7f4ff806df80 2024-04-25T13:15:54.004 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.002+0000 7f4ff57fa640 1 -- 172.21.15.52:0/1283158401 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec004240 con 0x7f4ff806df80 2024-04-25T13:15:54.004 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.002+0000 7f4fff243640 1 -- 172.21.15.52:0/1283158401 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff81f0e90 con 0x7f4ff806df80 2024-04-25T13:15:54.004 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.002+0000 7f4ff57fa640 1 -- 172.21.15.52:0/1283158401 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec037040 con 0x7f4ff806df80 2024-04-25T13:15:54.004 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.002+0000 7f4fff243640 1 -- 172.21.15.52:0/1283158401 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff81f1450 con 0x7f4ff806df80 2024-04-25T13:15:54.005 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.003+0000 7f4fff243640 1 -- 172.21.15.52:0/1283158401 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff80cafe0 con 0x7f4ff806df80 2024-04-25T13:15:54.005 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.003+0000 7f4ff57fa640 1 -- 172.21.15.52:0/1283158401 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f4fec02ad10 con 0x7f4ff806df80 2024-04-25T13:15:54.005 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.003+0000 7f4ff57fa640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4fdc06c890 0x7f4fdc06ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:54.005 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.003+0000 7f4ff57fa640 1 -- 172.21.15.52:0/1283158401 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f4fec0ab090 con 0x7f4ff806df80 2024-04-25T13:15:54.006 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.003+0000 7f4ff7fff640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4fdc06c890 0x7f4fdc06ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:54.006 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.004+0000 7f4ff7fff640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4fdc06c890 0x7f4fdc06ed50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8145fa0 tx=0x7f4fe4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:54.008 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.008+0000 7f4ff57fa640 1 -- 172.21.15.52:0/1283158401 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4fec079bb0 con 0x7f4ff806df80 2024-04-25T13:15:54.195 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.195+0000 7f4fff243640 1 -- 172.21.15.52:0/1283158401 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ff804fdc0 con 0x7f4ff806df80 2024-04-25T13:15:54.195 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.196+0000 7f4ff57fa640 1 -- 172.21.15.52:0/1283158401 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f4fec07deb0 con 0x7f4ff806df80 2024-04-25T13:15:54.196 INFO:teuthology.misc.health.smithi052.stdout: 2024-04-25T13:15:54.196 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":12,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:15:51.825139+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:15:54.198 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.197+0000 7f4fff243640 1 -- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4fdc06c890 msgr2=0x7f4fdc06ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:54.198 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.197+0000 7f4fff243640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4fdc06c890 0x7f4fdc06ed50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8145fa0 tx=0x7f4fe4009190 comp rx=0 tx=0).stop 2024-04-25T13:15:54.198 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.197+0000 7f4fff243640 1 -- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ff806df80 msgr2=0x7f4ff815a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:54.198 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.197+0000 7f4fff243640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ff806df80 0x7f4ff815a280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4fec031000 tx=0x7f4fec0046c0 comp rx=0 tx=0).stop 2024-04-25T13:15:54.198 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.198+0000 7f4fff243640 1 -- 172.21.15.52:0/1283158401 shutdown_connections 2024-04-25T13:15:54.198 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.198+0000 7f4fff243640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4fdc06c890 0x7f4fdc06ed50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:54.198 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.198+0000 7f4fff243640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ff8155690 0x7f4ff81e5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:54.198 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.198+0000 7f4fff243640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff81552b0 0x7f4ff81e5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:54.198 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.198+0000 7f4fff243640 1 --2- 172.21.15.52:0/1283158401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ff806df80 0x7f4ff815a280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:54.198 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.198+0000 7f4fff243640 1 -- 172.21.15.52:0/1283158401 >> 172.21.15.52:0/1283158401 conn(0x7f4ff8073690 msgr2=0x7f4ff80c5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:54.199 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.198+0000 7f4fff243640 1 -- 172.21.15.52:0/1283158401 shutdown_connections 2024-04-25T13:15:54.199 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:15:54.198+0000 7f4fff243640 1 -- 172.21.15.52:0/1283158401 wait complete. 2024-04-25T13:15:54.207 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T13:16:01.015 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:01.120 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.120+0000 7f733ffa2640 1 Processor -- start 2024-04-25T13:16:01.120 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.120+0000 7f733ffa2640 1 -- start start 2024-04-25T13:16:01.121 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733ffa2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73380cb980 0x7f733806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.121 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733ffa2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f733806d770 0x7f733815b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.121 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733ffa2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f733815e7d0 con 0x7f73381554d0 2024-04-25T13:16:01.121 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733ffa2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f733815eab0 con 0x7f733806d770 2024-04-25T13:16:01.121 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733ffa2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f733815ed90 con 0x7f73380cb980 2024-04-25T13:16:01.122 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733e53f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f733806d770 0x7f733815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.122 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733dd3e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f73381554d0 0x7f73380cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49588/0 (socket says 172.21.15.52:49588) 2024-04-25T13:16:01.122 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733dd3e640 1 -- 172.21.15.52:0/2190548368 learned_addr learned my addr 172.21.15.52:0/2190548368 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:01.122 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733d53d640 1 --2- 172.21.15.52:0/2190548368 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73380cb980 0x7f733806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.122 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733e53f640 1 -- 172.21.15.52:0/2190548368 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73380cb980 msgr2=0x7f733806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:01.122 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733e53f640 1 --2- 172.21.15.52:0/2190548368 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73380cb980 0x7f733806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.122 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733e53f640 1 -- 172.21.15.52:0/2190548368 >> v1:172.21.15.52:6789/0 conn(0x7f73381554d0 legacy=0x7f73380cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.122 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733cd3c640 1 -- 172.21.15.52:0/2190548368 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496194417 0 0) 0x7f733815e7d0 con 0x7f73381554d0 2024-04-25T13:16:01.122 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.121+0000 7f733e53f640 1 -- 172.21.15.52:0/2190548368 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733815f070 con 0x7f733806d770 2024-04-25T13:16:01.123 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.122+0000 7f733e53f640 1 --2- 172.21.15.52:0/2190548368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f733806d770 0x7f733815b490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7330009d90 tx=0x7f733002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db61491ab28b6453 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:01.123 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.122+0000 7f733cd3c640 1 -- 172.21.15.52:0/2190548368 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330007740 con 0x7f733806d770 2024-04-25T13:16:01.123 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.122+0000 7f733cd3c640 1 -- 172.21.15.52:0/2190548368 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73300078e0 con 0x7f733806d770 2024-04-25T13:16:01.124 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.122+0000 7f733cd3c640 1 -- 172.21.15.52:0/2190548368 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330007cb0 con 0x7f733806d770 2024-04-25T13:16:01.124 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.123+0000 7f733ffa2640 1 -- 172.21.15.52:0/2190548368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f733806d770 msgr2=0x7f733815b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.124 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.123+0000 7f733ffa2640 1 --2- 172.21.15.52:0/2190548368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f733806d770 0x7f733815b490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7330009d90 tx=0x7f733002a660 comp rx=0 tx=0).stop 2024-04-25T13:16:01.124 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.123+0000 7f733ffa2640 1 -- 172.21.15.52:0/2190548368 shutdown_connections 2024-04-25T13:16:01.124 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.123+0000 7f733ffa2640 1 --2- 172.21.15.52:0/2190548368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f733806d770 0x7f733815b490 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.124 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.123+0000 7f733ffa2640 1 --2- 172.21.15.52:0/2190548368 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73380cb980 0x7f733806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.124 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.123+0000 7f733ffa2640 1 -- 172.21.15.52:0/2190548368 >> 172.21.15.52:0/2190548368 conn(0x7f73380cd6d0 msgr2=0x7f73380cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:01.124 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.123+0000 7f733ffa2640 1 -- 172.21.15.52:0/2190548368 shutdown_connections 2024-04-25T13:16:01.124 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.123+0000 7f733ffa2640 1 -- 172.21.15.52:0/2190548368 wait complete. 2024-04-25T13:16:01.126 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.124+0000 7f733ffa2640 1 Processor -- start 2024-04-25T13:16:01.126 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.124+0000 7f733ffa2640 1 -- start start 2024-04-25T13:16:01.126 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733ffa2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f733806d770 0x7f733814f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.126 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733ffa2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73380cb980 0x7f73381492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733ffa2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73381554d0 0x7f7338149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733ffa2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f733815b9d0 con 0x7f73381554d0 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733ffa2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f73380b3b30 con 0x7f73380cb980 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733ffa2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f733815bb50 con 0x7f733806d770 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733e53f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73381554d0 0x7f7338149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733e53f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73381554d0 0x7f7338149800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38618/0 (socket says 172.21.15.52:38618) 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733e53f640 1 -- 172.21.15.52:0/2308084663 learned_addr learned my addr 172.21.15.52:0/2308084663 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733dd3e640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f733806d770 0x7f733814f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733d53d640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73380cb980 0x7f73381492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733e53f640 1 -- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f733806d770 msgr2=0x7f733814f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733e53f640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f733806d770 0x7f733814f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733e53f640 1 -- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73380cb980 msgr2=0x7f73381492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733e53f640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73380cb980 0x7f73381492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.127 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733e53f640 1 -- 172.21.15.52:0/2308084663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73381e5ee0 con 0x7f73381554d0 2024-04-25T13:16:01.128 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733d53d640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73380cb980 0x7f73381492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:01.128 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733e53f640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73381554d0 0x7f7338149800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7330009eb0 tx=0x7f7330004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:01.128 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f732e7fc640 1 -- 172.21.15.52:0/2308084663 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330040070 con 0x7f73381554d0 2024-04-25T13:16:01.128 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f732e7fc640 1 -- 172.21.15.52:0/2308084663 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7330031bc0 con 0x7f73381554d0 2024-04-25T13:16:01.128 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f733ffa2640 1 -- 172.21.15.52:0/2308084663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73381e50a0 con 0x7f73381554d0 2024-04-25T13:16:01.128 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.125+0000 7f732e7fc640 1 -- 172.21.15.52:0/2308084663 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330009450 con 0x7f73381554d0 2024-04-25T13:16:01.128 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.126+0000 7f733ffa2640 1 -- 172.21.15.52:0/2308084663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73381e5640 con 0x7f73381554d0 2024-04-25T13:16:01.128 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.126+0000 7f733ffa2640 1 -- 172.21.15.52:0/2308084663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73380cd2e0 con 0x7f73381554d0 2024-04-25T13:16:01.129 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.127+0000 7f732e7fc640 1 -- 172.21.15.52:0/2308084663 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7330039040 con 0x7f73381554d0 2024-04-25T13:16:01.129 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.127+0000 7f732e7fc640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f731c06c920 0x7f731c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.129 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.127+0000 7f732e7fc640 1 -- 172.21.15.52:0/2308084663 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f73300acf60 con 0x7f73381554d0 2024-04-25T13:16:01.129 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.128+0000 7f733dd3e640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f731c06c920 0x7f731c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.129 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.128+0000 7f733dd3e640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f731c06c920 0x7f731c06ede0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7334007fd0 tx=0x7f7334007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:01.132 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.132+0000 7f732e7fc640 1 -- 172.21.15.52:0/2308084663 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f73380cd2e0 con 0x7f73381554d0 2024-04-25T13:16:01.318 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.318+0000 7f733ffa2640 1 -- 172.21.15.52:0/2308084663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f733806e2f0 con 0x7f73381554d0 2024-04-25T13:16:01.319 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.319+0000 7f732e7fc640 1 -- 172.21.15.52:0/2308084663 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f733007b650 con 0x7f73381554d0 2024-04-25T13:16:01.319 INFO:teuthology.misc.health.smithi052.stdout: 2024-04-25T13:16:01.319 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":16,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:15:57.952696+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:01.322 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.321+0000 7f733ffa2640 1 -- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f731c06c920 msgr2=0x7f731c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.322 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.321+0000 7f733ffa2640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f731c06c920 0x7f731c06ede0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7334007fd0 tx=0x7f7334007de0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.322 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.321+0000 7f733ffa2640 1 -- 172.21.15.52:0/2308084663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73381554d0 msgr2=0x7f7338149800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.322 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.321+0000 7f733ffa2640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73381554d0 0x7f7338149800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7330009eb0 tx=0x7f7330004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:01.322 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.321+0000 7f733ffa2640 1 -- 172.21.15.52:0/2308084663 shutdown_connections 2024-04-25T13:16:01.322 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.321+0000 7f733ffa2640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f731c06c920 0x7f731c06ede0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.322 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.321+0000 7f733ffa2640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73381554d0 0x7f7338149800 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.322 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.321+0000 7f733ffa2640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73380cb980 0x7f73381492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.322 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.321+0000 7f733ffa2640 1 --2- 172.21.15.52:0/2308084663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f733806d770 0x7f733814f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.322 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.321+0000 7f733ffa2640 1 -- 172.21.15.52:0/2308084663 >> 172.21.15.52:0/2308084663 conn(0x7f73380cd6d0 msgr2=0x7f733814b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:01.322 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.321+0000 7f733ffa2640 1 -- 172.21.15.52:0/2308084663 shutdown_connections 2024-04-25T13:16:01.322 INFO:teuthology.misc.health.smithi052.stderr:2024-04-25T13:16:01.321+0000 7f733ffa2640 1 -- 172.21.15.52:0/2308084663 wait complete. 2024-04-25T13:16:01.331 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T13:16:01.331 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T13:16:01.331 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T13:16:01.332 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T13:16:01.334 INFO:tasks.ceph.mds.a:Started 2024-04-25T13:16:01.334 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T13:16:01.334 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T13:16:01.336 INFO:tasks.ceph.mds.c:Started 2024-04-25T13:16:01.336 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-25T13:16:01.336 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-25T13:16:01.338 INFO:tasks.ceph.mds.e:Started 2024-04-25T13:16:01.338 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T13:16:01.338 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T13:16:01.341 INFO:tasks.ceph.mds.b:Started 2024-04-25T13:16:01.341 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T13:16:01.341 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T13:16:01.344 INFO:tasks.ceph.mds.d:Started 2024-04-25T13:16:01.344 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-25T13:16:01.344 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-25T13:16:01.346 INFO:tasks.ceph.mds.f:Started 2024-04-25T13:16:01.347 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T13:16:01.347 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:01.412 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-04-25T13:16:01.412 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-04-25T13:16:01.415 INFO:tasks.ceph.mds.e.smithi052.stdout:starting mds.e at 2024-04-25T13:16:01.426 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-04-25T13:16:01.426 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-04-25T13:16:01.427 INFO:tasks.ceph.mds.f.smithi102.stdout:starting mds.f at 2024-04-25T13:16:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.456+0000 7f7c21f84640 1 Processor -- start 2024-04-25T13:16:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.456+0000 7f7c21f84640 1 -- start start 2024-04-25T13:16:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.457+0000 7f7c21f84640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c1c1554e0 0x7f7c1c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.457+0000 7f7c21f84640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7c1c0b3c00 0x7f7c1c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.457+0000 7f7c21f84640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c1c1558c0 con 0x7f7c1c0b5450 2024-04-25T13:16:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.457+0000 7f7c21f84640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7c1c0b4a80 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.457+0000 7f7c21f84640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7c1c15f630 con 0x7f7c1c1554e0 2024-04-25T13:16:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.457+0000 7f7c1b7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c1c1554e0 0x7f7c1c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.457+0000 7f7c1b7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c1c1554e0 0x7f7c1c15f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:48300/0 (socket says 172.21.15.52:48300) 2024-04-25T13:16:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.457+0000 7f7c1b7fe640 1 -- 172.21.15.52:0/4127614992 learned_addr learned my addr 172.21.15.52:0/4127614992 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.457+0000 7f7c1affd640 1 --2- 172.21.15.52:0/4127614992 >> v2:172.21.15.102:3300/0 conn(0x7f7c1c0b3c00 0x7f7c1c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.458+0000 7f7c1b7fe640 1 -- 172.21.15.52:0/4127614992 >> v2:172.21.15.102:3300/0 conn(0x7f7c1c0b3c00 msgr2=0x7f7c1c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.458+0000 7f7c1b7fe640 1 --2- 172.21.15.52:0/4127614992 >> v2:172.21.15.102:3300/0 conn(0x7f7c1c0b3c00 0x7f7c1c0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.458+0000 7f7c1b7fe640 1 -- 172.21.15.52:0/4127614992 >> v1:172.21.15.102:6789/0 conn(0x7f7c1c0b5450 legacy=0x7f7c1c0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.458+0000 7f7c1b7fe640 1 -- 172.21.15.52:0/4127614992 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1c0cb8c0 con 0x7f7c1c1554e0 2024-04-25T13:16:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.458+0000 7f7c1b7fe640 1 --2- 172.21.15.52:0/4127614992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c1c1554e0 0x7f7c1c15f0f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009870 tx=0x7f7c0c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d469ac66f9c7f525 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.458+0000 7f7c1a7fc640 1 -- 172.21.15.52:0/4127614992 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c037070 con 0x7f7c1c1554e0 2024-04-25T13:16:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.458+0000 7f7c1a7fc640 1 -- 172.21.15.52:0/4127614992 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0c02ae50 con 0x7f7c1c1554e0 2024-04-25T13:16:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.459+0000 7f7c1a7fc640 1 -- 172.21.15.52:0/4127614992 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c037070 con 0x7f7c1c1554e0 2024-04-25T13:16:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.459+0000 7f7c21f84640 1 -- 172.21.15.52:0/4127614992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c1c1554e0 msgr2=0x7f7c1c15f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.459+0000 7f7c21f84640 1 --2- 172.21.15.52:0/4127614992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c1c1554e0 0x7f7c1c15f0f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009870 tx=0x7f7c0c02a300 comp rx=0 tx=0).stop 2024-04-25T13:16:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.459+0000 7f7c21f84640 1 -- 172.21.15.52:0/4127614992 shutdown_connections 2024-04-25T13:16:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.459+0000 7f7c21f84640 1 --2- 172.21.15.52:0/4127614992 >> v2:172.21.15.102:3300/0 conn(0x7f7c1c0b3c00 0x7f7c1c0b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.459+0000 7f7c21f84640 1 --2- 172.21.15.52:0/4127614992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c1c1554e0 0x7f7c1c15f0f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.459+0000 7f7c21f84640 1 -- 172.21.15.52:0/4127614992 >> 172.21.15.52:0/4127614992 conn(0x7f7c1c074d50 msgr2=0x7f7c1c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.459+0000 7f7c21f84640 1 -- 172.21.15.52:0/4127614992 shutdown_connections 2024-04-25T13:16:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.459+0000 7f7c21f84640 1 -- 172.21.15.52:0/4127614992 wait complete. 2024-04-25T13:16:01.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.460+0000 7f7c21f84640 1 Processor -- start 2024-04-25T13:16:01.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.460+0000 7f7c21f84640 1 -- start start 2024-04-25T13:16:01.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.461+0000 7f7c21f84640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c1c0b3c00 0x7f7c1c1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.461+0000 7f7c21f84640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c1c0b5450 0x7f7c1c14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.461+0000 7f7c21f84640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c1c15c160 0x7f7c1c15e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.461+0000 7f7c21f84640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c0b4430 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.461+0000 7f7c21f84640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c0b4150 con 0x7f7c1c0b5450 2024-04-25T13:16:01.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.461+0000 7f7c21f84640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7c1c0b4710 con 0x7f7c1c15c160 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.461+0000 7f7c1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c1c0b3c00 0x7f7c1c1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.461+0000 7f7c1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c1c0b3c00 0x7f7c1c1509c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38666/0 (socket says 172.21.15.52:38666) 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.461+0000 7f7c1b7fe640 1 -- 172.21.15.52:0/2138219644 learned_addr learned my addr 172.21.15.52:0/2138219644 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.461+0000 7f7c1affd640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c1c0b5450 0x7f7c1c14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.461+0000 7f7c1bfff640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c1c15c160 0x7f7c1c15e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.462+0000 7f7c1b7fe640 1 -- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c1c15c160 msgr2=0x7f7c1c15e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.462+0000 7f7c1b7fe640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c1c15c160 0x7f7c1c15e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.462+0000 7f7c1b7fe640 1 -- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c1c0b5450 msgr2=0x7f7c1c14e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.462+0000 7f7c1b7fe640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c1c0b5450 0x7f7c1c14e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.462+0000 7f7c1b7fe640 1 -- 172.21.15.52:0/2138219644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1c15db80 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.462+0000 7f7c1affd640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c1c0b5450 0x7f7c1c14e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.462+0000 7f7c1b7fe640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c1c0b3c00 0x7f7c1c1509c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c000c00 tx=0x7f7c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.462+0000 7f7c03fff640 1 -- 172.21.15.52:0/2138219644 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c042020 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.462+0000 7f7c21f84640 1 -- 172.21.15.52:0/2138219644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1c14ec40 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.462+0000 7f7c03fff640 1 -- 172.21.15.52:0/2138219644 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0c0306d0 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.462+0000 7f7c21f84640 1 -- 172.21.15.52:0/2138219644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c1c14eee0 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.462+0000 7f7c03fff640 1 -- 172.21.15.52:0/2138219644 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c037070 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.463+0000 7f7c21f84640 1 -- 172.21.15.52:0/2138219644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c1c068e40 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.463+0000 7f7c03fff640 1 -- 172.21.15.52:0/2138219644 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c0c045020 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.464+0000 7f7c03fff640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7c0806cb20 0x7f7c0806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.464+0000 7f7c03fff640 1 -- 172.21.15.52:0/2138219644 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7c0c030880 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.464+0000 7f7c1affd640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7c0806cb20 0x7f7c0806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.465+0000 7f7c1affd640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7c0806cb20 0x7f7c0806efe0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0c9f00 tx=0x7f7c10009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:01.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.469+0000 7f7c03fff640 1 -- 172.21.15.52:0/2138219644 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c0c0794b0 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.655+0000 7f7c21f84640 1 -- 172.21.15.52:0/2138219644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c1c150f90 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.656+0000 7f7c03fff640 1 -- 172.21.15.52:0/2138219644 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f7c0c07d7b0 con 0x7f7c1c0b3c00 2024-04-25T13:16:01.656 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:01.656 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":16,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:15:57.952696+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:01.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.658+0000 7f7c21f84640 1 -- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7c0806cb20 msgr2=0x7f7c0806efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.658+0000 7f7c21f84640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7c0806cb20 0x7f7c0806efe0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0c9f00 tx=0x7f7c10009190 comp rx=0 tx=0).stop 2024-04-25T13:16:01.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.658+0000 7f7c21f84640 1 -- 172.21.15.52:0/2138219644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c1c0b3c00 msgr2=0x7f7c1c1509c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.658+0000 7f7c21f84640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c1c0b3c00 0x7f7c1c1509c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c000c00 tx=0x7f7c0c0046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.658+0000 7f7c21f84640 1 -- 172.21.15.52:0/2138219644 shutdown_connections 2024-04-25T13:16:01.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.658+0000 7f7c21f84640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7c0806cb20 0x7f7c0806efe0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.658+0000 7f7c21f84640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c1c15c160 0x7f7c1c15e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.658+0000 7f7c21f84640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c1c0b5450 0x7f7c1c14e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.658+0000 7f7c21f84640 1 --2- 172.21.15.52:0/2138219644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c1c0b3c00 0x7f7c1c1509c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.658+0000 7f7c21f84640 1 -- 172.21.15.52:0/2138219644 >> 172.21.15.52:0/2138219644 conn(0x7f7c1c074d50 msgr2=0x7f7c1c0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:01.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.658+0000 7f7c21f84640 1 -- 172.21.15.52:0/2138219644 shutdown_connections 2024-04-25T13:16:01.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.658+0000 7f7c21f84640 1 -- 172.21.15.52:0/2138219644 wait complete. 2024-04-25T13:16:01.669 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.833544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:16:01.669 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:01.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.772+0000 7f16cea60640 1 Processor -- start 2024-04-25T13:16:01.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.772+0000 7f16cea60640 1 -- start start 2024-04-25T13:16:01.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16cea60640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f16c81553c0 0x7f16c815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16cea60640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f16c815f310 0x7f16c80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16cea60640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c80c5c80 con 0x7f16c815b070 2024-04-25T13:16:01.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16cea60640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f16c815e660 con 0x7f16c81553c0 2024-04-25T13:16:01.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16cea60640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f16c81557a0 con 0x7f16c815f310 2024-04-25T13:16:01.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16c7fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f16c81553c0 0x7f16c815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16ccffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f16c815b070 0x7f16c80d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49606/0 (socket says 172.21.15.52:49606) 2024-04-25T13:16:01.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16ccffd640 1 -- 172.21.15.52:0/3728263143 learned_addr learned my addr 172.21.15.52:0/3728263143 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:01.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16c77fe640 1 --2- 172.21.15.52:0/3728263143 >> v2:172.21.15.102:3300/0 conn(0x7f16c815f310 0x7f16c80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16c7fff640 1 -- 172.21.15.52:0/3728263143 >> v2:172.21.15.102:3300/0 conn(0x7f16c815f310 msgr2=0x7f16c80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:01.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16c7fff640 1 --2- 172.21.15.52:0/3728263143 >> v2:172.21.15.102:3300/0 conn(0x7f16c815f310 0x7f16c80cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16c7fff640 1 -- 172.21.15.52:0/3728263143 >> v1:172.21.15.52:6789/0 conn(0x7f16c815b070 legacy=0x7f16c80d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16c7fff640 1 -- 172.21.15.52:0/3728263143 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c815b5d0 con 0x7f16c81553c0 2024-04-25T13:16:01.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.773+0000 7f16c77fe640 1 --2- 172.21.15.52:0/3728263143 >> v2:172.21.15.102:3300/0 conn(0x7f16c815f310 0x7f16c80cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:01.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.774+0000 7f16c7fff640 1 --2- 172.21.15.52:0/3728263143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16c81553c0 0x7f16c815edd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f16c808ea60 tx=0x7f16b802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c18710780e8d752 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:01.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.774+0000 7f16c6ffd640 1 -- 172.21.15.52:0/3728263143 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8037070 con 0x7f16c81553c0 2024-04-25T13:16:01.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.774+0000 7f16c6ffd640 1 -- 172.21.15.52:0/3728263143 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b8032440 con 0x7f16c81553c0 2024-04-25T13:16:01.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.774+0000 7f16c6ffd640 1 -- 172.21.15.52:0/3728263143 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8032810 con 0x7f16c81553c0 2024-04-25T13:16:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.774+0000 7f16cea60640 1 -- 172.21.15.52:0/3728263143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16c81553c0 msgr2=0x7f16c815edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.774+0000 7f16cea60640 1 --2- 172.21.15.52:0/3728263143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16c81553c0 0x7f16c815edd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f16c808ea60 tx=0x7f16b802a1a0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.774+0000 7f16cea60640 1 -- 172.21.15.52:0/3728263143 shutdown_connections 2024-04-25T13:16:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.774+0000 7f16cea60640 1 --2- 172.21.15.52:0/3728263143 >> v2:172.21.15.102:3300/0 conn(0x7f16c815f310 0x7f16c80cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.774+0000 7f16cea60640 1 --2- 172.21.15.52:0/3728263143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16c81553c0 0x7f16c815edd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.775+0000 7f16cea60640 1 -- 172.21.15.52:0/3728263143 >> 172.21.15.52:0/3728263143 conn(0x7f16c8072360 msgr2=0x7f16c8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.775+0000 7f16cea60640 1 -- 172.21.15.52:0/3728263143 shutdown_connections 2024-04-25T13:16:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.775+0000 7f16cea60640 1 -- 172.21.15.52:0/3728263143 wait complete. 2024-04-25T13:16:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.776+0000 7f16cea60640 1 Processor -- start 2024-04-25T13:16:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.776+0000 7f16cea60640 1 -- start start 2024-04-25T13:16:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.776+0000 7f16cea60640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c81553c0 0x7f16c814d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.776+0000 7f16cea60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16c815b070 0x7f16c81e6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.776+0000 7f16cea60640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c815f310 0x7f16c81e6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.776+0000 7f16cea60640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f16c815be70 con 0x7f16c815b070 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.776+0000 7f16cea60640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f16c815bb90 con 0x7f16c81553c0 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.776+0000 7f16cea60640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f16c815e8b0 con 0x7f16c815f310 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16c815b070 0x7f16c81e6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16c815b070 0x7f16c81e6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38688/0 (socket says 172.21.15.52:38688) 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c77fe640 1 -- 172.21.15.52:0/273946497 learned_addr learned my addr 172.21.15.52:0/273946497 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c7fff640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c81553c0 0x7f16c814d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16ccffd640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c815f310 0x7f16c81e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c77fe640 1 -- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c815f310 msgr2=0x7f16c81e6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c77fe640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c815f310 0x7f16c81e6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c77fe640 1 -- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c81553c0 msgr2=0x7f16c814d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c77fe640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c81553c0 0x7f16c814d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c77fe640 1 -- 172.21.15.52:0/273946497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c81f0e90 con 0x7f16c815b070 2024-04-25T13:16:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c7fff640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c81553c0 0x7f16c814d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c77fe640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16c815b070 0x7f16c81e6120 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00c7f0 tx=0x7f16bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c4ff9640 1 -- 172.21.15.52:0/273946497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc004220 con 0x7f16c815b070 2024-04-25T13:16:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c4ff9640 1 -- 172.21.15.52:0/273946497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc0043c0 con 0x7f16c815b070 2024-04-25T13:16:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16cea60640 1 -- 172.21.15.52:0/273946497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c81f1150 con 0x7f16c815b070 2024-04-25T13:16:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16c4ff9640 1 -- 172.21.15.52:0/273946497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc005bb0 con 0x7f16c815b070 2024-04-25T13:16:01.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.777+0000 7f16cea60640 1 -- 172.21.15.52:0/273946497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c81f1710 con 0x7f16c815b070 2024-04-25T13:16:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.778+0000 7f16cea60640 1 -- 172.21.15.52:0/273946497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c80b6180 con 0x7f16c815b070 2024-04-25T13:16:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.779+0000 7f16c4ff9640 1 -- 172.21.15.52:0/273946497 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f16bc006030 con 0x7f16c815b070 2024-04-25T13:16:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.779+0000 7f16c4ff9640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f16b406c8f0 0x7f16b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.779+0000 7f16c4ff9640 1 -- 172.21.15.52:0/273946497 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f16bc08bdd0 con 0x7f16c815b070 2024-04-25T13:16:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.779+0000 7f16c7fff640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f16b406c8f0 0x7f16b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.780+0000 7f16c7fff640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f16b406c8f0 0x7f16b406edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16b8034000 tx=0x7f16b802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.784+0000 7f16c4ff9640 1 -- 172.21.15.52:0/273946497 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f16bc01e020 con 0x7f16c815b070 2024-04-25T13:16:01.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.967+0000 7f16cea60640 1 -- 172.21.15.52:0/273946497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f16c80cc520 con 0x7f16c815b070 2024-04-25T13:16:01.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.967+0000 7f16c4ff9640 1 -- 172.21.15.52:0/273946497 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f16bc08d0a0 con 0x7f16c815b070 2024-04-25T13:16:01.968 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T13:16:01.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.969+0000 7f16cea60640 1 -- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f16b406c8f0 msgr2=0x7f16b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.969+0000 7f16cea60640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f16b406c8f0 0x7f16b406edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16b8034000 tx=0x7f16b802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:01.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.969+0000 7f16cea60640 1 -- 172.21.15.52:0/273946497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16c815b070 msgr2=0x7f16c81e6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:01.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.969+0000 7f16cea60640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16c815b070 0x7f16c81e6120 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00c7f0 tx=0x7f16bc00ccb0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.969+0000 7f16cea60640 1 -- 172.21.15.52:0/273946497 shutdown_connections 2024-04-25T13:16:01.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.969+0000 7f16cea60640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f16b406c8f0 0x7f16b406edb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.969+0000 7f16cea60640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f16c815f310 0x7f16c81e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.969+0000 7f16cea60640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16c815b070 0x7f16c81e6120 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.969+0000 7f16cea60640 1 --2- 172.21.15.52:0/273946497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16c81553c0 0x7f16c814d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:01.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.969+0000 7f16cea60640 1 -- 172.21.15.52:0/273946497 >> 172.21.15.52:0/273946497 conn(0x7f16c8072360 msgr2=0x7f16c8073850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:01.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.969+0000 7f16cea60640 1 -- 172.21.15.52:0/273946497 shutdown_connections 2024-04-25T13:16:01.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:01.969+0000 7f16cea60640 1 -- 172.21.15.52:0/273946497 wait complete. 2024-04-25T13:16:01.980 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:02.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.080+0000 7efcb0d44640 1 Processor -- start 2024-04-25T13:16:02.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.080+0000 7efcb0d44640 1 -- start start 2024-04-25T13:16:02.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.081+0000 7efcb0d44640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efcac152f10 0x7efcac0cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.081+0000 7efcb0d44640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efcac0c9a70 0x7efcac0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.081+0000 7efcb0d44640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcac158e20 con 0x7efcac0c9ff0 2024-04-25T13:16:02.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.081+0000 7efcb0d44640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7efcac0c56e0 con 0x7efcac152f10 2024-04-25T13:16:02.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.081+0000 7efcb0d44640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efcac1599b0 con 0x7efcac0c9a70 2024-04-25T13:16:02.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.081+0000 7efcaa59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efcac152f10 0x7efcac0cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.082+0000 7efcaad9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efcac0c9ff0 0x7efcac0c6ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49616/0 (socket says 172.21.15.52:49616) 2024-04-25T13:16:02.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.082+0000 7efcaad9d640 1 -- 172.21.15.52:0/1807303388 learned_addr learned my addr 172.21.15.52:0/1807303388 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:02.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.082+0000 7efca9d9b640 1 --2- 172.21.15.52:0/1807303388 >> v2:172.21.15.102:3300/0 conn(0x7efcac0c9a70 0x7efcac0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.082+0000 7efcaa59c640 1 -- 172.21.15.52:0/1807303388 >> v2:172.21.15.102:3300/0 conn(0x7efcac0c9a70 msgr2=0x7efcac0cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.082+0000 7efcaa59c640 1 --2- 172.21.15.52:0/1807303388 >> v2:172.21.15.102:3300/0 conn(0x7efcac0c9a70 0x7efcac0cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.082+0000 7efcaa59c640 1 -- 172.21.15.52:0/1807303388 >> v1:172.21.15.52:6789/0 conn(0x7efcac0c9ff0 legacy=0x7efcac0c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.082+0000 7efcaa59c640 1 -- 172.21.15.52:0/1807303388 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac1590c0 con 0x7efcac152f10 2024-04-25T13:16:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.082+0000 7efcaa59c640 1 --2- 172.21.15.52:0/1807303388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac152f10 0x7efcac0cd960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efcac159b30 tx=0x7efca402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a625584f22feab73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.083+0000 7efca959a640 1 -- 172.21.15.52:0/1807303388 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4037070 con 0x7efcac152f10 2024-04-25T13:16:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.083+0000 7efca959a640 1 -- 172.21.15.52:0/1807303388 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca4032440 con 0x7efcac152f10 2024-04-25T13:16:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.083+0000 7efca959a640 1 -- 172.21.15.52:0/1807303388 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4032810 con 0x7efcac152f10 2024-04-25T13:16:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.083+0000 7efcb0d44640 1 -- 172.21.15.52:0/1807303388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac152f10 msgr2=0x7efcac0cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.083+0000 7efcb0d44640 1 --2- 172.21.15.52:0/1807303388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac152f10 0x7efcac0cd960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efcac159b30 tx=0x7efca402a1a0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.083+0000 7efcb0d44640 1 -- 172.21.15.52:0/1807303388 shutdown_connections 2024-04-25T13:16:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.083+0000 7efcb0d44640 1 --2- 172.21.15.52:0/1807303388 >> v2:172.21.15.102:3300/0 conn(0x7efcac0c9a70 0x7efcac0cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.083+0000 7efcb0d44640 1 --2- 172.21.15.52:0/1807303388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac152f10 0x7efcac0cd960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.083+0000 7efcb0d44640 1 -- 172.21.15.52:0/1807303388 >> 172.21.15.52:0/1807303388 conn(0x7efcac06b920 msgr2=0x7efcac06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:02.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.083+0000 7efcb0d44640 1 -- 172.21.15.52:0/1807303388 shutdown_connections 2024-04-25T13:16:02.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.083+0000 7efcb0d44640 1 -- 172.21.15.52:0/1807303388 wait complete. 2024-04-25T13:16:02.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.085+0000 7efcb0d44640 1 Processor -- start 2024-04-25T13:16:02.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.085+0000 7efcb0d44640 1 -- start start 2024-04-25T13:16:02.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.085+0000 7efcb0d44640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcac0c9a70 0x7efcac15cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.085+0000 7efcb0d44640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efcac0c9ff0 0x7efcac1eef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.085+0000 7efcb0d44640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac152f10 0x7efcac146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.085+0000 7efcb0d44640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efcac159640 con 0x7efcac152f10 2024-04-25T13:16:02.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.085+0000 7efcb0d44640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efcac159360 con 0x7efcac0c9a70 2024-04-25T13:16:02.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.085+0000 7efcb0d44640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efcac1532f0 con 0x7efcac0c9ff0 2024-04-25T13:16:02.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.085+0000 7efcaad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac152f10 0x7efcac146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.085+0000 7efcaad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac152f10 0x7efcac146f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38712/0 (socket says 172.21.15.52:38712) 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.085+0000 7efcaad9d640 1 -- 172.21.15.52:0/2754586948 learned_addr learned my addr 172.21.15.52:0/2754586948 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efca9d9b640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efcac0c9ff0 0x7efcac1eef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efcaa59c640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcac0c9a70 0x7efcac15cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efcaad9d640 1 -- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efcac0c9ff0 msgr2=0x7efcac1eef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efcaad9d640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efcac0c9ff0 0x7efcac1eef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efcaad9d640 1 -- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcac0c9a70 msgr2=0x7efcac15cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efcaad9d640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcac0c9a70 0x7efcac15cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efcaad9d640 1 -- 172.21.15.52:0/2754586948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac1478b0 con 0x7efcac152f10 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efcaad9d640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac152f10 0x7efcac146f30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00cbf0 tx=0x7efc9c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efc9affd640 1 -- 172.21.15.52:0/2754586948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c017070 con 0x7efcac152f10 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efc9affd640 1 -- 172.21.15.52:0/2754586948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9c00ace0 con 0x7efcac152f10 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efcb0d44640 1 -- 172.21.15.52:0/2754586948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcac1f2a80 con 0x7efcac152f10 2024-04-25T13:16:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efc9affd640 1 -- 172.21.15.52:0/2754586948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c012600 con 0x7efcac152f10 2024-04-25T13:16:02.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.086+0000 7efcb0d44640 1 -- 172.21.15.52:0/2754586948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcac1ee7b0 con 0x7efcac152f10 2024-04-25T13:16:02.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.088+0000 7efcb0d44640 1 -- 172.21.15.52:0/2754586948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcac068e40 con 0x7efcac152f10 2024-04-25T13:16:02.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.088+0000 7efc9affd640 1 -- 172.21.15.52:0/2754586948 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc9c01a070 con 0x7efcac152f10 2024-04-25T13:16:02.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.089+0000 7efc9affd640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efc8c06c8f0 0x7efc8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:02.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.089+0000 7efc9affd640 1 -- 172.21.15.52:0/2754586948 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7efc9c08b4e0 con 0x7efcac152f10 2024-04-25T13:16:02.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.089+0000 7efcaa59c640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efc8c06c8f0 0x7efc8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:02.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.089+0000 7efcaa59c640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efc8c06c8f0 0x7efc8c06edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efca4034000 tx=0x7efca402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:02.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.093+0000 7efc9affd640 1 -- 172.21.15.52:0/2754586948 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efcac1478b0 con 0x7efcac152f10 2024-04-25T13:16:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.318+0000 7efcb0d44640 1 -- 172.21.15.52:0/2754586948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcac14cf90 con 0x7efcac152f10 2024-04-25T13:16:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.318+0000 7efc9affd640 1 -- 172.21.15.52:0/2754586948 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7efc9c059580 con 0x7efcac152f10 2024-04-25T13:16:02.319 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:02.319 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3228537118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3228537118},{"type":"v1","addr":"172.21.15.52:6834","nonce":3228537118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T13:16:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 2 2024-04-25T13:16:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.320+0000 7efcb0d44640 1 -- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efc8c06c8f0 msgr2=0x7efc8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.320+0000 7efcb0d44640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efc8c06c8f0 0x7efc8c06edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efca4034000 tx=0x7efca402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.320+0000 7efcb0d44640 1 -- 172.21.15.52:0/2754586948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac152f10 msgr2=0x7efcac146f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.320+0000 7efcb0d44640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac152f10 0x7efcac146f30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00cbf0 tx=0x7efc9c00a430 comp rx=0 tx=0).stop 2024-04-25T13:16:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.320+0000 7efcb0d44640 1 -- 172.21.15.52:0/2754586948 shutdown_connections 2024-04-25T13:16:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.320+0000 7efcb0d44640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efc8c06c8f0 0x7efc8c06edb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.320+0000 7efcb0d44640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efcac0c9ff0 0x7efcac1eef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.320+0000 7efcb0d44640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac152f10 0x7efcac146f30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.320+0000 7efcb0d44640 1 --2- 172.21.15.52:0/2754586948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcac0c9a70 0x7efcac15cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.320+0000 7efcb0d44640 1 -- 172.21.15.52:0/2754586948 >> 172.21.15.52:0/2754586948 conn(0x7efcac06b920 msgr2=0x7efcac0c86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.320+0000 7efcb0d44640 1 -- 172.21.15.52:0/2754586948 shutdown_connections 2024-04-25T13:16:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:02.320+0000 7efcb0d44640 1 -- 172.21.15.52:0/2754586948 wait complete. 2024-04-25T13:16:04.332 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:04.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.446+0000 7ff135dbf640 1 Processor -- start 2024-04-25T13:16:04.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.446+0000 7ff135dbf640 1 -- start start 2024-04-25T13:16:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff135dbf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1300b3c00 0x7ff1300b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff135dbf640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff1300b5450 0x7ff1300d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff135dbf640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1301558c0 con 0x7ff1301554e0 2024-04-25T13:16:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff135dbf640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff1300b4a80 con 0x7ff1300b3c00 2024-04-25T13:16:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff135dbf640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff1300cb8c0 con 0x7ff1300b5450 2024-04-25T13:16:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff12effd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1300b3c00 0x7ff1300b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff12effd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1300b3c00 0x7ff1300b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38726/0 (socket says 172.21.15.52:38726) 2024-04-25T13:16:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff12effd640 1 -- 172.21.15.52:0/1687048695 learned_addr learned my addr 172.21.15.52:0/1687048695 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff12ffff640 1 --2- 172.21.15.52:0/1687048695 >> v2:172.21.15.102:3300/0 conn(0x7ff1300b5450 0x7ff1300d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff12effd640 1 -- 172.21.15.52:0/1687048695 >> v2:172.21.15.102:3300/0 conn(0x7ff1300b5450 msgr2=0x7ff1300d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff12effd640 1 --2- 172.21.15.52:0/1687048695 >> v2:172.21.15.102:3300/0 conn(0x7ff1300b5450 0x7ff1300d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff12effd640 1 -- 172.21.15.52:0/1687048695 >> v1:172.21.15.102:6789/0 conn(0x7ff1301554e0 legacy=0x7ff13015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.447+0000 7ff12effd640 1 -- 172.21.15.52:0/1687048695 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1300cbba0 con 0x7ff1300b3c00 2024-04-25T13:16:04.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.448+0000 7ff12effd640 1 --2- 172.21.15.52:0/1687048695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1300b3c00 0x7ff1300b4f10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1300ce7e0 tx=0x7ff12402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c3ee500d98384a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:04.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.448+0000 7ff12e7fc640 1 -- 172.21.15.52:0/1687048695 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124037070 con 0x7ff1300b3c00 2024-04-25T13:16:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.448+0000 7ff12e7fc640 1 -- 172.21.15.52:0/1687048695 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12402ae50 con 0x7ff1300b3c00 2024-04-25T13:16:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.448+0000 7ff12e7fc640 1 -- 172.21.15.52:0/1687048695 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124032860 con 0x7ff1300b3c00 2024-04-25T13:16:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.449+0000 7ff135dbf640 1 -- 172.21.15.52:0/1687048695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1300b3c00 msgr2=0x7ff1300b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.449+0000 7ff135dbf640 1 --2- 172.21.15.52:0/1687048695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1300b3c00 0x7ff1300b4f10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1300ce7e0 tx=0x7ff12402a300 comp rx=0 tx=0).stop 2024-04-25T13:16:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.449+0000 7ff135dbf640 1 -- 172.21.15.52:0/1687048695 shutdown_connections 2024-04-25T13:16:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.449+0000 7ff135dbf640 1 --2- 172.21.15.52:0/1687048695 >> v2:172.21.15.102:3300/0 conn(0x7ff1300b5450 0x7ff1300d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.449+0000 7ff135dbf640 1 --2- 172.21.15.52:0/1687048695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1300b3c00 0x7ff1300b4f10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.449+0000 7ff135dbf640 1 -- 172.21.15.52:0/1687048695 >> 172.21.15.52:0/1687048695 conn(0x7ff130074d50 msgr2=0x7ff130075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.449+0000 7ff135dbf640 1 -- 172.21.15.52:0/1687048695 shutdown_connections 2024-04-25T13:16:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.449+0000 7ff135dbf640 1 -- 172.21.15.52:0/1687048695 wait complete. 2024-04-25T13:16:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.450+0000 7ff135dbf640 1 Processor -- start 2024-04-25T13:16:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.450+0000 7ff135dbf640 1 -- start start 2024-04-25T13:16:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff135dbf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1300b3c00 0x7ff1300ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff135dbf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1300b5450 0x7ff13014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff135dbf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1301554e0 0x7ff13014c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff135dbf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff1300b4710 con 0x7ff1300b3c00 2024-04-25T13:16:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff135dbf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff1300b4430 con 0x7ff1301554e0 2024-04-25T13:16:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff135dbf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff1300b3580 con 0x7ff1300b5450 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff12f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1300b3c00 0x7ff1300ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff12f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1300b3c00 0x7ff1300ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38730/0 (socket says 172.21.15.52:38730) 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff12f7fe640 1 -- 172.21.15.52:0/355861300 learned_addr learned my addr 172.21.15.52:0/355861300 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff12ffff640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1301554e0 0x7ff13014c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff12effd640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1300b5450 0x7ff13014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff12f7fe640 1 -- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1300b5450 msgr2=0x7ff13014c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff12f7fe640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1300b5450 0x7ff13014c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff12f7fe640 1 -- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1301554e0 msgr2=0x7ff13014c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff12f7fe640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1301554e0 0x7ff13014c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.451+0000 7ff12f7fe640 1 -- 172.21.15.52:0/355861300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13015c3e0 con 0x7ff1300b3c00 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.452+0000 7ff12f7fe640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1300b3c00 0x7ff1300ca3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c400 tx=0x7ff12000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.452+0000 7ff117fff640 1 -- 172.21.15.52:0/355861300 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1200052d0 con 0x7ff1300b3c00 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.452+0000 7ff117fff640 1 -- 172.21.15.52:0/355861300 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff120005490 con 0x7ff1300b3c00 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.452+0000 7ff117fff640 1 -- 172.21.15.52:0/355861300 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120007260 con 0x7ff1300b3c00 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.452+0000 7ff135dbf640 1 -- 172.21.15.52:0/355861300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13015c6c0 con 0x7ff1300b3c00 2024-04-25T13:16:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.452+0000 7ff135dbf640 1 -- 172.21.15.52:0/355861300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff13015cc80 con 0x7ff1300b3c00 2024-04-25T13:16:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.453+0000 7ff135dbf640 1 -- 172.21.15.52:0/355861300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff130073570 con 0x7ff1300b3c00 2024-04-25T13:16:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.454+0000 7ff117fff640 1 -- 172.21.15.52:0/355861300 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff120007400 con 0x7ff1300b3c00 2024-04-25T13:16:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.454+0000 7ff117fff640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff11c06c8f0 0x7ff11c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.454+0000 7ff117fff640 1 -- 172.21.15.52:0/355861300 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff12008ace0 con 0x7ff1300b3c00 2024-04-25T13:16:04.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.454+0000 7ff12effd640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff11c06c8f0 0x7ff11c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:04.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.455+0000 7ff12effd640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff11c06c8f0 0x7ff11c06edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff124034000 tx=0x7ff12402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:04.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.459+0000 7ff117fff640 1 -- 172.21.15.52:0/355861300 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff130073570 con 0x7ff1300b3c00 2024-04-25T13:16:04.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.682+0000 7ff135dbf640 1 -- 172.21.15.52:0/355861300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff130068e40 con 0x7ff1300b3c00 2024-04-25T13:16:04.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.682+0000 7ff117fff640 1 -- 172.21.15.52:0/355861300 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5515 (secure 0 0 0) 0x7ff1301558c0 con 0x7ff1300b3c00 2024-04-25T13:16:04.683 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:04.683 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2650846419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2650846419},{"type":"v1","addr":"172.21.15.102:6837","nonce":2650846419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6838/1508646651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":1508646651},{"type":"v1","addr":"172.21.15.102:6838","nonce":1508646651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/1980846137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1980846137},{"type":"v1","addr":"172.21.15.102:6839","nonce":1980846137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/714334205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":714334205},{"type":"v1","addr":"172.21.15.52:6835","nonce":714334205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3228537118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3228537118},{"type":"v1","addr":"172.21.15.52:6834","nonce":3228537118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4290,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/413759311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":413759311},{"type":"v1","addr":"172.21.15.52:6837","nonce":413759311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T13:16:04.683 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 3 2024-04-25T13:16:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.684+0000 7ff135dbf640 1 -- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff11c06c8f0 msgr2=0x7ff11c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.684+0000 7ff135dbf640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff11c06c8f0 0x7ff11c06edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff124034000 tx=0x7ff12402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.684+0000 7ff135dbf640 1 -- 172.21.15.52:0/355861300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1300b3c00 msgr2=0x7ff1300ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.684+0000 7ff135dbf640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1300b3c00 0x7ff1300ca3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c400 tx=0x7ff12000c8c0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.684+0000 7ff135dbf640 1 -- 172.21.15.52:0/355861300 shutdown_connections 2024-04-25T13:16:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.684+0000 7ff135dbf640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff11c06c8f0 0x7ff11c06edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.684+0000 7ff135dbf640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1300b5450 0x7ff13014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.684+0000 7ff135dbf640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1301554e0 0x7ff13014c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.684+0000 7ff135dbf640 1 --2- 172.21.15.52:0/355861300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1300b3c00 0x7ff1300ca3f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.684+0000 7ff135dbf640 1 -- 172.21.15.52:0/355861300 >> 172.21.15.52:0/355861300 conn(0x7ff130074d50 msgr2=0x7ff130072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.685+0000 7ff135dbf640 1 -- 172.21.15.52:0/355861300 shutdown_connections 2024-04-25T13:16:04.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.685+0000 7ff135dbf640 1 -- 172.21.15.52:0/355861300 wait complete. 2024-04-25T13:16:04.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:04.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.796+0000 7f8cccf29640 1 Processor -- start 2024-04-25T13:16:04.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.796+0000 7f8cccf29640 1 -- start start 2024-04-25T13:16:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cccf29640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8cc81554e0 0x7f8cc815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cccf29640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8cc80d08a0 0x7f8cc80d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cccf29640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cc81558c0 con 0x7f8cc80b3c00 2024-04-25T13:16:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cccf29640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8cc80b4a80 con 0x7f8cc80d08a0 2024-04-25T13:16:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cccf29640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8cc815f630 con 0x7f8cc81554e0 2024-04-25T13:16:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cc6d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8cc80d08a0 0x7f8cc80d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cbffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8cc80b3c00 0x7f8cc80b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49628/0 (socket says 172.21.15.52:49628) 2024-04-25T13:16:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cbffff640 1 -- 172.21.15.52:0/1251784844 learned_addr learned my addr 172.21.15.52:0/1251784844 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cc659c640 1 --2- 172.21.15.52:0/1251784844 >> v2:172.21.15.102:3300/0 conn(0x7f8cc81554e0 0x7f8cc815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cc6d9d640 1 -- 172.21.15.52:0/1251784844 >> v2:172.21.15.102:3300/0 conn(0x7f8cc81554e0 msgr2=0x7f8cc815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cc6d9d640 1 --2- 172.21.15.52:0/1251784844 >> v2:172.21.15.102:3300/0 conn(0x7f8cc81554e0 0x7f8cc815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cc6d9d640 1 -- 172.21.15.52:0/1251784844 >> v1:172.21.15.52:6789/0 conn(0x7f8cc80b3c00 legacy=0x7f8cc80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cc6d9d640 1 -- 172.21.15.52:0/1251784844 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc80cb8c0 con 0x7f8cc80d08a0 2024-04-25T13:16:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cc5d9b640 1 -- 172.21.15.52:0/1251784844 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317915779 0 0) 0x7f8cb0001110 con 0x7f8cc80b3c00 2024-04-25T13:16:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.797+0000 7f8cc659c640 1 --2- 172.21.15.52:0/1251784844 >> v2:172.21.15.102:3300/0 conn(0x7f8cc81554e0 0x7f8cc815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.798+0000 7f8cc6d9d640 1 --2- 172.21.15.52:0/1251784844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc80d08a0 0x7f8cc80d0cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cc808e520 tx=0x7f8cc002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99adb8d9d1d16632 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.798+0000 7f8cc5d9b640 1 -- 172.21.15.52:0/1251784844 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0007740 con 0x7f8cc80d08a0 2024-04-25T13:16:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.798+0000 7f8cc5d9b640 1 -- 172.21.15.52:0/1251784844 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc00078e0 con 0x7f8cc80d08a0 2024-04-25T13:16:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.798+0000 7f8cc5d9b640 1 -- 172.21.15.52:0/1251784844 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0007cb0 con 0x7f8cc80d08a0 2024-04-25T13:16:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.799+0000 7f8cccf29640 1 -- 172.21.15.52:0/1251784844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc80d08a0 msgr2=0x7f8cc80d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.799+0000 7f8cccf29640 1 --2- 172.21.15.52:0/1251784844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc80d08a0 0x7f8cc80d0cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cc808e520 tx=0x7f8cc002a710 comp rx=0 tx=0).stop 2024-04-25T13:16:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.799+0000 7f8cccf29640 1 -- 172.21.15.52:0/1251784844 shutdown_connections 2024-04-25T13:16:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.799+0000 7f8cccf29640 1 --2- 172.21.15.52:0/1251784844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc80d08a0 0x7f8cc80d0cb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.799+0000 7f8cccf29640 1 --2- 172.21.15.52:0/1251784844 >> v2:172.21.15.102:3300/0 conn(0x7f8cc81554e0 0x7f8cc815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.799+0000 7f8cccf29640 1 -- 172.21.15.52:0/1251784844 >> 172.21.15.52:0/1251784844 conn(0x7f8cc8074d50 msgr2=0x7f8cc8075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.799+0000 7f8cccf29640 1 -- 172.21.15.52:0/1251784844 shutdown_connections 2024-04-25T13:16:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.799+0000 7f8cccf29640 1 -- 172.21.15.52:0/1251784844 wait complete. 2024-04-25T13:16:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.800+0000 7f8cccf29640 1 Processor -- start 2024-04-25T13:16:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.800+0000 7f8cccf29640 1 -- start start 2024-04-25T13:16:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cccf29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc80b3c00 0x7f8cc8150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cccf29640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8cc80d08a0 0x7f8cc80ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cccf29640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc81554e0 0x7f8cc80cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cccf29640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc80b4430 con 0x7f8cc80b3c00 2024-04-25T13:16:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cccf29640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc80b4150 con 0x7f8cc81554e0 2024-04-25T13:16:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cccf29640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc80b4710 con 0x7f8cc80d08a0 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cc659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc80b3c00 0x7f8cc8150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cc659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc80b3c00 0x7f8cc8150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38746/0 (socket says 172.21.15.52:38746) 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cc659c640 1 -- 172.21.15.52:0/3942452436 learned_addr learned my addr 172.21.15.52:0/3942452436 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cc6d9d640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc81554e0 0x7f8cc80cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cbffff640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8cc80d08a0 0x7f8cc80ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cc659c640 1 -- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8cc80d08a0 msgr2=0x7f8cc80ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cc659c640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8cc80d08a0 0x7f8cc80ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cc659c640 1 -- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc81554e0 msgr2=0x7f8cc80cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cc659c640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc81554e0 0x7f8cc80cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cc659c640 1 -- 172.21.15.52:0/3942452436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc80c9f00 con 0x7f8cc80b3c00 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cc6d9d640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc81554e0 0x7f8cc80cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cc659c640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc80b3c00 0x7f8cc8150580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800d7d0 tx=0x7f8cb800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cbeffd640 1 -- 172.21.15.52:0/3942452436 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8004030 con 0x7f8cc80b3c00 2024-04-25T13:16:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cbeffd640 1 -- 172.21.15.52:0/3942452436 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb80041d0 con 0x7f8cc80b3c00 2024-04-25T13:16:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cbeffd640 1 -- 172.21.15.52:0/3942452436 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb80096a0 con 0x7f8cc80b3c00 2024-04-25T13:16:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cccf29640 1 -- 172.21.15.52:0/3942452436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc8150ac0 con 0x7f8cc80b3c00 2024-04-25T13:16:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.801+0000 7f8cccf29640 1 -- 172.21.15.52:0/3942452436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc815e1b0 con 0x7f8cc80b3c00 2024-04-25T13:16:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.802+0000 7f8cccf29640 1 -- 172.21.15.52:0/3942452436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc8073c70 con 0x7f8cc80b3c00 2024-04-25T13:16:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.803+0000 7f8cbeffd640 1 -- 172.21.15.52:0/3942452436 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8cb8009840 con 0x7f8cc80b3c00 2024-04-25T13:16:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.803+0000 7f8cbeffd640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8ca806c8f0 0x7f8ca806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.803+0000 7f8cbeffd640 1 -- 172.21.15.52:0/3942452436 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8cb808baf0 con 0x7f8cc80b3c00 2024-04-25T13:16:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.803+0000 7f8cbffff640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8ca806c8f0 0x7f8ca806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:04.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.804+0000 7f8cbffff640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8ca806c8f0 0x7f8ca806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0007fd0 tx=0x7f8cb0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:04.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.808+0000 7f8cbeffd640 1 -- 172.21.15.52:0/3942452436 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8cc8073c70 con 0x7f8cc80b3c00 2024-04-25T13:16:04.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.992+0000 7f8cccf29640 1 -- 172.21.15.52:0/3942452436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cc8068e40 con 0x7f8cc80b3c00 2024-04-25T13:16:04.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.993+0000 7f8cbeffd640 1 -- 172.21.15.52:0/3942452436 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f8cb805a270 con 0x7f8cc80b3c00 2024-04-25T13:16:04.993 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:04.994 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":16,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:15:57.952696+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:04.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.995+0000 7f8cccf29640 1 -- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8ca806c8f0 msgr2=0x7f8ca806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:04.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.995+0000 7f8cccf29640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8ca806c8f0 0x7f8ca806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0007fd0 tx=0x7f8cb0009040 comp rx=0 tx=0).stop 2024-04-25T13:16:04.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.995+0000 7f8cccf29640 1 -- 172.21.15.52:0/3942452436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc80b3c00 msgr2=0x7f8cc8150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:04.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.995+0000 7f8cccf29640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc80b3c00 0x7f8cc8150580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800d7d0 tx=0x7f8cb800dc90 comp rx=0 tx=0).stop 2024-04-25T13:16:04.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.995+0000 7f8cccf29640 1 -- 172.21.15.52:0/3942452436 shutdown_connections 2024-04-25T13:16:04.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.995+0000 7f8cccf29640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8ca806c8f0 0x7f8ca806edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.995+0000 7f8cccf29640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8cc80d08a0 0x7f8cc80ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.995+0000 7f8cccf29640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc81554e0 0x7f8cc80cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.995+0000 7f8cccf29640 1 --2- 172.21.15.52:0/3942452436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc80b3c00 0x7f8cc8150580 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:04.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.995+0000 7f8cccf29640 1 -- 172.21.15.52:0/3942452436 >> 172.21.15.52:0/3942452436 conn(0x7f8cc8074d50 msgr2=0x7f8cc8072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:04.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.995+0000 7f8cccf29640 1 -- 172.21.15.52:0/3942452436 shutdown_connections 2024-04-25T13:16:04.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:04.995+0000 7f8cccf29640 1 -- 172.21.15.52:0/3942452436 wait complete. 2024-04-25T13:16:05.006 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.833544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:16:05.006 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.110+0000 7f3a643e5640 1 Processor -- start 2024-04-25T13:16:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.110+0000 7f3a643e5640 1 -- start start 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a643e5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3a5c15b070 0x7f3a5c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a643e5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a5c0cbae0 0x7f3a5c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a643e5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a5c0c5c80 con 0x7f3a5c1553c0 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a643e5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3a5c15e660 con 0x7f3a5c0cbae0 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a643e5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3a5c1557a0 con 0x7f3a5c15b070 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a62982640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a5c0cbae0 0x7f3a5c0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a62982640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a5c0cbae0 0x7f3a5c0d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38756/0 (socket says 172.21.15.52:38756) 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a62982640 1 -- 172.21.15.52:0/2234803928 learned_addr learned my addr 172.21.15.52:0/2234803928 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a61980640 1 --2- 172.21.15.52:0/2234803928 >> v2:172.21.15.102:3300/0 conn(0x7f3a5c15b070 0x7f3a5c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a62982640 1 -- 172.21.15.52:0/2234803928 >> v2:172.21.15.102:3300/0 conn(0x7f3a5c15b070 msgr2=0x7f3a5c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a62982640 1 --2- 172.21.15.52:0/2234803928 >> v2:172.21.15.102:3300/0 conn(0x7f3a5c15b070 0x7f3a5c0cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a62982640 1 -- 172.21.15.52:0/2234803928 >> v1:172.21.15.102:6789/0 conn(0x7f3a5c1553c0 legacy=0x7f3a5c15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.111+0000 7f3a62982640 1 -- 172.21.15.52:0/2234803928 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c15b5d0 con 0x7f3a5c0cbae0 2024-04-25T13:16:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.112+0000 7f3a62982640 1 --2- 172.21.15.52:0/2234803928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cbae0 0x7f3a5c0d0820 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c08ea60 tx=0x7f3a4c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297250b37a57dc33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.112+0000 7f3a6117f640 1 -- 172.21.15.52:0/2234803928 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c036070 con 0x7f3a5c0cbae0 2024-04-25T13:16:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.112+0000 7f3a6117f640 1 -- 172.21.15.52:0/2234803928 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4c031600 con 0x7f3a5c0cbae0 2024-04-25T13:16:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.112+0000 7f3a6117f640 1 -- 172.21.15.52:0/2234803928 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0319d0 con 0x7f3a5c0cbae0 2024-04-25T13:16:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.113+0000 7f3a643e5640 1 -- 172.21.15.52:0/2234803928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cbae0 msgr2=0x7f3a5c0d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.113+0000 7f3a643e5640 1 --2- 172.21.15.52:0/2234803928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cbae0 0x7f3a5c0d0820 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c08ea60 tx=0x7f3a4c02a6f0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.113+0000 7f3a643e5640 1 -- 172.21.15.52:0/2234803928 shutdown_connections 2024-04-25T13:16:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.113+0000 7f3a643e5640 1 --2- 172.21.15.52:0/2234803928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cbae0 0x7f3a5c0d0820 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.113+0000 7f3a643e5640 1 --2- 172.21.15.52:0/2234803928 >> v2:172.21.15.102:3300/0 conn(0x7f3a5c15b070 0x7f3a5c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.113+0000 7f3a643e5640 1 -- 172.21.15.52:0/2234803928 >> 172.21.15.52:0/2234803928 conn(0x7f3a5c072360 msgr2=0x7f3a5c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.113+0000 7f3a643e5640 1 -- 172.21.15.52:0/2234803928 shutdown_connections 2024-04-25T13:16:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.113+0000 7f3a643e5640 1 -- 172.21.15.52:0/2234803928 wait complete. 2024-04-25T13:16:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.114+0000 7f3a643e5640 1 Processor -- start 2024-04-25T13:16:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.114+0000 7f3a643e5640 1 -- start start 2024-04-25T13:16:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a643e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a5c0cbae0 0x7f3a5c15de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a643e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c1553c0 0x7f3a5c1e3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a643e5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c15b070 0x7f3a5c1480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a643e5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c15be70 con 0x7f3a5c1553c0 2024-04-25T13:16:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a643e5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c15bb90 con 0x7f3a5c0cbae0 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a643e5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5c15e8b0 con 0x7f3a5c15b070 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a61980640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c1553c0 0x7f3a5c1e3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a61980640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c1553c0 0x7f3a5c1e3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38758/0 (socket says 172.21.15.52:38758) 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a61980640 1 -- 172.21.15.52:0/1032276768 learned_addr learned my addr 172.21.15.52:0/1032276768 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a62181640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a5c0cbae0 0x7f3a5c15de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a62982640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c15b070 0x7f3a5c1480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a61980640 1 -- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c15b070 msgr2=0x7f3a5c1480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a61980640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c15b070 0x7f3a5c1480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a61980640 1 -- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a5c0cbae0 msgr2=0x7f3a5c15de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a61980640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a5c0cbae0 0x7f3a5c15de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a61980640 1 -- 172.21.15.52:0/1032276768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c15dbb0 con 0x7f3a5c1553c0 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a61980640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c1553c0 0x7f3a5c1e3c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000c820 tx=0x7f3a5000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a5affd640 1 -- 172.21.15.52:0/1032276768 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50015070 con 0x7f3a5c1553c0 2024-04-25T13:16:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a5affd640 1 -- 172.21.15.52:0/1032276768 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a50004020 con 0x7f3a5c1553c0 2024-04-25T13:16:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a643e5640 1 -- 172.21.15.52:0/1032276768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5c1f10d0 con 0x7f3a5c1553c0 2024-04-25T13:16:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a5affd640 1 -- 172.21.15.52:0/1032276768 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a500043f0 con 0x7f3a5c1553c0 2024-04-25T13:16:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.115+0000 7f3a643e5640 1 -- 172.21.15.52:0/1032276768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5c1f1690 con 0x7f3a5c1553c0 2024-04-25T13:16:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.116+0000 7f3a643e5640 1 -- 172.21.15.52:0/1032276768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5c0ce830 con 0x7f3a5c1553c0 2024-04-25T13:16:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.117+0000 7f3a5affd640 1 -- 172.21.15.52:0/1032276768 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a50007830 con 0x7f3a5c1553c0 2024-04-25T13:16:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.117+0000 7f3a5affd640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3a4806c8f0 0x7f3a4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.117+0000 7f3a5affd640 1 -- 172.21.15.52:0/1032276768 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3a5008b5e0 con 0x7f3a5c1553c0 2024-04-25T13:16:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.117+0000 7f3a62181640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3a4806c8f0 0x7f3a4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.118+0000 7f3a62181640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3a4806c8f0 0x7f3a4806edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3a54007fd0 tx=0x7f3a54007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.122+0000 7f3a5affd640 1 -- 172.21.15.52:0/1032276768 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a50059680 con 0x7f3a5c1553c0 2024-04-25T13:16:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.305+0000 7f3a643e5640 1 -- 172.21.15.52:0/1032276768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3a5c0cc0e0 con 0x7f3a5c1553c0 2024-04-25T13:16:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.306+0000 7f3a5affd640 1 -- 172.21.15.52:0/1032276768 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f3a5005d980 con 0x7f3a5c1553c0 2024-04-25T13:16:05.306 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T13:16:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.307+0000 7f3a643e5640 1 -- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3a4806c8f0 msgr2=0x7f3a4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.307+0000 7f3a643e5640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3a4806c8f0 0x7f3a4806edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3a54007fd0 tx=0x7f3a54007e80 comp rx=0 tx=0).stop 2024-04-25T13:16:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.307+0000 7f3a643e5640 1 -- 172.21.15.52:0/1032276768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c1553c0 msgr2=0x7f3a5c1e3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.307+0000 7f3a643e5640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c1553c0 0x7f3a5c1e3c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000c820 tx=0x7f3a5000cce0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.307+0000 7f3a643e5640 1 -- 172.21.15.52:0/1032276768 shutdown_connections 2024-04-25T13:16:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.307+0000 7f3a643e5640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3a4806c8f0 0x7f3a4806edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.307+0000 7f3a643e5640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c15b070 0x7f3a5c1480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.307+0000 7f3a643e5640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c1553c0 0x7f3a5c1e3c60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.307+0000 7f3a643e5640 1 --2- 172.21.15.52:0/1032276768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a5c0cbae0 0x7f3a5c15de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.307+0000 7f3a643e5640 1 -- 172.21.15.52:0/1032276768 >> 172.21.15.52:0/1032276768 conn(0x7f3a5c072360 msgr2=0x7f3a5c0c6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.307+0000 7f3a643e5640 1 -- 172.21.15.52:0/1032276768 shutdown_connections 2024-04-25T13:16:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.307+0000 7f3a643e5640 1 -- 172.21.15.52:0/1032276768 wait complete. 2024-04-25T13:16:05.318 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T13:16:05.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.419+0000 7fd77bd29640 1 Processor -- start 2024-04-25T13:16:05.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.419+0000 7fd77bd29640 1 -- start start 2024-04-25T13:16:05.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd77bd29640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd77415f2a0 0x7fd77415b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd77bd29640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7740cd830 con 0x7fd77415b550 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd77bd29640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7741446e0 con 0x7fd774144300 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd77bd29640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd77415ee10 con 0x7fd77415f2a0 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd77a2c6640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd77415b550 0x7fd774074d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49644/0 (socket says 172.21.15.52:49644) 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd77a2c6640 1 -- 172.21.15.52:0/1796024911 learned_addr learned my addr 172.21.15.52:0/1796024911 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd7792c4640 1 --2- 172.21.15.52:0/1796024911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd77415f2a0 0x7fd77415b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd778ac3640 1 -- 172.21.15.52:0/1796024911 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479020333 0 0) 0x7fd7740cd830 con 0x7fd77415b550 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd778ac3640 1 -- 172.21.15.52:0/1796024911 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd760003520 con 0x7fd77415b550 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd778ac3640 1 -- 172.21.15.52:0/1796024911 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188617615 0 0) 0x7fd7741446e0 con 0x7fd774144300 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd778ac3640 1 -- 172.21.15.52:0/1796024911 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7740cd830 con 0x7fd774144300 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd778ac3640 1 -- 172.21.15.52:0/1796024911 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 80973096 0 0) 0x7fd760003520 con 0x7fd77415b550 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd7792c4640 1 -- 172.21.15.52:0/1796024911 >> v1:172.21.15.102:6789/0 conn(0x7fd774144300 legacy=0x7fd7740c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd7792c4640 1 -- 172.21.15.52:0/1796024911 >> v1:172.21.15.52:6789/0 conn(0x7fd77415b550 legacy=0x7fd774074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.420+0000 7fd7792c4640 1 -- 172.21.15.52:0/1796024911 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77415bac0 con 0x7fd77415f2a0 2024-04-25T13:16:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.421+0000 7fd7792c4640 1 --2- 172.21.15.52:0/1796024911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd77415f2a0 0x7fd77415b010 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd7640097d0 tx=0x7fd76402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5617060f2ac30de3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.421+0000 7fd778ac3640 1 -- 172.21.15.52:0/1796024911 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764037070 con 0x7fd77415f2a0 2024-04-25T13:16:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.421+0000 7fd778ac3640 1 -- 172.21.15.52:0/1796024911 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd76402acc0 con 0x7fd77415f2a0 2024-04-25T13:16:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.421+0000 7fd778ac3640 1 -- 172.21.15.52:0/1796024911 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c0019f0 con 0x7fd77415f2a0 2024-04-25T13:16:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.422+0000 7fd77bd29640 1 -- 172.21.15.52:0/1796024911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd77415f2a0 msgr2=0x7fd77415b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.422+0000 7fd77bd29640 1 --2- 172.21.15.52:0/1796024911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd77415f2a0 0x7fd77415b010 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd7640097d0 tx=0x7fd76402a230 comp rx=0 tx=0).stop 2024-04-25T13:16:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.422+0000 7fd77bd29640 1 -- 172.21.15.52:0/1796024911 shutdown_connections 2024-04-25T13:16:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.422+0000 7fd77bd29640 1 --2- 172.21.15.52:0/1796024911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd77415f2a0 0x7fd77415b010 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.422+0000 7fd77bd29640 1 -- 172.21.15.52:0/1796024911 >> 172.21.15.52:0/1796024911 conn(0x7fd77406b920 msgr2=0x7fd77406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.422+0000 7fd77bd29640 1 -- 172.21.15.52:0/1796024911 shutdown_connections 2024-04-25T13:16:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.422+0000 7fd77bd29640 1 -- 172.21.15.52:0/1796024911 wait complete. 2024-04-25T13:16:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.423+0000 7fd77bd29640 1 Processor -- start 2024-04-25T13:16:05.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.423+0000 7fd77bd29640 1 -- start start 2024-04-25T13:16:05.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd77bd29640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd774144300 0x7fd7741f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd77bd29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd77415b550 0x7fd7741f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd77bd29640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd77415f2a0 0x7fd77413ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd77bd29640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd77415eaa0 con 0x7fd77415b550 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd77bd29640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd77415e7c0 con 0x7fd774144300 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd77bd29640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd774075460 con 0x7fd77415f2a0 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd7792c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd77415b550 0x7fd7741f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd7792c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd77415b550 0x7fd7741f0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38764/0 (socket says 172.21.15.52:38764) 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd7792c4640 1 -- 172.21.15.52:0/2651717827 learned_addr learned my addr 172.21.15.52:0/2651717827 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd779ac5640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd774144300 0x7fd7741f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd77a2c6640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd77415f2a0 0x7fd77413ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd7792c4640 1 -- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd77415f2a0 msgr2=0x7fd77413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd7792c4640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd77415f2a0 0x7fd77413ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd7792c4640 1 -- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd774144300 msgr2=0x7fd7741f0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd7792c4640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd774144300 0x7fd7741f0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd7792c4640 1 -- 172.21.15.52:0/2651717827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7740ca370 con 0x7fd77415b550 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd779ac5640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd774144300 0x7fd7741f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd77a2c6640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd77415f2a0 0x7fd77413ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd7792c4640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd77415b550 0x7fd7741f0f70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd764035040 tx=0x7fd7640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.424+0000 7fd76a7fc640 1 -- 172.21.15.52:0/2651717827 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764037050 con 0x7fd77415b550 2024-04-25T13:16:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.425+0000 7fd76a7fc640 1 -- 172.21.15.52:0/2651717827 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd764043070 con 0x7fd77415b550 2024-04-25T13:16:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.425+0000 7fd77bd29640 1 -- 172.21.15.52:0/2651717827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7740ca650 con 0x7fd77415b550 2024-04-25T13:16:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.425+0000 7fd76a7fc640 1 -- 172.21.15.52:0/2651717827 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764006e10 con 0x7fd77415b550 2024-04-25T13:16:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.425+0000 7fd77bd29640 1 -- 172.21.15.52:0/2651717827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd77415b280 con 0x7fd77415b550 2024-04-25T13:16:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.425+0000 7fd77bd29640 1 -- 172.21.15.52:0/2651717827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd774068e40 con 0x7fd77415b550 2024-04-25T13:16:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.426+0000 7fd76a7fc640 1 -- 172.21.15.52:0/2651717827 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd76403ca30 con 0x7fd77415b550 2024-04-25T13:16:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.426+0000 7fd76a7fc640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd75806c920 0x7fd75806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.426+0000 7fd76a7fc640 1 -- 172.21.15.52:0/2651717827 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd7640ac2b0 con 0x7fd77415b550 2024-04-25T13:16:05.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.427+0000 7fd779ac5640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd75806c920 0x7fd75806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.427+0000 7fd779ac5640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd75806c920 0x7fd75806ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd7700011e0 tx=0x7fd770009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.431+0000 7fd76a7fc640 1 -- 172.21.15.52:0/2651717827 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd764030e20 con 0x7fd77415b550 2024-04-25T13:16:05.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.616+0000 7fd77bd29640 1 -- 172.21.15.52:0/2651717827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd7740c8110 con 0x7fd77415b550 2024-04-25T13:16:05.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.617+0000 7fd76a7fc640 1 -- 172.21.15.52:0/2651717827 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fd76407aac0 con 0x7fd77415b550 2024-04-25T13:16:05.617 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:05.617 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-04-25T13:16:05.617 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T13:16:05.618 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-04-25T13:16:05.618 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-04-25T13:16:05.618 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T13:16:05.618 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-04-25T13:16:05.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.619+0000 7fd77bd29640 1 -- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd75806c920 msgr2=0x7fd75806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.619+0000 7fd77bd29640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd75806c920 0x7fd75806ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd7700011e0 tx=0x7fd770009040 comp rx=0 tx=0).stop 2024-04-25T13:16:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.619+0000 7fd77bd29640 1 -- 172.21.15.52:0/2651717827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd77415b550 msgr2=0x7fd7741f0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.619+0000 7fd77bd29640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd77415b550 0x7fd7741f0f70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd764035040 tx=0x7fd7640046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.619+0000 7fd77bd29640 1 -- 172.21.15.52:0/2651717827 shutdown_connections 2024-04-25T13:16:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.619+0000 7fd77bd29640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd75806c920 0x7fd75806ede0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.619+0000 7fd77bd29640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd77415f2a0 0x7fd77413ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.619+0000 7fd77bd29640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd77415b550 0x7fd7741f0f70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.619+0000 7fd77bd29640 1 --2- 172.21.15.52:0/2651717827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd774144300 0x7fd7741f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.619+0000 7fd77bd29640 1 -- 172.21.15.52:0/2651717827 >> 172.21.15.52:0/2651717827 conn(0x7fd77406b920 msgr2=0x7fd774143230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.619+0000 7fd77bd29640 1 -- 172.21.15.52:0/2651717827 shutdown_connections 2024-04-25T13:16:05.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.619+0000 7fd77bd29640 1 -- 172.21.15.52:0/2651717827 wait complete. 2024-04-25T13:16:05.630 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T13:16:05.630 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T13:16:05.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.734+0000 7f79f73cd640 1 Processor -- start 2024-04-25T13:16:05.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.734+0000 7f79f73cd640 1 -- start start 2024-04-25T13:16:05.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.735+0000 7f79f73cd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f79f0155510 0x7f79f015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.735+0000 7f79f73cd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f015e800 con 0x7f79f0155130 2024-04-25T13:16:05.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.735+0000 7f79f73cd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f015eac0 con 0x7f79f00cde80 2024-04-25T13:16:05.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.735+0000 7f79f73cd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f79f015e5d0 con 0x7f79f0155510 2024-04-25T13:16:05.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.735+0000 7f79f5169640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f79f0155130 0x7f79f0073150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49650/0 (socket says 172.21.15.52:49650) 2024-04-25T13:16:05.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.735+0000 7f79f5169640 1 -- 172.21.15.52:0/2432250220 learned_addr learned my addr 172.21.15.52:0/2432250220 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:05.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.735+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1994515190 0 0) 0x7f79f015e800 con 0x7f79f0155130 2024-04-25T13:16:05.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.735+0000 7f79f4968640 1 --2- 172.21.15.52:0/2432250220 >> v2:172.21.15.102:3300/0 conn(0x7f79f0155510 0x7f79f015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.735+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79d8003520 con 0x7f79f0155130 2024-04-25T13:16:05.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 467110752 0 0) 0x7f79d8003520 con 0x7f79f0155130 2024-04-25T13:16:05.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 >> v2:172.21.15.102:3300/0 conn(0x7f79f0155510 msgr2=0x7f79f015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:05.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 --2- 172.21.15.52:0/2432250220 >> v2:172.21.15.102:3300/0 conn(0x7f79f0155510 0x7f79f015ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 >> v1:172.21.15.102:6789/0 conn(0x7f79f00cde80 legacy=0x7f79f00c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f015eda0 con 0x7f79f0155130 2024-04-25T13:16:05.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f79e8001670 con 0x7f79f0155130 2024-04-25T13:16:05.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 >> v1:172.21.15.52:6789/0 conn(0x7f79f0155130 legacy=0x7f79f0073150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 --2- 172.21.15.52:0/2432250220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79d80039b0 0x7f79d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 --2- 172.21.15.52:0/2432250220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 0x7f79d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 --2- 172.21.15.52:0/2432250220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79d80051c0 0x7f79d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f79d800c030 con 0x7f79d8004800 2024-04-25T13:16:05.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f79d800c1e0 con 0x7f79d80039b0 2024-04-25T13:16:05.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f79d800c3e0 con 0x7f79d80051c0 2024-04-25T13:16:05.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79f4968640 1 --2- 172.21.15.52:0/2432250220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 0x7f79d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79f5169640 1 --2- 172.21.15.52:0/2432250220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79d80039b0 0x7f79d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79f596a640 1 --2- 172.21.15.52:0/2432250220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79d80051c0 0x7f79d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79f4968640 1 -- 172.21.15.52:0/2432250220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79d80051c0 msgr2=0x7f79d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:05.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79f4968640 1 --2- 172.21.15.52:0/2432250220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79d80051c0 0x7f79d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79f4968640 1 -- 172.21.15.52:0/2432250220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79d80039b0 msgr2=0x7f79d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:05.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79f4968640 1 --2- 172.21.15.52:0/2432250220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79d80039b0 0x7f79d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79f4968640 1 -- 172.21.15.52:0/2432250220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d8003520 con 0x7f79d8004800 2024-04-25T13:16:05.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.736+0000 7f79f596a640 1 -- 172.21.15.52:0/2432250220 reap_dead start 2024-04-25T13:16:05.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.737+0000 7f79f4968640 1 --2- 172.21.15.52:0/2432250220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 0x7f79d8004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009ac0 tx=0x7f79d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f5ff307cb23cae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:05.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.737+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e4036070 con 0x7f79d8004800 2024-04-25T13:16:05.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.737+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e4031400 con 0x7f79d8004800 2024-04-25T13:16:05.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.737+0000 7f79effff640 1 -- 172.21.15.52:0/2432250220 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e4009690 con 0x7f79d8004800 2024-04-25T13:16:05.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.737+0000 7f79f73cd640 1 -- 172.21.15.52:0/2432250220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 msgr2=0x7f79d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.737+0000 7f79f73cd640 1 --2- 172.21.15.52:0/2432250220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 0x7f79d8004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009ac0 tx=0x7f79d8005830 comp rx=0 tx=0).stop 2024-04-25T13:16:05.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.737+0000 7f79f73cd640 1 -- 172.21.15.52:0/2432250220 shutdown_connections 2024-04-25T13:16:05.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.737+0000 7f79f73cd640 1 --2- 172.21.15.52:0/2432250220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 0x7f79d8004c80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.737+0000 7f79f73cd640 1 -- 172.21.15.52:0/2432250220 >> 172.21.15.52:0/2432250220 conn(0x7f79f0068360 msgr2=0x7f79f006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:05.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.737+0000 7f79f73cd640 1 -- 172.21.15.52:0/2432250220 shutdown_connections 2024-04-25T13:16:05.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.738+0000 7f79f73cd640 1 -- 172.21.15.52:0/2432250220 wait complete. 2024-04-25T13:16:05.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.739+0000 7f79f73cd640 1 Processor -- start 2024-04-25T13:16:05.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.739+0000 7f79f73cd640 1 -- start start 2024-04-25T13:16:05.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.739+0000 7f79f73cd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 0x7f79f014e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.739+0000 7f79f73cd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79f01516a0 0x7f79f0150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.739+0000 7f79f73cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79f0158620 0x7f79f01f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.739+0000 7f79f73cd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f79f015f360 con 0x7f79d8004800 2024-04-25T13:16:05.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.739+0000 7f79f73cd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f79f00c57a0 con 0x7f79f0158620 2024-04-25T13:16:05.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.739+0000 7f79f73cd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f79f00cb710 con 0x7f79f01516a0 2024-04-25T13:16:05.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f5169640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 0x7f79f014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f5169640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 0x7f79f014e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38778/0 (socket says 172.21.15.52:38778) 2024-04-25T13:16:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f5169640 1 -- 172.21.15.52:0/4027013919 learned_addr learned my addr 172.21.15.52:0/4027013919 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f4968640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79f01516a0 0x7f79f0150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f596a640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79f0158620 0x7f79f01f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f5169640 1 -- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79f01516a0 msgr2=0x7f79f0150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f5169640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79f01516a0 0x7f79f0150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f5169640 1 -- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79f0158620 msgr2=0x7f79f01f1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f5169640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79f0158620 0x7f79f01f1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f5169640 1 -- 172.21.15.52:0/4027013919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f015e0a0 con 0x7f79d8004800 2024-04-25T13:16:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f5169640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 0x7f79f014e100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f79e80072c0 tx=0x7f79e8007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79edffb640 1 -- 172.21.15.52:0/4027013919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e800f860 con 0x7f79d8004800 2024-04-25T13:16:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79edffb640 1 -- 172.21.15.52:0/4027013919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e8018070 con 0x7f79d8004800 2024-04-25T13:16:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79edffb640 1 -- 172.21.15.52:0/4027013919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e800fc40 con 0x7f79d8004800 2024-04-25T13:16:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f73cd640 1 -- 172.21.15.52:0/4027013919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f015e360 con 0x7f79d8004800 2024-04-25T13:16:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.740+0000 7f79f73cd640 1 -- 172.21.15.52:0/4027013919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f014fb10 con 0x7f79d8004800 2024-04-25T13:16:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.741+0000 7f79f73cd640 1 -- 172.21.15.52:0/4027013919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f015e800 con 0x7f79d8004800 2024-04-25T13:16:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.742+0000 7f79edffb640 1 -- 172.21.15.52:0/4027013919 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f79e801d460 con 0x7f79d8004800 2024-04-25T13:16:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.742+0000 7f79edffb640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f79dc06c8f0 0x7f79dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.742+0000 7f79edffb640 1 -- 172.21.15.52:0/4027013919 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f79e808b7e0 con 0x7f79d8004800 2024-04-25T13:16:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.742+0000 7f79f4968640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f79dc06c8f0 0x7f79dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.743+0000 7f79f4968640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f79dc06c8f0 0x7f79dc06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f79e4033000 tx=0x7f79e4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.746+0000 7f79edffb640 1 -- 172.21.15.52:0/4027013919 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f79e8059880 con 0x7f79d8004800 2024-04-25T13:16:05.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.931+0000 7f79f73cd640 1 -- 172.21.15.52:0/4027013919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f79f01539e0 con 0x7f79d8004800 2024-04-25T13:16:05.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.969+0000 7f79edffb640 1 -- 172.21.15.52:0/4027013919 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f79e805db80 con 0x7f79d8004800 2024-04-25T13:16:05.970 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-04-25T13:16:05.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.972+0000 7f79f73cd640 1 -- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f79dc06c8f0 msgr2=0x7f79dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.972+0000 7f79f73cd640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f79dc06c8f0 0x7f79dc06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f79e4033000 tx=0x7f79e4008030 comp rx=0 tx=0).stop 2024-04-25T13:16:05.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.972+0000 7f79f73cd640 1 -- 172.21.15.52:0/4027013919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 msgr2=0x7f79f014e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:05.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.972+0000 7f79f73cd640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 0x7f79f014e100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f79e80072c0 tx=0x7f79e8007780 comp rx=0 tx=0).stop 2024-04-25T13:16:05.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.972+0000 7f79f73cd640 1 -- 172.21.15.52:0/4027013919 shutdown_connections 2024-04-25T13:16:05.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.972+0000 7f79f73cd640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f79dc06c8f0 0x7f79dc06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.972+0000 7f79f73cd640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79f01516a0 0x7f79f0150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.972+0000 7f79f73cd640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79f0158620 0x7f79f01f1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.972+0000 7f79f73cd640 1 --2- 172.21.15.52:0/4027013919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d8004800 0x7f79f014e100 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:05.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.972+0000 7f79f73cd640 1 -- 172.21.15.52:0/4027013919 >> 172.21.15.52:0/4027013919 conn(0x7f79f0068360 msgr2=0x7f79f0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:05.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.972+0000 7f79f73cd640 1 -- 172.21.15.52:0/4027013919 shutdown_connections 2024-04-25T13:16:05.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:05.972+0000 7f79f73cd640 1 -- 172.21.15.52:0/4027013919 wait complete. 2024-04-25T13:16:05.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T13:16:06.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.094+0000 7f7d0af75640 1 Processor -- start 2024-04-25T13:16:06.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.094+0000 7f7d0af75640 1 -- start start 2024-04-25T13:16:06.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d0af75640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d041554e0 0x7f7d040d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d0af75640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7d040d1010 0x7f7d040cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d0af75640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d040d1510 con 0x7f7d040cc6f0 2024-04-25T13:16:06.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d0af75640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7d040cced0 con 0x7f7d040d1010 2024-04-25T13:16:06.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d0af75640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0415bf00 con 0x7f7d041554e0 2024-04-25T13:16:06.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d09512640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7d040cc6f0 0x7f7d040cd0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49654/0 (socket says 172.21.15.52:49654) 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d09512640 1 -- 172.21.15.52:0/1042395760 learned_addr learned my addr 172.21.15.52:0/1042395760 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d03fff640 1 --2- 172.21.15.52:0/1042395760 >> v2:172.21.15.102:3300/0 conn(0x7f7d040d1010 0x7f7d040cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d08d11640 1 --2- 172.21.15.52:0/1042395760 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d041554e0 0x7f7d040d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1120595421 0 0) 0x7f7d040d1510 con 0x7f7d040cc6f0 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cf4003520 con 0x7f7d040cc6f0 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2147198327 0 0) 0x7f7cf4003520 con 0x7f7d040cc6f0 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d041554e0 msgr2=0x7f7d040d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 --2- 172.21.15.52:0/1042395760 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d041554e0 0x7f7d040d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 >> v2:172.21.15.102:3300/0 conn(0x7f7d040d1010 msgr2=0x7f7d040cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 --2- 172.21.15.52:0/1042395760 >> v2:172.21.15.102:3300/0 conn(0x7f7d040d1010 0x7f7d040cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0415b5d0 con 0x7f7d040cc6f0 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f7cfc0019f0 con 0x7f7d040cc6f0 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 >> v1:172.21.15.52:6789/0 conn(0x7f7d040cc6f0 legacy=0x7f7d040cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 --2- 172.21.15.52:0/1042395760 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d041554e0 0x7f7cf40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 --2- 172.21.15.52:0/1042395760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cf4003f30 0x7f7cf4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.095+0000 7f7d037fe640 1 --2- 172.21.15.52:0/1042395760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf4004d40 0x7f7cf40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.096+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d040cced0 con 0x7f7cf4003f30 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.096+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0415bf00 con 0x7f7cf4004d40 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.096+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf400b9c0 con 0x7f7d041554e0 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.096+0000 7f7d03fff640 1 --2- 172.21.15.52:0/1042395760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cf4003f30 0x7f7cf4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.096+0000 7f7d08d11640 1 --2- 172.21.15.52:0/1042395760 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d041554e0 0x7f7cf40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.096+0000 7f7d09512640 1 --2- 172.21.15.52:0/1042395760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf4004d40 0x7f7cf40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.096+0000 7f7d03fff640 1 -- 172.21.15.52:0/1042395760 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d041554e0 msgr2=0x7f7cf40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.096+0000 7f7d03fff640 1 --2- 172.21.15.52:0/1042395760 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d041554e0 0x7f7cf40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.096+0000 7f7d03fff640 1 -- 172.21.15.52:0/1042395760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf4004d40 msgr2=0x7f7cf40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.096+0000 7f7d03fff640 1 --2- 172.21.15.52:0/1042395760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf4004d40 0x7f7cf40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.096+0000 7f7d03fff640 1 -- 172.21.15.52:0/1042395760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf4003520 con 0x7f7cf4003f30 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.097+0000 7f7d03fff640 1 --2- 172.21.15.52:0/1042395760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cf4003f30 0x7f7cf4004800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009ac0 tx=0x7f7cf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e64dba365c055a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.097+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0036070 con 0x7f7cf4003f30 2024-04-25T13:16:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.097+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf0031400 con 0x7f7cf4003f30 2024-04-25T13:16:06.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.097+0000 7f7d037fe640 1 -- 172.21.15.52:0/1042395760 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0009690 con 0x7f7cf4003f30 2024-04-25T13:16:06.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.097+0000 7f7d0af75640 1 -- 172.21.15.52:0/1042395760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cf4003f30 msgr2=0x7f7cf4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.097+0000 7f7d0af75640 1 --2- 172.21.15.52:0/1042395760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cf4003f30 0x7f7cf4004800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009ac0 tx=0x7f7cf4005830 comp rx=0 tx=0).stop 2024-04-25T13:16:06.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.097+0000 7f7d09512640 1 -- 172.21.15.52:0/1042395760 reap_dead start 2024-04-25T13:16:06.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.097+0000 7f7d0af75640 1 -- 172.21.15.52:0/1042395760 shutdown_connections 2024-04-25T13:16:06.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.097+0000 7f7d0af75640 1 -- 172.21.15.52:0/1042395760 >> 172.21.15.52:0/1042395760 conn(0x7f7d04074d50 msgr2=0x7f7d04075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:06.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.097+0000 7f7d0af75640 1 -- 172.21.15.52:0/1042395760 shutdown_connections 2024-04-25T13:16:06.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.097+0000 7f7d0af75640 1 -- 172.21.15.52:0/1042395760 wait complete. 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.098+0000 7f7d0af75640 1 Processor -- start 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.099+0000 7f7d0af75640 1 -- start start 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.099+0000 7f7d0af75640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf4003f30 0x7f7d041f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.099+0000 7f7d0af75640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d040c9f30 0x7f7d040c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.099+0000 7f7d0af75640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d040caf80 0x7f7d0414fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.099+0000 7f7d0af75640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0415b280 con 0x7f7d040caf80 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.099+0000 7f7d0af75640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0415bb90 con 0x7f7d040c9f30 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.099+0000 7f7d0af75640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7d041558c0 con 0x7f7cf4003f30 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.099+0000 7f7d09512640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d040caf80 0x7f7d0414fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d09512640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d040caf80 0x7f7d0414fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38790/0 (socket says 172.21.15.52:38790) 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d09512640 1 -- 172.21.15.52:0/2816446113 learned_addr learned my addr 172.21.15.52:0/2816446113 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d03fff640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d040c9f30 0x7f7d040c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d08d11640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf4003f30 0x7f7d041f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d09512640 1 -- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf4003f30 msgr2=0x7f7d041f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d09512640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf4003f30 0x7f7d041f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d09512640 1 -- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d040c9f30 msgr2=0x7f7d040c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d09512640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d040c9f30 0x7f7d040c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d09512640 1 -- 172.21.15.52:0/2816446113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d04153e60 con 0x7f7d040caf80 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d09512640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d040caf80 0x7f7d0414fdf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0013d0 tx=0x7f7cfc007a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d017fa640 1 -- 172.21.15.52:0/2816446113 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ac50 con 0x7f7d040caf80 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d017fa640 1 -- 172.21.15.52:0/2816446113 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00adf0 con 0x7f7d040caf80 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d0af75640 1 -- 172.21.15.52:0/2816446113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d04154120 con 0x7f7d040caf80 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d017fa640 1 -- 172.21.15.52:0/2816446113 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc013630 con 0x7f7d040caf80 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.100+0000 7f7d0af75640 1 -- 172.21.15.52:0/2816446113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d041f0dc0 con 0x7f7d040caf80 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.101+0000 7f7d0af75640 1 -- 172.21.15.52:0/2816446113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d04068e40 con 0x7f7d040caf80 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.102+0000 7f7d017fa640 1 -- 172.21.15.52:0/2816446113 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7cfc0137d0 con 0x7f7d040caf80 2024-04-25T13:16:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.102+0000 7f7d017fa640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7ce806c8f0 0x7f7ce806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:06.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.102+0000 7f7d017fa640 1 -- 172.21.15.52:0/2816446113 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f7cfc08bce0 con 0x7f7d040caf80 2024-04-25T13:16:06.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.102+0000 7f7d08d11640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7ce806c8f0 0x7f7ce806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:06.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.103+0000 7f7d08d11640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7ce806c8f0 0x7f7ce806edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009ae0 tx=0x7f7cf8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:06.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.107+0000 7f7d017fa640 1 -- 172.21.15.52:0/2816446113 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7cfc05a380 con 0x7f7d040caf80 2024-04-25T13:16:06.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.293+0000 7f7d0af75640 1 -- 172.21.15.52:0/2816446113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f7d040c79f0 con 0x7f7d040caf80 2024-04-25T13:16:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.972+0000 7f7d017fa640 1 -- 172.21.15.52:0/2816446113 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f7cfc059c80 con 0x7f7d040caf80 2024-04-25T13:16:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-04-25T13:16:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.976+0000 7f7d0af75640 1 -- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7ce806c8f0 msgr2=0x7f7ce806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.976+0000 7f7d0af75640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7ce806c8f0 0x7f7ce806edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009ae0 tx=0x7f7cf8009190 comp rx=0 tx=0).stop 2024-04-25T13:16:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.976+0000 7f7d0af75640 1 -- 172.21.15.52:0/2816446113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d040caf80 msgr2=0x7f7d0414fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.976+0000 7f7d0af75640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d040caf80 0x7f7d0414fdf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0013d0 tx=0x7f7cfc007a60 comp rx=0 tx=0).stop 2024-04-25T13:16:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.976+0000 7f7d0af75640 1 -- 172.21.15.52:0/2816446113 shutdown_connections 2024-04-25T13:16:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.976+0000 7f7d0af75640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7ce806c8f0 0x7f7ce806edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.976+0000 7f7d0af75640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d040caf80 0x7f7d0414fdf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.976+0000 7f7d0af75640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d040c9f30 0x7f7d040c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.976+0000 7f7d0af75640 1 --2- 172.21.15.52:0/2816446113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf4003f30 0x7f7d041f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.976+0000 7f7d0af75640 1 -- 172.21.15.52:0/2816446113 >> 172.21.15.52:0/2816446113 conn(0x7f7d04074d50 msgr2=0x7f7d04159980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.976+0000 7f7d0af75640 1 -- 172.21.15.52:0/2816446113 shutdown_connections 2024-04-25T13:16:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:06.977+0000 7f7d0af75640 1 -- 172.21.15.52:0/2816446113 wait complete. 2024-04-25T13:16:07.004 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.112+0000 7f9eb19cc640 1 Processor -- start 2024-04-25T13:16:07.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.112+0000 7f9eb19cc640 1 -- start start 2024-04-25T13:16:07.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eb19cc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9eac0cccf0 0x7f9eac15f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eb19cc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eac0c58f0 0x7f9eac0c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eb19cc640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eac0cbe10 con 0x7f9eac155530 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eb19cc640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9eac15bf10 con 0x7f9eac0cccf0 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eb19cc640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9eac0c6260 con 0x7f9eac0c58f0 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eaa7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9eac0cccf0 0x7f9eac15f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eaa7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9eac0cccf0 0x7f9eac15f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38806/0 (socket says 172.21.15.52:38806) 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eaa7fc640 1 -- 172.21.15.52:0/3778679170 learned_addr learned my addr 172.21.15.52:0/3778679170 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eab7fe640 1 --2- 172.21.15.52:0/3778679170 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eac0c58f0 0x7f9eac0c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eaa7fc640 1 -- 172.21.15.52:0/3778679170 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eac0c58f0 msgr2=0x7f9eac0c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eaa7fc640 1 --2- 172.21.15.52:0/3778679170 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eac0c58f0 0x7f9eac0c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eaa7fc640 1 -- 172.21.15.52:0/3778679170 >> v1:172.21.15.102:6789/0 conn(0x7f9eac155530 legacy=0x7f9eac0d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9eaa7fc640 1 -- 172.21.15.52:0/3778679170 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac0cc0d0 con 0x7f9eac0cccf0 2024-04-25T13:16:07.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.113+0000 7f9ea9ffb640 1 -- 172.21.15.52:0/3778679170 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 461644770 0 0) 0x7f9eac0cbe10 con 0x7f9eac155530 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.114+0000 7f9eaa7fc640 1 --2- 172.21.15.52:0/3778679170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eac0cccf0 0x7f9eac15f210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009870 tx=0x7f9e9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3634719a014b5f6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.114+0000 7f9ea9ffb640 1 -- 172.21.15.52:0/3778679170 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e94037070 con 0x7f9eac0cccf0 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.114+0000 7f9ea9ffb640 1 -- 172.21.15.52:0/3778679170 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e94032440 con 0x7f9eac0cccf0 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.114+0000 7f9ea9ffb640 1 -- 172.21.15.52:0/3778679170 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e94032810 con 0x7f9eac0cccf0 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.115+0000 7f9eb19cc640 1 -- 172.21.15.52:0/3778679170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eac0cccf0 msgr2=0x7f9eac15f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.115+0000 7f9eb19cc640 1 --2- 172.21.15.52:0/3778679170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eac0cccf0 0x7f9eac15f210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009870 tx=0x7f9e9402a270 comp rx=0 tx=0).stop 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.115+0000 7f9eb19cc640 1 -- 172.21.15.52:0/3778679170 shutdown_connections 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.115+0000 7f9eb19cc640 1 --2- 172.21.15.52:0/3778679170 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eac0c58f0 0x7f9eac0c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.115+0000 7f9eb19cc640 1 --2- 172.21.15.52:0/3778679170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eac0cccf0 0x7f9eac15f210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.115+0000 7f9eb19cc640 1 -- 172.21.15.52:0/3778679170 >> 172.21.15.52:0/3778679170 conn(0x7f9eac06d350 msgr2=0x7f9eac073110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.115+0000 7f9eb19cc640 1 -- 172.21.15.52:0/3778679170 shutdown_connections 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.115+0000 7f9eb19cc640 1 -- 172.21.15.52:0/3778679170 wait complete. 2024-04-25T13:16:07.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.116+0000 7f9eb19cc640 1 Processor -- start 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.116+0000 7f9eb19cc640 1 -- start start 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eb19cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eac0c58f0 0x7f9eac0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eb19cc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eac0cccf0 0x7f9eac156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eb19cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eac155530 0x7f9eac157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eb19cc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac15bba0 con 0x7f9eac0c58f0 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eb19cc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac15b8c0 con 0x7f9eac155530 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eb19cc640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9eac15b290 con 0x7f9eac0cccf0 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eac0c58f0 0x7f9eac0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eaaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eac0c58f0 0x7f9eac0cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38812/0 (socket says 172.21.15.52:38812) 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eaaffd640 1 -- 172.21.15.52:0/2546655333 learned_addr learned my addr 172.21.15.52:0/2546655333 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eaa7fc640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eac0cccf0 0x7f9eac156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eab7fe640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eac155530 0x7f9eac157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eaaffd640 1 -- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eac0cccf0 msgr2=0x7f9eac156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eaaffd640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eac0cccf0 0x7f9eac156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eaaffd640 1 -- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eac155530 msgr2=0x7f9eac157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eaaffd640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eac155530 0x7f9eac157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eaaffd640 1 -- 172.21.15.52:0/2546655333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac1f2830 con 0x7f9eac0c58f0 2024-04-25T13:16:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eab7fe640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eac155530 0x7f9eac157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9eaaffd640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eac0c58f0 0x7f9eac0cf980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400c440 tx=0x7f9ea400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.117+0000 7f9ea3fff640 1 -- 172.21.15.52:0/2546655333 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4017070 con 0x7f9eac0c58f0 2024-04-25T13:16:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.118+0000 7f9ea3fff640 1 -- 172.21.15.52:0/2546655333 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea4005480 con 0x7f9eac0c58f0 2024-04-25T13:16:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.118+0000 7f9eb19cc640 1 -- 172.21.15.52:0/2546655333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eac148cf0 con 0x7f9eac0c58f0 2024-04-25T13:16:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.118+0000 7f9ea3fff640 1 -- 172.21.15.52:0/2546655333 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4003830 con 0x7f9eac0c58f0 2024-04-25T13:16:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.118+0000 7f9eb19cc640 1 -- 172.21.15.52:0/2546655333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eac1f2520 con 0x7f9eac0c58f0 2024-04-25T13:16:07.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.118+0000 7f9eb19cc640 1 -- 172.21.15.52:0/2546655333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eac069ef0 con 0x7f9eac0c58f0 2024-04-25T13:16:07.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.119+0000 7f9ea3fff640 1 -- 172.21.15.52:0/2546655333 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ea401a070 con 0x7f9eac0c58f0 2024-04-25T13:16:07.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.119+0000 7f9ea3fff640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9e8c06c8f0 0x7f9e8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.120+0000 7f9ea3fff640 1 -- 172.21.15.52:0/2546655333 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f9ea408ae10 con 0x7f9eac0c58f0 2024-04-25T13:16:07.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.120+0000 7f9eaa7fc640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9e8c06c8f0 0x7f9e8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.120+0000 7f9eaa7fc640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9e8c06c8f0 0x7f9e8c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e94034000 tx=0x7f9e9402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:07.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.124+0000 7f9ea3fff640 1 -- 172.21.15.52:0/2546655333 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9ea40592a0 con 0x7f9eac0c58f0 2024-04-25T13:16:07.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:07.351+0000 7f9eb19cc640 1 -- 172.21.15.52:0/2546655333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9eac0cb860 con 0x7f9eac0c58f0 2024-04-25T13:16:08.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.003+0000 7f9ea3fff640 1 -- 172.21.15.52:0/2546655333 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f9eac0cb860 con 0x7f9eac0c58f0 2024-04-25T13:16:08.007 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T13:16:08.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.010+0000 7f9eb19cc640 1 -- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9e8c06c8f0 msgr2=0x7f9e8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.010+0000 7f9eb19cc640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9e8c06c8f0 0x7f9e8c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e94034000 tx=0x7f9e9402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:08.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.010+0000 7f9eb19cc640 1 -- 172.21.15.52:0/2546655333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eac0c58f0 msgr2=0x7f9eac0cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.010+0000 7f9eb19cc640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eac0c58f0 0x7f9eac0cf980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400c440 tx=0x7f9ea400c900 comp rx=0 tx=0).stop 2024-04-25T13:16:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.011+0000 7f9eb19cc640 1 -- 172.21.15.52:0/2546655333 shutdown_connections 2024-04-25T13:16:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.011+0000 7f9eb19cc640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9e8c06c8f0 0x7f9e8c06edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.011+0000 7f9eb19cc640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eac0cccf0 0x7f9eac156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.011+0000 7f9eb19cc640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eac155530 0x7f9eac157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.011+0000 7f9eb19cc640 1 --2- 172.21.15.52:0/2546655333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eac0c58f0 0x7f9eac0cf980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.011+0000 7f9eb19cc640 1 -- 172.21.15.52:0/2546655333 >> 172.21.15.52:0/2546655333 conn(0x7f9eac06d350 msgr2=0x7f9eac0c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:08.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.012+0000 7f9eb19cc640 1 -- 172.21.15.52:0/2546655333 shutdown_connections 2024-04-25T13:16:08.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.012+0000 7f9eb19cc640 1 -- 172.21.15.52:0/2546655333 wait complete. 2024-04-25T13:16:08.026 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T13:16:08.027 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T13:16:08.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.135+0000 7f3932810640 1 Processor -- start 2024-04-25T13:16:08.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.135+0000 7f3932810640 1 -- start start 2024-04-25T13:16:08.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f3932810640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f392c155130 0x7f392c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:08.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f3932810640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f392c0cde80 0x7f392c0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:08.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f3932810640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392c15e800 con 0x7f392c155510 2024-04-25T13:16:08.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f3932810640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f392c15e5d0 con 0x7f392c155130 2024-04-25T13:16:08.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f3932810640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f392c15bfa0 con 0x7f392c0cde80 2024-04-25T13:16:08.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f392bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f392c155130 0x7f392c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f392b7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f392c155510 0x7f392c073150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49658/0 (socket says 172.21.15.52:49658) 2024-04-25T13:16:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f392b7fe640 1 -- 172.21.15.52:0/1281613158 learned_addr learned my addr 172.21.15.52:0/1281613158 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f3930dad640 1 --2- 172.21.15.52:0/1281613158 >> v2:172.21.15.102:3300/0 conn(0x7f392c0cde80 0x7f392c0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f392bfff640 1 -- 172.21.15.52:0/1281613158 >> v2:172.21.15.102:3300/0 conn(0x7f392c0cde80 msgr2=0x7f392c0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f392bfff640 1 --2- 172.21.15.52:0/1281613158 >> v2:172.21.15.102:3300/0 conn(0x7f392c0cde80 0x7f392c0c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f392bfff640 1 -- 172.21.15.52:0/1281613158 >> v1:172.21.15.52:6789/0 conn(0x7f392c155510 legacy=0x7f392c073150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.136+0000 7f392bfff640 1 -- 172.21.15.52:0/1281613158 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c15eac0 con 0x7f392c155130 2024-04-25T13:16:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.137+0000 7f392bfff640 1 --2- 172.21.15.52:0/1281613158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c155130 0x7f392c15ba60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f392c0b3c10 tx=0x7f392002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed37b616145526d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.137+0000 7f392affd640 1 -- 172.21.15.52:0/1281613158 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920037070 con 0x7f392c155130 2024-04-25T13:16:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.137+0000 7f392affd640 1 -- 172.21.15.52:0/1281613158 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3920032440 con 0x7f392c155130 2024-04-25T13:16:08.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.137+0000 7f392affd640 1 -- 172.21.15.52:0/1281613158 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920032810 con 0x7f392c155130 2024-04-25T13:16:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.137+0000 7f3932810640 1 -- 172.21.15.52:0/1281613158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c155130 msgr2=0x7f392c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.137+0000 7f3932810640 1 --2- 172.21.15.52:0/1281613158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c155130 0x7f392c15ba60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f392c0b3c10 tx=0x7f392002a1e0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.138+0000 7f3932810640 1 -- 172.21.15.52:0/1281613158 shutdown_connections 2024-04-25T13:16:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.138+0000 7f3932810640 1 --2- 172.21.15.52:0/1281613158 >> v2:172.21.15.102:3300/0 conn(0x7f392c0cde80 0x7f392c0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.138+0000 7f3932810640 1 --2- 172.21.15.52:0/1281613158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c155130 0x7f392c15ba60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.138+0000 7f3932810640 1 -- 172.21.15.52:0/1281613158 >> 172.21.15.52:0/1281613158 conn(0x7f392c068360 msgr2=0x7f392c06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.138+0000 7f3932810640 1 -- 172.21.15.52:0/1281613158 shutdown_connections 2024-04-25T13:16:08.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.138+0000 7f3932810640 1 -- 172.21.15.52:0/1281613158 wait complete. 2024-04-25T13:16:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.139+0000 7f3932810640 1 Processor -- start 2024-04-25T13:16:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.139+0000 7f3932810640 1 -- start start 2024-04-25T13:16:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f3932810640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0cde80 0x7f392c14a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f3932810640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c155130 0x7f392c14e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f3932810640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392c155510 0x7f392c1455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f3932810640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f392c15f080 con 0x7f392c155130 2024-04-25T13:16:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f3932810640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0c57a0 con 0x7f392c155510 2024-04-25T13:16:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f3932810640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f392c15f360 con 0x7f392c0cde80 2024-04-25T13:16:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f392b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c155130 0x7f392c14e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:08.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f392b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c155130 0x7f392c14e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38828/0 (socket says 172.21.15.52:38828) 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f392b7fe640 1 -- 172.21.15.52:0/1864714776 learned_addr learned my addr 172.21.15.52:0/1864714776 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f3930dad640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392c155510 0x7f392c1455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f392bfff640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0cde80 0x7f392c14a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f392b7fe640 1 -- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0cde80 msgr2=0x7f392c14a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f392b7fe640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0cde80 0x7f392c14a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f392b7fe640 1 -- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392c155510 msgr2=0x7f392c1455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f392b7fe640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392c155510 0x7f392c1455c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f392b7fe640 1 -- 172.21.15.52:0/1864714776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c1f4840 con 0x7f392c155130 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f392b7fe640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c155130 0x7f392c14e3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f391c00c430 tx=0x7f391c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f3928ff9640 1 -- 172.21.15.52:0/1864714776 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c017070 con 0x7f392c155130 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f3928ff9640 1 -- 172.21.15.52:0/1864714776 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391c005ce0 con 0x7f392c155130 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f3932810640 1 -- 172.21.15.52:0/1864714776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c1f4b00 con 0x7f392c155130 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f3928ff9640 1 -- 172.21.15.52:0/1864714776 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c0072f0 con 0x7f392c155130 2024-04-25T13:16:08.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.140+0000 7f3932810640 1 -- 172.21.15.52:0/1864714776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c1f50c0 con 0x7f392c155130 2024-04-25T13:16:08.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.141+0000 7f3932810640 1 -- 172.21.15.52:0/1864714776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392c0b5d30 con 0x7f392c155130 2024-04-25T13:16:08.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.142+0000 7f3928ff9640 1 -- 172.21.15.52:0/1864714776 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f391c01a070 con 0x7f392c155130 2024-04-25T13:16:08.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.142+0000 7f3928ff9640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f391806c8f0 0x7f391806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:08.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.142+0000 7f3928ff9640 1 -- 172.21.15.52:0/1864714776 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f391c08af50 con 0x7f392c155130 2024-04-25T13:16:08.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.142+0000 7f392bfff640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f391806c8f0 0x7f391806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:08.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.143+0000 7f392bfff640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f391806c8f0 0x7f391806edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3920034000 tx=0x7f392002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:08.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.147+0000 7f3928ff9640 1 -- 172.21.15.52:0/1864714776 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f391c058ca0 con 0x7f392c155130 2024-04-25T13:16:08.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.339+0000 7f3932810640 1 -- 172.21.15.52:0/1864714776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f392c0cad50 con 0x7f392c155130 2024-04-25T13:16:08.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.989+0000 7f3928ff9640 1 -- 172.21.15.52:0/1864714776 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f391c05cfa0 con 0x7f392c155130 2024-04-25T13:16:08.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.992+0000 7f3932810640 1 -- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f391806c8f0 msgr2=0x7f391806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.992+0000 7f3932810640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f391806c8f0 0x7f391806edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3920034000 tx=0x7f392002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:08.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.992+0000 7f3932810640 1 -- 172.21.15.52:0/1864714776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c155130 msgr2=0x7f392c14e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:08.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.992+0000 7f3932810640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c155130 0x7f392c14e3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f391c00c430 tx=0x7f391c00c8f0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.992+0000 7f3932810640 1 -- 172.21.15.52:0/1864714776 shutdown_connections 2024-04-25T13:16:08.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.992+0000 7f3932810640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f391806c8f0 0x7f391806edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.992+0000 7f3932810640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392c155510 0x7f392c1455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.992+0000 7f3932810640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f392c155130 0x7f392c14e3c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.992+0000 7f3932810640 1 --2- 172.21.15.52:0/1864714776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0cde80 0x7f392c14a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:08.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.992+0000 7f3932810640 1 -- 172.21.15.52:0/1864714776 >> 172.21.15.52:0/1864714776 conn(0x7f392c068360 msgr2=0x7f392c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:08.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.992+0000 7f3932810640 1 -- 172.21.15.52:0/1864714776 shutdown_connections 2024-04-25T13:16:08.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:08.992+0000 7f3932810640 1 -- 172.21.15.52:0/1864714776 wait complete. 2024-04-25T13:16:09.007 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T13:16:09.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.122+0000 7f9edcf4b640 1 Processor -- start 2024-04-25T13:16:09.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.122+0000 7f9edcf4b640 1 -- start start 2024-04-25T13:16:09.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.123+0000 7f9edcf4b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ed8155370 0x7f9ed80cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.123+0000 7f9edcf4b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ed80cbf60 0x7f9ed80c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.123+0000 7f9edcf4b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed80cd110 con 0x7f9ed8155750 2024-04-25T13:16:09.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.123+0000 7f9edcf4b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed815e800 con 0x7f9ed80cbf60 2024-04-25T13:16:09.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.123+0000 7f9edcf4b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed815eae0 con 0x7f9ed8155370 2024-04-25T13:16:09.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.123+0000 7f9ed5d9b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9ed8155750 0x7f9ed80d0920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35752/0 (socket says 172.21.15.52:35752) 2024-04-25T13:16:09.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.123+0000 7f9ed5d9b640 1 -- 172.21.15.52:0/626419761 learned_addr learned my addr 172.21.15.52:0/626419761 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:09.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.123+0000 7f9ed6d9d640 1 --2- 172.21.15.52:0/626419761 >> v2:172.21.15.102:3300/0 conn(0x7f9ed80cbf60 0x7f9ed80c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.123+0000 7f9ed559a640 1 -- 172.21.15.52:0/626419761 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3925564060 0 0) 0x7f9ed80cd110 con 0x7f9ed8155750 2024-04-25T13:16:09.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.123+0000 7f9ed559a640 1 -- 172.21.15.52:0/626419761 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ec4003520 con 0x7f9ed8155750 2024-04-25T13:16:09.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.123+0000 7f9ed659c640 1 --2- 172.21.15.52:0/626419761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ed8155370 0x7f9ed80cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.124+0000 7f9ed559a640 1 -- 172.21.15.52:0/626419761 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 505034112 0 0) 0x7f9ec4003520 con 0x7f9ed8155750 2024-04-25T13:16:09.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.124+0000 7f9ed6d9d640 1 -- 172.21.15.52:0/626419761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ed8155370 msgr2=0x7f9ed80cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:09.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.124+0000 7f9ed6d9d640 1 --2- 172.21.15.52:0/626419761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ed8155370 0x7f9ed80cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.124+0000 7f9ed6d9d640 1 -- 172.21.15.52:0/626419761 >> v1:172.21.15.52:6789/0 conn(0x7f9ed8155750 legacy=0x7f9ed80d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:09.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.124+0000 7f9ed6d9d640 1 -- 172.21.15.52:0/626419761 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed815edc0 con 0x7f9ed80cbf60 2024-04-25T13:16:09.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.124+0000 7f9ed6d9d640 1 --2- 172.21.15.52:0/626419761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ed80cbf60 0x7f9ed80c58d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8009d90 tx=0x7f9ec802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b9403a216a646f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:09.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.125+0000 7f9ed559a640 1 -- 172.21.15.52:0/626419761 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0001690 con 0x7f9ed80cbf60 2024-04-25T13:16:09.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.125+0000 7f9ed559a640 1 -- 172.21.15.52:0/626419761 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec8007540 con 0x7f9ed80cbf60 2024-04-25T13:16:09.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.125+0000 7f9ed559a640 1 -- 172.21.15.52:0/626419761 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec80078f0 con 0x7f9ed80cbf60 2024-04-25T13:16:09.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.125+0000 7f9edcf4b640 1 -- 172.21.15.52:0/626419761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ed80cbf60 msgr2=0x7f9ed80c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:09.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.125+0000 7f9edcf4b640 1 --2- 172.21.15.52:0/626419761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ed80cbf60 0x7f9ed80c58d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8009d90 tx=0x7f9ec802a680 comp rx=0 tx=0).stop 2024-04-25T13:16:09.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.125+0000 7f9edcf4b640 1 -- 172.21.15.52:0/626419761 shutdown_connections 2024-04-25T13:16:09.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.125+0000 7f9edcf4b640 1 --2- 172.21.15.52:0/626419761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ed80cbf60 0x7f9ed80c58d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.125+0000 7f9edcf4b640 1 --2- 172.21.15.52:0/626419761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ed8155370 0x7f9ed80cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.125+0000 7f9edcf4b640 1 -- 172.21.15.52:0/626419761 >> 172.21.15.52:0/626419761 conn(0x7f9ed8073150 msgr2=0x7f9ed8073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:09.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.125+0000 7f9edcf4b640 1 -- 172.21.15.52:0/626419761 shutdown_connections 2024-04-25T13:16:09.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.125+0000 7f9edcf4b640 1 -- 172.21.15.52:0/626419761 wait complete. 2024-04-25T13:16:09.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.126+0000 7f9edcf4b640 1 Processor -- start 2024-04-25T13:16:09.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.127+0000 7f9edcf4b640 1 -- start start 2024-04-25T13:16:09.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.127+0000 7f9edcf4b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed80cbf60 0x7f9ed80ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.127+0000 7f9edcf4b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ed8155370 0x7f9ed81e4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.127+0000 7f9edcf4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ed8155750 0x7f9ed81e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.127+0000 7f9edcf4b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed80d1030 con 0x7f9ed80cbf60 2024-04-25T13:16:09.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.127+0000 7f9edcf4b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed815c0b0 con 0x7f9ed8155750 2024-04-25T13:16:09.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.127+0000 7f9edcf4b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed80d11b0 con 0x7f9ed8155370 2024-04-25T13:16:09.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.127+0000 7f9ed659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed80cbf60 0x7f9ed80ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.127+0000 7f9ed659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed80cbf60 0x7f9ed80ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55468/0 (socket says 172.21.15.52:55468) 2024-04-25T13:16:09.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.127+0000 7f9ed659c640 1 -- 172.21.15.52:0/712444630 learned_addr learned my addr 172.21.15.52:0/712444630 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:09.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.127+0000 7f9ed5d9b640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ed8155370 0x7f9ed81e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.127+0000 7f9ed6d9d640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ed8155750 0x7f9ed81e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.128+0000 7f9ed659c640 1 -- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ed8155370 msgr2=0x7f9ed81e4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:09.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.128+0000 7f9ed659c640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ed8155370 0x7f9ed81e4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.128+0000 7f9ed659c640 1 -- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ed8155750 msgr2=0x7f9ed81e4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:09.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.128+0000 7f9ed659c640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ed8155750 0x7f9ed81e4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:09.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.128+0000 7f9ed659c640 1 -- 172.21.15.52:0/712444630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed80cedb0 con 0x7f9ed80cbf60 2024-04-25T13:16:09.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.128+0000 7f9ed659c640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed80cbf60 0x7f9ed80ce870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000e9e0 tx=0x7f9ed000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:09.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.128+0000 7f9eceffd640 1 -- 172.21.15.52:0/712444630 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0017070 con 0x7f9ed80cbf60 2024-04-25T13:16:09.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.128+0000 7f9eceffd640 1 -- 172.21.15.52:0/712444630 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed000c9d0 con 0x7f9ed80cbf60 2024-04-25T13:16:09.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.128+0000 7f9edcf4b640 1 -- 172.21.15.52:0/712444630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed81e72f0 con 0x7f9ed80cbf60 2024-04-25T13:16:09.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.128+0000 7f9eceffd640 1 -- 172.21.15.52:0/712444630 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000cdc0 con 0x7f9ed80cbf60 2024-04-25T13:16:09.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.128+0000 7f9edcf4b640 1 -- 172.21.15.52:0/712444630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed815e220 con 0x7f9ed80cbf60 2024-04-25T13:16:09.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.129+0000 7f9edcf4b640 1 -- 172.21.15.52:0/712444630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed8068d30 con 0x7f9ed80cbf60 2024-04-25T13:16:09.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.130+0000 7f9eceffd640 1 -- 172.21.15.52:0/712444630 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ed001a070 con 0x7f9ed80cbf60 2024-04-25T13:16:09.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.130+0000 7f9eceffd640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9eb806c920 0x7f9eb806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:09.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.130+0000 7f9eceffd640 1 -- 172.21.15.52:0/712444630 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f9ed008bbb0 con 0x7f9ed80cbf60 2024-04-25T13:16:09.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.130+0000 7f9ed5d9b640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9eb806c920 0x7f9eb806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:09.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.131+0000 7f9ed5d9b640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9eb806c920 0x7f9eb806ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8158d60 tx=0x7f9ec0001d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:09.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.135+0000 7f9eceffd640 1 -- 172.21.15.52:0/712444630 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9ed0059860 con 0x7f9ed80cbf60 2024-04-25T13:16:09.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:09.320+0000 7f9edcf4b640 1 -- 172.21.15.52:0/712444630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9ed8154b90 con 0x7f9ed80cbf60 2024-04-25T13:16:09.641 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:16:09.644 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:16:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.011+0000 7f9eceffd640 1 -- 172.21.15.52:0/712444630 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f9ed005db60 con 0x7f9ed80cbf60 2024-04-25T13:16:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data_ec' created 2024-04-25T13:16:11.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.016+0000 7f9edcf4b640 1 -- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9eb806c920 msgr2=0x7f9eb806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:11.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.016+0000 7f9edcf4b640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9eb806c920 0x7f9eb806ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8158d60 tx=0x7f9ec0001d40 comp rx=0 tx=0).stop 2024-04-25T13:16:11.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.016+0000 7f9edcf4b640 1 -- 172.21.15.52:0/712444630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed80cbf60 msgr2=0x7f9ed80ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:11.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.016+0000 7f9edcf4b640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed80cbf60 0x7f9ed80ce870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000e9e0 tx=0x7f9ed000eea0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.016+0000 7f9edcf4b640 1 -- 172.21.15.52:0/712444630 shutdown_connections 2024-04-25T13:16:11.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.016+0000 7f9edcf4b640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9eb806c920 0x7f9eb806ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.016+0000 7f9edcf4b640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ed8155370 0x7f9ed81e4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.016+0000 7f9edcf4b640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ed8155750 0x7f9ed81e4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.016+0000 7f9edcf4b640 1 --2- 172.21.15.52:0/712444630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed80cbf60 0x7f9ed80ce870 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000e9e0 tx=0x7f9ed000eea0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.016+0000 7f9edcf4b640 1 -- 172.21.15.52:0/712444630 >> 172.21.15.52:0/712444630 conn(0x7f9ed8073150 msgr2=0x7f9ed8154450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.019+0000 7f9edcf4b640 1 -- 172.21.15.52:0/712444630 shutdown_connections 2024-04-25T13:16:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.020+0000 7f9edcf4b640 1 -- 172.21.15.52:0/712444630 wait complete. 2024-04-25T13:16:11.037 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T13:16:11.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.147+0000 7fed1c39b640 1 Processor -- start 2024-04-25T13:16:11.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.147+0000 7fed1c39b640 1 -- start start 2024-04-25T13:16:11.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1c39b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fed14155990 0x7fed140d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1c39b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed140d1180 0x7fed1415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1c39b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed1415d240 0x7fed1415b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1c39b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fed1415d690 con 0x7fed1415d240 2024-04-25T13:16:11.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1c39b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fed1415ebc0 con 0x7fed14155990 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1c39b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fed1415ee80 con 0x7fed140d1180 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1a938640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed1415d240 0x7fed1415b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1a938640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed1415d240 0x7fed1415b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55476/0 (socket says 172.21.15.52:55476) 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1a938640 1 -- 172.21.15.52:0/1493711140 learned_addr learned my addr 172.21.15.52:0/1493711140 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1a137640 1 --2- 172.21.15.52:0/1493711140 >> v2:172.21.15.102:3300/0 conn(0x7fed14155990 0x7fed140d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed19936640 1 --2- 172.21.15.52:0/1493711140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed140d1180 0x7fed1415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1a938640 1 -- 172.21.15.52:0/1493711140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed140d1180 msgr2=0x7fed1415cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1a938640 1 --2- 172.21.15.52:0/1493711140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed140d1180 0x7fed1415cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1a938640 1 -- 172.21.15.52:0/1493711140 >> v2:172.21.15.102:3300/0 conn(0x7fed14155990 msgr2=0x7fed140d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1a938640 1 --2- 172.21.15.52:0/1493711140 >> v2:172.21.15.102:3300/0 conn(0x7fed14155990 0x7fed140d0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed1a938640 1 -- 172.21.15.52:0/1493711140 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1415f160 con 0x7fed1415d240 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.148+0000 7fed19936640 1 --2- 172.21.15.52:0/1493711140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed140d1180 0x7fed1415cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:11.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.149+0000 7fed1a938640 1 --2- 172.21.15.52:0/1493711140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed1415d240 0x7fed1415b800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed1408e5e0 tx=0x7fed0c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d954aebba7e825c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:11.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.149+0000 7fed19135640 1 -- 172.21.15.52:0/1493711140 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c036070 con 0x7fed1415d240 2024-04-25T13:16:11.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.149+0000 7fed19135640 1 -- 172.21.15.52:0/1493711140 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0c031600 con 0x7fed1415d240 2024-04-25T13:16:11.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.149+0000 7fed19135640 1 -- 172.21.15.52:0/1493711140 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0319d0 con 0x7fed1415d240 2024-04-25T13:16:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.150+0000 7fed1c39b640 1 -- 172.21.15.52:0/1493711140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed1415d240 msgr2=0x7fed1415b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.150+0000 7fed1c39b640 1 --2- 172.21.15.52:0/1493711140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed1415d240 0x7fed1415b800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed1408e5e0 tx=0x7fed0c02a730 comp rx=0 tx=0).stop 2024-04-25T13:16:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.150+0000 7fed1c39b640 1 -- 172.21.15.52:0/1493711140 shutdown_connections 2024-04-25T13:16:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.150+0000 7fed1c39b640 1 --2- 172.21.15.52:0/1493711140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed1415d240 0x7fed1415b800 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.150+0000 7fed1c39b640 1 --2- 172.21.15.52:0/1493711140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed140d1180 0x7fed1415cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.150+0000 7fed1c39b640 1 --2- 172.21.15.52:0/1493711140 >> v2:172.21.15.102:3300/0 conn(0x7fed14155990 0x7fed140d0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.150+0000 7fed1c39b640 1 -- 172.21.15.52:0/1493711140 >> 172.21.15.52:0/1493711140 conn(0x7fed14074f30 msgr2=0x7fed14075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.150+0000 7fed1c39b640 1 -- 172.21.15.52:0/1493711140 shutdown_connections 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.150+0000 7fed1c39b640 1 -- 172.21.15.52:0/1493711140 wait complete. 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.151+0000 7fed1c39b640 1 Processor -- start 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.151+0000 7fed1c39b640 1 -- start start 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed1c39b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed140d1180 0x7fed141e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed1c39b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed14155990 0x7fed141f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed1c39b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed1415d240 0x7fed141e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed1c39b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fed1415fa00 con 0x7fed14155990 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed1c39b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fed1415f720 con 0x7fed1415d240 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed1c39b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fed1415bd40 con 0x7fed140d1180 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed19936640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed14155990 0x7fed141f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed19936640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed14155990 0x7fed141f52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55490/0 (socket says 172.21.15.52:55490) 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed19936640 1 -- 172.21.15.52:0/1872456615 learned_addr learned my addr 172.21.15.52:0/1872456615 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed1a137640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed140d1180 0x7fed141e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed1a938640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed1415d240 0x7fed141e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed19936640 1 -- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed140d1180 msgr2=0x7fed141e7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed19936640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed140d1180 0x7fed141e7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed19936640 1 -- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed1415d240 msgr2=0x7fed141e71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed19936640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed1415d240 0x7fed141e71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed19936640 1 -- 172.21.15.52:0/1872456615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed141f5810 con 0x7fed14155990 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed1a938640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed1415d240 0x7fed141e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.152+0000 7fed19936640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed14155990 0x7fed141f52d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed0400c7c0 tx=0x7fed0400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.153+0000 7fed0affd640 1 -- 172.21.15.52:0/1872456615 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed04015070 con 0x7fed14155990 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.153+0000 7fed0affd640 1 -- 172.21.15.52:0/1872456615 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed04007a30 con 0x7fed14155990 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.153+0000 7fed0affd640 1 -- 172.21.15.52:0/1872456615 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed04007e00 con 0x7fed14155990 2024-04-25T13:16:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.153+0000 7fed1c39b640 1 -- 172.21.15.52:0/1872456615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed141e8450 con 0x7fed14155990 2024-04-25T13:16:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.153+0000 7fed1c39b640 1 -- 172.21.15.52:0/1872456615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed141f16d0 con 0x7fed14155990 2024-04-25T13:16:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.154+0000 7fed1c39b640 1 -- 172.21.15.52:0/1872456615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed140c3e10 con 0x7fed14155990 2024-04-25T13:16:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.154+0000 7fed0affd640 1 -- 172.21.15.52:0/1872456615 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed04018070 con 0x7fed14155990 2024-04-25T13:16:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.155+0000 7fed0affd640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fecf806c8f0 0x7fecf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.155+0000 7fed0affd640 1 -- 172.21.15.52:0/1872456615 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7fed0408bd10 con 0x7fed14155990 2024-04-25T13:16:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.155+0000 7fed1a137640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fecf806c8f0 0x7fecf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.156+0000 7fed1a137640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fecf806c8f0 0x7fecf806edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed10006fd0 tx=0x7fed10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:11.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.160+0000 7fed0affd640 1 -- 172.21.15.52:0/1872456615 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed040597d0 con 0x7fed14155990 2024-04-25T13:16:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:11.343+0000 7fed1c39b640 1 -- 172.21.15.52:0/1872456615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fed140cc690 con 0x7fed14155990 2024-04-25T13:16:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.015+0000 7fed0affd640 1 -- 172.21.15.52:0/1872456615 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7fed0405dad0 con 0x7fed14155990 2024-04-25T13:16:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T13:16:12.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.022+0000 7fed1c39b640 1 -- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fecf806c8f0 msgr2=0x7fecf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:12.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.022+0000 7fed1c39b640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fecf806c8f0 0x7fecf806edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed10006fd0 tx=0x7fed10008040 comp rx=0 tx=0).stop 2024-04-25T13:16:12.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.022+0000 7fed1c39b640 1 -- 172.21.15.52:0/1872456615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed14155990 msgr2=0x7fed141f52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:12.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.022+0000 7fed1c39b640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed14155990 0x7fed141f52d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed0400c7c0 tx=0x7fed0400cc80 comp rx=0 tx=0).stop 2024-04-25T13:16:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.030+0000 7fed1c39b640 1 -- 172.21.15.52:0/1872456615 shutdown_connections 2024-04-25T13:16:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.030+0000 7fed1c39b640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fecf806c8f0 0x7fecf806edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.030+0000 7fed1c39b640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed1415d240 0x7fed141e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.030+0000 7fed1c39b640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed14155990 0x7fed141f52d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.030+0000 7fed1c39b640 1 --2- 172.21.15.52:0/1872456615 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed140d1180 0x7fed141e7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.030+0000 7fed1c39b640 1 -- 172.21.15.52:0/1872456615 >> 172.21.15.52:0/1872456615 conn(0x7fed14074f30 msgr2=0x7fed140cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.032+0000 7fed1c39b640 1 -- 172.21.15.52:0/1872456615 shutdown_connections 2024-04-25T13:16:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.032+0000 7fed1c39b640 1 -- 172.21.15.52:0/1872456615 wait complete. 2024-04-25T13:16:12.053 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T13:16:12.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.160+0000 7f6ea65c6640 1 Processor -- start 2024-04-25T13:16:12.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.160+0000 7f6ea65c6640 1 -- start start 2024-04-25T13:16:12.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.160+0000 7f6ea65c6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ea0155330 0x7f6ea00d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:12.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.160+0000 7f6ea65c6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea00c8960 con 0x7f6ea015cca0 2024-04-25T13:16:12.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.160+0000 7f6ea65c6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea00c8c40 con 0x7f6ea015b200 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.160+0000 7f6ea65c6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea00c8f20 con 0x7f6ea0155330 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6ea4b63640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6ea015cca0 0x7f6ea00c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35768/0 (socket says 172.21.15.52:35768) 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6ea4b63640 1 -- 172.21.15.52:0/4213913300 learned_addr learned my addr 172.21.15.52:0/4213913300 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9ffff640 1 --2- 172.21.15.52:0/4213913300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ea0155330 0x7f6ea00d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 629384738 0 0) 0x7f6ea00c8960 con 0x7f6ea015cca0 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e88003520 con 0x7f6ea015cca0 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 68733289 0 0) 0x7f6e88003520 con 0x7f6ea015cca0 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ea0155330 msgr2=0x7f6ea00d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 --2- 172.21.15.52:0/4213913300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ea0155330 0x7f6ea00d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 >> v1:172.21.15.102:6789/0 conn(0x7f6ea015b200 legacy=0x7f6ea015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea00c9200 con 0x7f6ea015cca0 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f6e98001a10 con 0x7f6ea015cca0 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 >> v1:172.21.15.52:6789/0 conn(0x7f6ea015cca0 legacy=0x7f6ea00c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 --2- 172.21.15.52:0/4213913300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e880039e0 0x7f6e88003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 --2- 172.21.15.52:0/4213913300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ea0155330 0x7f6e88004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 --2- 172.21.15.52:0/4213913300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e88004d40 0x7f6e880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea00c8f20 con 0x7f6e880039e0 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8800ba70 con 0x7f6e88004d40 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6e8800bc20 con 0x7f6ea0155330 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9ffff640 1 --2- 172.21.15.52:0/4213913300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e880039e0 0x7f6e88003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6e9f7fe640 1 --2- 172.21.15.52:0/4213913300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ea0155330 0x7f6e88004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.161+0000 7f6ea4b63640 1 --2- 172.21.15.52:0/4213913300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e88004d40 0x7f6e880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.162+0000 7f6e9ffff640 1 -- 172.21.15.52:0/4213913300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ea0155330 msgr2=0x7f6e88004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.162+0000 7f6e9ffff640 1 --2- 172.21.15.52:0/4213913300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ea0155330 0x7f6e88004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.162+0000 7f6e9ffff640 1 -- 172.21.15.52:0/4213913300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e88004d40 msgr2=0x7f6e880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.162+0000 7f6e9ffff640 1 --2- 172.21.15.52:0/4213913300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e88004d40 0x7f6e880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.162+0000 7f6e9ffff640 1 -- 172.21.15.52:0/4213913300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e88003520 con 0x7f6e880039e0 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.162+0000 7f6e9ffff640 1 --2- 172.21.15.52:0/4213913300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e880039e0 0x7f6e88003dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009ac0 tx=0x7f6e88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a8275338bd8f21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.162+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90036070 con 0x7f6e880039e0 2024-04-25T13:16:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.162+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e90031400 con 0x7f6e880039e0 2024-04-25T13:16:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.162+0000 7f6e9effd640 1 -- 172.21.15.52:0/4213913300 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90009690 con 0x7f6e880039e0 2024-04-25T13:16:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.163+0000 7f6ea65c6640 1 -- 172.21.15.52:0/4213913300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e880039e0 msgr2=0x7f6e88003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.163+0000 7f6ea65c6640 1 --2- 172.21.15.52:0/4213913300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e880039e0 0x7f6e88003dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009ac0 tx=0x7f6e88005830 comp rx=0 tx=0).stop 2024-04-25T13:16:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.163+0000 7f6ea4b63640 1 -- 172.21.15.52:0/4213913300 reap_dead start 2024-04-25T13:16:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.163+0000 7f6ea65c6640 1 -- 172.21.15.52:0/4213913300 shutdown_connections 2024-04-25T13:16:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.163+0000 7f6ea65c6640 1 -- 172.21.15.52:0/4213913300 >> 172.21.15.52:0/4213913300 conn(0x7f6ea0072570 msgr2=0x7f6ea0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.163+0000 7f6ea65c6640 1 -- 172.21.15.52:0/4213913300 shutdown_connections 2024-04-25T13:16:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.163+0000 7f6ea65c6640 1 -- 172.21.15.52:0/4213913300 wait complete. 2024-04-25T13:16:12.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.164+0000 7f6ea65c6640 1 Processor -- start 2024-04-25T13:16:12.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.164+0000 7f6ea65c6640 1 -- start start 2024-04-25T13:16:12.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6ea65c6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e880039e0 0x7f6ea01f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:12.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6ea65c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea01528a0 0x7f6ea014eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:12.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6ea65c6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ea01f18d0 0x7f6ea01534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:12.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6ea65c6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea0155710 con 0x7f6ea01528a0 2024-04-25T13:16:12.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6ea65c6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea00c97c0 con 0x7f6ea01f18d0 2024-04-25T13:16:12.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6ea65c6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea00d0530 con 0x7f6e880039e0 2024-04-25T13:16:12.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6e9f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea01528a0 0x7f6ea014eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:12.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6e9f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea01528a0 0x7f6ea014eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55512/0 (socket says 172.21.15.52:55512) 2024-04-25T13:16:12.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6e9f7fe640 1 -- 172.21.15.52:0/1510954752 learned_addr learned my addr 172.21.15.52:0/1510954752 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6ea4b63640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ea01f18d0 0x7f6ea01534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6e9ffff640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e880039e0 0x7f6ea01f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6e9f7fe640 1 -- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e880039e0 msgr2=0x7f6ea01f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6e9f7fe640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e880039e0 0x7f6ea01f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6e9f7fe640 1 -- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ea01f18d0 msgr2=0x7f6ea01534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6e9f7fe640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ea01f18d0 0x7f6ea01534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.165+0000 7f6e9f7fe640 1 -- 172.21.15.52:0/1510954752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea01f4720 con 0x7f6ea01528a0 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.166+0000 7f6e9f7fe640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea01528a0 0x7f6ea014eaf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400f860 tx=0x7f6e9400fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.166+0000 7f6e9cff9640 1 -- 172.21.15.52:0/1510954752 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e940052e0 con 0x7f6ea01528a0 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.166+0000 7f6e9cff9640 1 -- 172.21.15.52:0/1510954752 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e94018070 con 0x7f6ea01528a0 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.166+0000 7f6ea65c6640 1 -- 172.21.15.52:0/1510954752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea00cffb0 con 0x7f6ea01528a0 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.166+0000 7f6e9cff9640 1 -- 172.21.15.52:0/1510954752 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9400d910 con 0x7f6ea01528a0 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.166+0000 7f6ea65c6640 1 -- 172.21.15.52:0/1510954752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea01f0df0 con 0x7f6ea01528a0 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.167+0000 7f6ea65c6640 1 -- 172.21.15.52:0/1510954752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea0068f50 con 0x7f6ea01528a0 2024-04-25T13:16:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.167+0000 7f6e9cff9640 1 -- 172.21.15.52:0/1510954752 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e9400dab0 con 0x7f6ea01528a0 2024-04-25T13:16:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.168+0000 7f6e9cff9640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6e8c06c920 0x7f6e8c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.168+0000 7f6e9cff9640 1 -- 172.21.15.52:0/1510954752 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f6e9408bba0 con 0x7f6ea01528a0 2024-04-25T13:16:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.168+0000 7f6e9ffff640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6e8c06c920 0x7f6e8c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.168+0000 7f6e9ffff640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6e8c06c920 0x7f6e8c06ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e90033000 tx=0x7f6e90008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:12.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.172+0000 7f6e9cff9640 1 -- 172.21.15.52:0/1510954752 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e940596f0 con 0x7f6ea01528a0 2024-04-25T13:16:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:12.397+0000 7f6ea65c6640 1 -- 172.21.15.52:0/1510954752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f6ea0150180 con 0x7f6ea01528a0 2024-04-25T13:16:13.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.017+0000 7f6e9cff9640 1 -- 172.21.15.52:0/1510954752 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f6e9405d9f0 con 0x7f6ea01528a0 2024-04-25T13:16:13.018 INFO:teuthology.orchestra.run.smithi052.stderr:added data pool 4 to fsmap 2024-04-25T13:16:13.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.022+0000 7f6ea65c6640 1 -- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6e8c06c920 msgr2=0x7f6e8c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.022+0000 7f6ea65c6640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6e8c06c920 0x7f6e8c06ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e90033000 tx=0x7f6e90008030 comp rx=0 tx=0).stop 2024-04-25T13:16:13.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.022+0000 7f6ea65c6640 1 -- 172.21.15.52:0/1510954752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea01528a0 msgr2=0x7f6ea014eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.022+0000 7f6ea65c6640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea01528a0 0x7f6ea014eaf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400f860 tx=0x7f6e9400fd20 comp rx=0 tx=0).stop 2024-04-25T13:16:13.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.022+0000 7f6ea65c6640 1 -- 172.21.15.52:0/1510954752 shutdown_connections 2024-04-25T13:16:13.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.022+0000 7f6ea65c6640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6e8c06c920 0x7f6e8c06ede0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.022+0000 7f6ea65c6640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ea01f18d0 0x7f6ea01534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.022+0000 7f6ea65c6640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ea01528a0 0x7f6ea014eaf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.022+0000 7f6ea65c6640 1 --2- 172.21.15.52:0/1510954752 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e880039e0 0x7f6ea01f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.022+0000 7f6ea65c6640 1 -- 172.21.15.52:0/1510954752 >> 172.21.15.52:0/1510954752 conn(0x7f6ea0072570 msgr2=0x7f6ea015b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:13.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.023+0000 7f6ea65c6640 1 -- 172.21.15.52:0/1510954752 shutdown_connections 2024-04-25T13:16:13.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.023+0000 7f6ea65c6640 1 -- 172.21.15.52:0/1510954752 wait complete. 2024-04-25T13:16:13.036 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.142+0000 7fcf5cb30640 1 Processor -- start 2024-04-25T13:16:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.142+0000 7fcf5cb30640 1 -- start start 2024-04-25T13:16:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf5cb30640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf580b3c00 0x7fcf580b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf5cb30640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcf580b5450 0x7fcf580d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf5cb30640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf581558c0 con 0x7fcf581554e0 2024-04-25T13:16:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf5cb30640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcf580b4a80 con 0x7fcf580b5450 2024-04-25T13:16:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf5cb30640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcf580cb8c0 con 0x7fcf580b3c00 2024-04-25T13:16:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf56d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcf580b5450 0x7fcf580d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf5659c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcf581554e0 0x7fcf5815f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35770/0 (socket says 172.21.15.52:35770) 2024-04-25T13:16:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf5659c640 1 -- 172.21.15.52:0/3809436270 learned_addr learned my addr 172.21.15.52:0/3809436270 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf4ffff640 1 --2- 172.21.15.52:0/3809436270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf580b3c00 0x7fcf580b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf56d9d640 1 -- 172.21.15.52:0/3809436270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf580b3c00 msgr2=0x7fcf580b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf56d9d640 1 --2- 172.21.15.52:0/3809436270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf580b3c00 0x7fcf580b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf56d9d640 1 -- 172.21.15.52:0/3809436270 >> v1:172.21.15.52:6789/0 conn(0x7fcf581554e0 legacy=0x7fcf5815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf56d9d640 1 -- 172.21.15.52:0/3809436270 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf580cbba0 con 0x7fcf580b5450 2024-04-25T13:16:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.143+0000 7fcf4ffff640 1 --2- 172.21.15.52:0/3809436270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf580b3c00 0x7fcf580b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.144+0000 7fcf56d9d640 1 --2- 172.21.15.52:0/3809436270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf580b5450 0x7fcf580d08a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcf50009d90 tx=0x7fcf5002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d0263dfdbf8d8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.144+0000 7fcf55d9b640 1 -- 172.21.15.52:0/3809436270 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50007740 con 0x7fcf580b5450 2024-04-25T13:16:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.144+0000 7fcf55d9b640 1 -- 172.21.15.52:0/3809436270 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf500078e0 con 0x7fcf580b5450 2024-04-25T13:16:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.144+0000 7fcf55d9b640 1 -- 172.21.15.52:0/3809436270 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50007cb0 con 0x7fcf580b5450 2024-04-25T13:16:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.144+0000 7fcf5cb30640 1 -- 172.21.15.52:0/3809436270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf580b5450 msgr2=0x7fcf580d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.144+0000 7fcf5cb30640 1 --2- 172.21.15.52:0/3809436270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf580b5450 0x7fcf580d08a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcf50009d90 tx=0x7fcf5002a6f0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.144+0000 7fcf5cb30640 1 -- 172.21.15.52:0/3809436270 shutdown_connections 2024-04-25T13:16:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.144+0000 7fcf5cb30640 1 --2- 172.21.15.52:0/3809436270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf580b5450 0x7fcf580d08a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.144+0000 7fcf5cb30640 1 --2- 172.21.15.52:0/3809436270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf580b3c00 0x7fcf580b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.144+0000 7fcf5cb30640 1 -- 172.21.15.52:0/3809436270 >> 172.21.15.52:0/3809436270 conn(0x7fcf58074d50 msgr2=0x7fcf58075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.144+0000 7fcf5cb30640 1 -- 172.21.15.52:0/3809436270 shutdown_connections 2024-04-25T13:16:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.145+0000 7fcf5cb30640 1 -- 172.21.15.52:0/3809436270 wait complete. 2024-04-25T13:16:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.146+0000 7fcf5cb30640 1 Processor -- start 2024-04-25T13:16:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.146+0000 7fcf5cb30640 1 -- start start 2024-04-25T13:16:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.146+0000 7fcf5cb30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf580b3c00 0x7fcf5814b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.146+0000 7fcf5cb30640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf580b5450 0x7fcf5814cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.146+0000 7fcf5cb30640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf581554e0 0x7fcf5814d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5cb30640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcf580b4710 con 0x7fcf580b3c00 2024-04-25T13:16:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5cb30640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcf580b4430 con 0x7fcf581554e0 2024-04-25T13:16:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5cb30640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcf580b3580 con 0x7fcf580b5450 2024-04-25T13:16:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf580b3c00 0x7fcf5814b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf580b3c00 0x7fcf5814b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55524/0 (socket says 172.21.15.52:55524) 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5659c640 1 -- 172.21.15.52:0/279071977 learned_addr learned my addr 172.21.15.52:0/279071977 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf56d9d640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf581554e0 0x7fcf5814d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf4ffff640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf580b5450 0x7fcf5814cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5659c640 1 -- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf580b5450 msgr2=0x7fcf5814cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5659c640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf580b5450 0x7fcf5814cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5659c640 1 -- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf581554e0 msgr2=0x7fcf5814d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5659c640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf581554e0 0x7fcf5814d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5659c640 1 -- 172.21.15.52:0/279071977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf581e18a0 con 0x7fcf580b3c00 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf56d9d640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf581554e0 0x7fcf5814d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5659c640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf580b3c00 0x7fcf5814b500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c400 tx=0x7fcf4800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf4effd640 1 -- 172.21.15.52:0/279071977 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48017070 con 0x7fcf580b3c00 2024-04-25T13:16:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf4effd640 1 -- 172.21.15.52:0/279071977 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf48005ce0 con 0x7fcf580b3c00 2024-04-25T13:16:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5cb30640 1 -- 172.21.15.52:0/279071977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5814c240 con 0x7fcf580b3c00 2024-04-25T13:16:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf4effd640 1 -- 172.21.15.52:0/279071977 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf480072f0 con 0x7fcf580b3c00 2024-04-25T13:16:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.147+0000 7fcf5cb30640 1 -- 172.21.15.52:0/279071977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5814af40 con 0x7fcf580b3c00 2024-04-25T13:16:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.148+0000 7fcf5cb30640 1 -- 172.21.15.52:0/279071977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf580cec90 con 0x7fcf580b3c00 2024-04-25T13:16:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.149+0000 7fcf4effd640 1 -- 172.21.15.52:0/279071977 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf4801a070 con 0x7fcf580b3c00 2024-04-25T13:16:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.149+0000 7fcf4effd640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcf3806c8f0 0x7fcf3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.149+0000 7fcf4effd640 1 -- 172.21.15.52:0/279071977 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcf4808b210 con 0x7fcf580b3c00 2024-04-25T13:16:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.149+0000 7fcf4ffff640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcf3806c8f0 0x7fcf3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.150+0000 7fcf4ffff640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcf3806c8f0 0x7fcf3806edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcf5814f460 tx=0x7fcf40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:13.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.154+0000 7fcf4effd640 1 -- 172.21.15.52:0/279071977 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf580cec90 con 0x7fcf580b3c00 2024-04-25T13:16:13.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.382+0000 7fcf5cb30640 1 -- 172.21.15.52:0/279071977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf58068e40 con 0x7fcf580b3c00 2024-04-25T13:16:13.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.382+0000 7fcf4effd640 1 -- 172.21.15.52:0/279071977 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6823 (secure 0 0 0) 0x7fcf581558c0 con 0x7fcf580b3c00 2024-04-25T13:16:13.382 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:13.383 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2650846419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2650846419},{"type":"v1","addr":"172.21.15.102:6837","nonce":2650846419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6838/1508646651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":1508646651},{"type":"v1","addr":"172.21.15.102:6838","nonce":1508646651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/1980846137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1980846137},{"type":"v1","addr":"172.21.15.102:6839","nonce":1980846137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/714334205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":714334205},{"type":"v1","addr":"172.21.15.52:6835","nonce":714334205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3228537118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3228537118},{"type":"v1","addr":"172.21.15.52:6834","nonce":3228537118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:07.352382+0000","modified":"2024-04-25T13:16:12.399023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"e","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.52:6837/413759311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":413759311},{"type":"v1","addr":"172.21.15.52:6837","nonce":413759311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T13:16:13.383 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-25T13:16:13.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.384+0000 7fcf5cb30640 1 -- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcf3806c8f0 msgr2=0x7fcf3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.384+0000 7fcf5cb30640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcf3806c8f0 0x7fcf3806edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcf5814f460 tx=0x7fcf40008040 comp rx=0 tx=0).stop 2024-04-25T13:16:13.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.384+0000 7fcf5cb30640 1 -- 172.21.15.52:0/279071977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf580b3c00 msgr2=0x7fcf5814b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.384+0000 7fcf5cb30640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf580b3c00 0x7fcf5814b500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c400 tx=0x7fcf4800c8c0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.384+0000 7fcf5cb30640 1 -- 172.21.15.52:0/279071977 shutdown_connections 2024-04-25T13:16:13.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.384+0000 7fcf5cb30640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcf3806c8f0 0x7fcf3806edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.384+0000 7fcf5cb30640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf580b5450 0x7fcf5814cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.384+0000 7fcf5cb30640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf581554e0 0x7fcf5814d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.384+0000 7fcf5cb30640 1 --2- 172.21.15.52:0/279071977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf580b3c00 0x7fcf5814b500 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.384+0000 7fcf5cb30640 1 -- 172.21.15.52:0/279071977 >> 172.21.15.52:0/279071977 conn(0x7fcf58074d50 msgr2=0x7fcf58150c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:13.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.384+0000 7fcf5cb30640 1 -- 172.21.15.52:0/279071977 shutdown_connections 2024-04-25T13:16:13.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.384+0000 7fcf5cb30640 1 -- 172.21.15.52:0/279071977 wait complete. 2024-04-25T13:16:13.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9f1660640 1 Processor -- start 2024-04-25T13:16:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9f1660640 1 -- start start 2024-04-25T13:16:13.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9f1660640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb9ec0b3c00 0x7fb9ec0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9f1660640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9ec0b5450 0x7fb9ec0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9f1660640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ec1558c0 con 0x7fb9ec1554e0 2024-04-25T13:16:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9f1660640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ec0b4a80 con 0x7fb9ec0b5450 2024-04-25T13:16:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9f1660640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ec0cb8c0 con 0x7fb9ec0b3c00 2024-04-25T13:16:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9eb7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9ec0b5450 0x7fb9ec0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9eaffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb9ec1554e0 0x7fb9ec15f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35780/0 (socket says 172.21.15.52:35780) 2024-04-25T13:16:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9eaffd640 1 -- 172.21.15.52:0/2733632438 learned_addr learned my addr 172.21.15.52:0/2733632438 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9e3fff640 1 --2- 172.21.15.52:0/2733632438 >> v2:172.21.15.102:3300/0 conn(0x7fb9ec0b3c00 0x7fb9ec0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9eb7fe640 1 -- 172.21.15.52:0/2733632438 >> v2:172.21.15.102:3300/0 conn(0x7fb9ec0b3c00 msgr2=0x7fb9ec0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9eb7fe640 1 --2- 172.21.15.52:0/2733632438 >> v2:172.21.15.102:3300/0 conn(0x7fb9ec0b3c00 0x7fb9ec0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9eb7fe640 1 -- 172.21.15.52:0/2733632438 >> v1:172.21.15.52:6789/0 conn(0x7fb9ec1554e0 legacy=0x7fb9ec15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9eb7fe640 1 -- 172.21.15.52:0/2733632438 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec0cbba0 con 0x7fb9ec0b5450 2024-04-25T13:16:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.497+0000 7fb9ea7fc640 1 -- 172.21.15.52:0/2733632438 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2427898257 0 0) 0x7fb9dc001110 con 0x7fb9ec1554e0 2024-04-25T13:16:13.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.498+0000 7fb9eb7fe640 1 --2- 172.21.15.52:0/2733632438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9ec0b5450 0x7fb9ec0d08a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0b6040 tx=0x7fb9e402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e292b39e9055c1dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.498+0000 7fb9ea7fc640 1 -- 172.21.15.52:0/2733632438 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4007740 con 0x7fb9ec0b5450 2024-04-25T13:16:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.498+0000 7fb9ea7fc640 1 -- 172.21.15.52:0/2733632438 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e40078e0 con 0x7fb9ec0b5450 2024-04-25T13:16:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.498+0000 7fb9ea7fc640 1 -- 172.21.15.52:0/2733632438 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4007cb0 con 0x7fb9ec0b5450 2024-04-25T13:16:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.499+0000 7fb9f1660640 1 -- 172.21.15.52:0/2733632438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9ec0b5450 msgr2=0x7fb9ec0d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.499+0000 7fb9f1660640 1 --2- 172.21.15.52:0/2733632438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9ec0b5450 0x7fb9ec0d08a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0b6040 tx=0x7fb9e402a710 comp rx=0 tx=0).stop 2024-04-25T13:16:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.499+0000 7fb9f1660640 1 -- 172.21.15.52:0/2733632438 shutdown_connections 2024-04-25T13:16:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.499+0000 7fb9f1660640 1 --2- 172.21.15.52:0/2733632438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9ec0b5450 0x7fb9ec0d08a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.499+0000 7fb9f1660640 1 --2- 172.21.15.52:0/2733632438 >> v2:172.21.15.102:3300/0 conn(0x7fb9ec0b3c00 0x7fb9ec0b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.499+0000 7fb9f1660640 1 -- 172.21.15.52:0/2733632438 >> 172.21.15.52:0/2733632438 conn(0x7fb9ec074d50 msgr2=0x7fb9ec075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.499+0000 7fb9f1660640 1 -- 172.21.15.52:0/2733632438 shutdown_connections 2024-04-25T13:16:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.499+0000 7fb9f1660640 1 -- 172.21.15.52:0/2733632438 wait complete. 2024-04-25T13:16:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.500+0000 7fb9f1660640 1 Processor -- start 2024-04-25T13:16:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.500+0000 7fb9f1660640 1 -- start start 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9f1660640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9ec0b3c00 0x7fb9ec14c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9f1660640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9ec0b5450 0x7fb9ec147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9f1660640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9ec1554e0 0x7fb9ec148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9f1660640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec0b4710 con 0x7fb9ec0b5450 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9f1660640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec0b4430 con 0x7fb9ec1554e0 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9f1660640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb9ec0b3580 con 0x7fb9ec0b3c00 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9e3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9ec0b5450 0x7fb9ec147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9e3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9ec0b5450 0x7fb9ec147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55540/0 (socket says 172.21.15.52:55540) 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9e3fff640 1 -- 172.21.15.52:0/3840875303 learned_addr learned my addr 172.21.15.52:0/3840875303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9eb7fe640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9ec1554e0 0x7fb9ec148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9eaffd640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9ec0b3c00 0x7fb9ec14c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9e3fff640 1 -- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9ec0b3c00 msgr2=0x7fb9ec14c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9e3fff640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9ec0b3c00 0x7fb9ec14c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9e3fff640 1 -- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9ec1554e0 msgr2=0x7fb9ec148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9e3fff640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9ec1554e0 0x7fb9ec148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9e3fff640 1 -- 172.21.15.52:0/3840875303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec1f0d90 con 0x7fb9ec0b5450 2024-04-25T13:16:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9e3fff640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9ec0b5450 0x7fb9ec147e00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400d5f0 tx=0x7fb9d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9e37fe640 1 -- 172.21.15.52:0/3840875303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40125f0 con 0x7fb9ec0b5450 2024-04-25T13:16:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9e37fe640 1 -- 172.21.15.52:0/3840875303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d4019070 con 0x7fb9ec0b5450 2024-04-25T13:16:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9f1660640 1 -- 172.21.15.52:0/3840875303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ec0c9ae0 con 0x7fb9ec0b5450 2024-04-25T13:16:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9e37fe640 1 -- 172.21.15.52:0/3840875303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40129d0 con 0x7fb9ec0b5450 2024-04-25T13:16:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.501+0000 7fb9f1660640 1 -- 172.21.15.52:0/3840875303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ec0ca0a0 con 0x7fb9ec0b5450 2024-04-25T13:16:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.502+0000 7fb9f1660640 1 -- 172.21.15.52:0/3840875303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ec1f0f60 con 0x7fb9ec0b5450 2024-04-25T13:16:13.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.503+0000 7fb9e37fe640 1 -- 172.21.15.52:0/3840875303 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9d4012b70 con 0x7fb9ec0b5450 2024-04-25T13:16:13.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.503+0000 7fb9e37fe640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb9cc06c920 0x7fb9cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.503+0000 7fb9e37fe640 1 -- 172.21.15.52:0/3840875303 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb9d408c2d0 con 0x7fb9ec0b5450 2024-04-25T13:16:13.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.503+0000 7fb9eaffd640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb9cc06c920 0x7fb9cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.504+0000 7fb9eaffd640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb9cc06c920 0x7fb9cc06ede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc000f60 tx=0x7fb9dc007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.509+0000 7fb9e37fe640 1 -- 172.21.15.52:0/3840875303 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb9d4059c40 con 0x7fb9ec0b5450 2024-04-25T13:16:13.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.699+0000 7fb9f1660640 1 -- 172.21.15.52:0/3840875303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9ec068e40 con 0x7fb9ec0b5450 2024-04-25T13:16:13.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.700+0000 7fb9e37fe640 1 -- 172.21.15.52:0/3840875303 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18503 (secure 0 0 0) 0x7fb9d405df40 con 0x7fb9ec0b5450 2024-04-25T13:16:13.700 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:13.701 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:12.398832+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.702+0000 7fb9f1660640 1 -- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb9cc06c920 msgr2=0x7fb9cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.702+0000 7fb9f1660640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb9cc06c920 0x7fb9cc06ede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc000f60 tx=0x7fb9dc007b50 comp rx=0 tx=0).stop 2024-04-25T13:16:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.702+0000 7fb9f1660640 1 -- 172.21.15.52:0/3840875303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9ec0b5450 msgr2=0x7fb9ec147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.702+0000 7fb9f1660640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9ec0b5450 0x7fb9ec147e00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400d5f0 tx=0x7fb9d400dab0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.703+0000 7fb9f1660640 1 -- 172.21.15.52:0/3840875303 shutdown_connections 2024-04-25T13:16:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.703+0000 7fb9f1660640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb9cc06c920 0x7fb9cc06ede0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.703+0000 7fb9f1660640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9ec1554e0 0x7fb9ec148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.703+0000 7fb9f1660640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9ec0b5450 0x7fb9ec147e00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.703+0000 7fb9f1660640 1 --2- 172.21.15.52:0/3840875303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9ec0b3c00 0x7fb9ec14c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.703+0000 7fb9f1660640 1 -- 172.21.15.52:0/3840875303 >> 172.21.15.52:0/3840875303 conn(0x7fb9ec074d50 msgr2=0x7fb9ec0cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:13.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.703+0000 7fb9f1660640 1 -- 172.21.15.52:0/3840875303 shutdown_connections 2024-04-25T13:16:13.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.703+0000 7fb9f1660640 1 -- 172.21.15.52:0/3840875303 wait complete. 2024-04-25T13:16:13.714 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:13.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.814+0000 7f2c38129640 1 Processor -- start 2024-04-25T13:16:13.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.814+0000 7f2c38129640 1 -- start start 2024-04-25T13:16:13.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.814+0000 7f2c38129640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301554e0 0x7f2c3015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.814+0000 7f2c38129640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2c300b3c00 0x7f2c300b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.814+0000 7f2c38129640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c301558c0 con 0x7f2c300b5450 2024-04-25T13:16:13.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.814+0000 7f2c38129640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2c300b4a80 con 0x7f2c300b3c00 2024-04-25T13:16:13.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.814+0000 7f2c38129640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3015f630 con 0x7f2c301554e0 2024-04-25T13:16:13.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c366c6640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2c300b5450 0x7f2c300d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35796/0 (socket says 172.21.15.52:35796) 2024-04-25T13:16:13.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c366c6640 1 -- 172.21.15.52:0/591878567 learned_addr learned my addr 172.21.15.52:0/591878567 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c35ec5640 1 --2- 172.21.15.52:0/591878567 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301554e0 0x7f2c3015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c356c4640 1 --2- 172.21.15.52:0/591878567 >> v2:172.21.15.102:3300/0 conn(0x7f2c300b3c00 0x7f2c300b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552990792 0 0) 0x7f2c20001490 con 0x7f2c300b5450 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c18003520 con 0x7f2c300b5450 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1241351933 0 0) 0x7f2c18003520 con 0x7f2c300b5450 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301554e0 msgr2=0x7f2c3015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 --2- 172.21.15.52:0/591878567 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301554e0 0x7f2c3015f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 >> v2:172.21.15.102:3300/0 conn(0x7f2c300b3c00 msgr2=0x7f2c300b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 --2- 172.21.15.52:0/591878567 >> v2:172.21.15.102:3300/0 conn(0x7f2c300b3c00 0x7f2c300b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c300cb8c0 con 0x7f2c300b5450 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f2c20001bc0 con 0x7f2c300b5450 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 >> v1:172.21.15.52:6789/0 conn(0x7f2c300b5450 legacy=0x7f2c300d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 --2- 172.21.15.52:0/591878567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c180039b0 0x7f2c18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 --2- 172.21.15.52:0/591878567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18004800 0x7f2c18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 --2- 172.21.15.52:0/591878567 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301554e0 0x7f2c180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2c300b4a80 con 0x7f2c18004800 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3015f630 con 0x7f2c180039b0 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1800b9c0 con 0x7f2c301554e0 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c356c4640 1 --2- 172.21.15.52:0/591878567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18004800 0x7f2c18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c35ec5640 1 --2- 172.21.15.52:0/591878567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c180039b0 0x7f2c18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c366c6640 1 --2- 172.21.15.52:0/591878567 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301554e0 0x7f2c180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.815+0000 7f2c356c4640 1 -- 172.21.15.52:0/591878567 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301554e0 msgr2=0x7f2c180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.816+0000 7f2c356c4640 1 --2- 172.21.15.52:0/591878567 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301554e0 0x7f2c180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.816+0000 7f2c356c4640 1 -- 172.21.15.52:0/591878567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c180039b0 msgr2=0x7f2c18003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.816+0000 7f2c356c4640 1 --2- 172.21.15.52:0/591878567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c180039b0 0x7f2c18003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.816+0000 7f2c356c4640 1 -- 172.21.15.52:0/591878567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c18003520 con 0x7f2c18004800 2024-04-25T13:16:13.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.816+0000 7f2c356c4640 1 --2- 172.21.15.52:0/591878567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18004800 0x7f2c18004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009ac0 tx=0x7f2c18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab67ec53ba336d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:13.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.816+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24036070 con 0x7f2c18004800 2024-04-25T13:16:13.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.816+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c24031400 con 0x7f2c18004800 2024-04-25T13:16:13.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.816+0000 7f2c34ec3640 1 -- 172.21.15.52:0/591878567 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24009690 con 0x7f2c18004800 2024-04-25T13:16:13.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.817+0000 7f2c38129640 1 -- 172.21.15.52:0/591878567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18004800 msgr2=0x7f2c18004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.817+0000 7f2c38129640 1 --2- 172.21.15.52:0/591878567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18004800 0x7f2c18004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009ac0 tx=0x7f2c18005830 comp rx=0 tx=0).stop 2024-04-25T13:16:13.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.817+0000 7f2c366c6640 1 -- 172.21.15.52:0/591878567 reap_dead start 2024-04-25T13:16:13.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.817+0000 7f2c38129640 1 -- 172.21.15.52:0/591878567 shutdown_connections 2024-04-25T13:16:13.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.817+0000 7f2c38129640 1 -- 172.21.15.52:0/591878567 >> 172.21.15.52:0/591878567 conn(0x7f2c30074d50 msgr2=0x7f2c30075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:13.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.817+0000 7f2c38129640 1 -- 172.21.15.52:0/591878567 shutdown_connections 2024-04-25T13:16:13.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.817+0000 7f2c38129640 1 -- 172.21.15.52:0/591878567 wait complete. 2024-04-25T13:16:13.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.818+0000 7f2c38129640 1 Processor -- start 2024-04-25T13:16:13.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.818+0000 7f2c38129640 1 -- start start 2024-04-25T13:16:13.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c38129640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18004800 0x7f2c301f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c38129640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c301f0e90 0x7f2c300cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c38129640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301e6da0 0x7f2c3015c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c38129640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2c300b4430 con 0x7f2c18004800 2024-04-25T13:16:13.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c38129640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c300b4150 con 0x7f2c301f0e90 2024-04-25T13:16:13.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c38129640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2c300b4710 con 0x7f2c301e6da0 2024-04-25T13:16:13.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c35ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18004800 0x7f2c301f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c35ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18004800 0x7f2c301f4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55564/0 (socket says 172.21.15.52:55564) 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c35ec5640 1 -- 172.21.15.52:0/3880844229 learned_addr learned my addr 172.21.15.52:0/3880844229 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c356c4640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c301f0e90 0x7f2c300cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c366c6640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301e6da0 0x7f2c3015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c35ec5640 1 -- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301e6da0 msgr2=0x7f2c3015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c35ec5640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301e6da0 0x7f2c3015c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c35ec5640 1 -- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c301f0e90 msgr2=0x7f2c300cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c35ec5640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c301f0e90 0x7f2c300cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c35ec5640 1 -- 172.21.15.52:0/3880844229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3015e770 con 0x7f2c18004800 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c366c6640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301e6da0 0x7f2c3015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c356c4640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c301f0e90 0x7f2c300cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.819+0000 7f2c35ec5640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18004800 0x7f2c301f4e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c280119d0 tx=0x7f2c28011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.820+0000 7f2c2e7fc640 1 -- 172.21.15.52:0/3880844229 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2800fb50 con 0x7f2c18004800 2024-04-25T13:16:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.820+0000 7f2c2e7fc640 1 -- 172.21.15.52:0/3880844229 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2800fcf0 con 0x7f2c18004800 2024-04-25T13:16:13.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.820+0000 7f2c38129640 1 -- 172.21.15.52:0/3880844229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3015ea10 con 0x7f2c18004800 2024-04-25T13:16:13.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.820+0000 7f2c2e7fc640 1 -- 172.21.15.52:0/3880844229 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2800fea0 con 0x7f2c18004800 2024-04-25T13:16:13.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.820+0000 7f2c38129640 1 -- 172.21.15.52:0/3880844229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c301f4610 con 0x7f2c18004800 2024-04-25T13:16:13.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.821+0000 7f2c38129640 1 -- 172.21.15.52:0/3880844229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c300c8eb0 con 0x7f2c18004800 2024-04-25T13:16:13.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.821+0000 7f2c2e7fc640 1 -- 172.21.15.52:0/3880844229 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c28012040 con 0x7f2c18004800 2024-04-25T13:16:13.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.821+0000 7f2c2e7fc640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2c1c06c8f0 0x7f2c1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:13.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.821+0000 7f2c2e7fc640 1 -- 172.21.15.52:0/3880844229 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2c2808c530 con 0x7f2c18004800 2024-04-25T13:16:13.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.822+0000 7f2c356c4640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2c1c06c8f0 0x7f2c1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:13.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.822+0000 7f2c356c4640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2c1c06c8f0 0x7f2c1c06edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2c24033000 tx=0x7f2c24008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:13.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:13.826+0000 7f2c2e7fc640 1 -- 172.21.15.52:0/3880844229 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c28019030 con 0x7f2c18004800 2024-04-25T13:16:14.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.015+0000 7f2c38129640 1 -- 172.21.15.52:0/3880844229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c301f4400 con 0x7f2c18004800 2024-04-25T13:16:14.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.016+0000 7f2c2e7fc640 1 -- 172.21.15.52:0/3880844229 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18503 (secure 0 0 0) 0x7f2c2805a580 con 0x7f2c18004800 2024-04-25T13:16:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:14.017 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:12.398832+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.018+0000 7f2c38129640 1 -- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2c1c06c8f0 msgr2=0x7f2c1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.018+0000 7f2c38129640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2c1c06c8f0 0x7f2c1c06edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2c24033000 tx=0x7f2c24008030 comp rx=0 tx=0).stop 2024-04-25T13:16:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.018+0000 7f2c38129640 1 -- 172.21.15.52:0/3880844229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18004800 msgr2=0x7f2c301f4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.018+0000 7f2c38129640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18004800 0x7f2c301f4e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c280119d0 tx=0x7f2c28011e90 comp rx=0 tx=0).stop 2024-04-25T13:16:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.019+0000 7f2c38129640 1 -- 172.21.15.52:0/3880844229 shutdown_connections 2024-04-25T13:16:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.019+0000 7f2c38129640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2c1c06c8f0 0x7f2c1c06edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.019+0000 7f2c38129640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c301e6da0 0x7f2c3015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.019+0000 7f2c38129640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c301f0e90 0x7f2c300cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.019+0000 7f2c38129640 1 --2- 172.21.15.52:0/3880844229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18004800 0x7f2c301f4e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.019+0000 7f2c38129640 1 -- 172.21.15.52:0/3880844229 >> 172.21.15.52:0/3880844229 conn(0x7f2c30074d50 msgr2=0x7f2c30075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:14.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.019+0000 7f2c38129640 1 -- 172.21.15.52:0/3880844229 shutdown_connections 2024-04-25T13:16:14.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.019+0000 7f2c38129640 1 -- 172.21.15.52:0/3880844229 wait complete. 2024-04-25T13:16:14.046 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:14.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.148+0000 7f387cbe1640 1 Processor -- start 2024-04-25T13:16:14.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.148+0000 7f387cbe1640 1 -- start start 2024-04-25T13:16:14.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.149+0000 7f387cbe1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f38780b3c00 0x7f38780b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.149+0000 7f387cbe1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38780b5450 0x7f38780d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.149+0000 7f387cbe1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38781558c0 con 0x7f38781554e0 2024-04-25T13:16:14.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.149+0000 7f387cbe1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f38780b4a80 con 0x7f38780b3c00 2024-04-25T13:16:14.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.149+0000 7f387cbe1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f38780cb8c0 con 0x7f38780b5450 2024-04-25T13:16:14.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.149+0000 7f3875d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f38780b3c00 0x7f38780b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.149+0000 7f3876d9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38780b5450 0x7f38780d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.149+0000 7f3876d9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38780b5450 0x7f38780d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:54898/0 (socket says 172.21.15.52:54898) 2024-04-25T13:16:14.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.149+0000 7f3875d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f38780b3c00 0x7f38780b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:53904/0 (socket says 172.21.15.52:53904) 2024-04-25T13:16:14.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.149+0000 7f3876d9d640 1 -- 172.21.15.52:0/3505163782 learned_addr learned my addr 172.21.15.52:0/3505163782 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:14.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.150+0000 7f3876d9d640 1 -- 172.21.15.52:0/3505163782 >> v2:172.21.15.102:3300/0 conn(0x7f38780b3c00 msgr2=0x7f38780b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:14.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.150+0000 7f3876d9d640 1 --2- 172.21.15.52:0/3505163782 >> v2:172.21.15.102:3300/0 conn(0x7f38780b3c00 0x7f38780b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.150+0000 7f3876d9d640 1 -- 172.21.15.52:0/3505163782 >> v1:172.21.15.102:6789/0 conn(0x7f38781554e0 legacy=0x7f387815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.150+0000 7f3876d9d640 1 -- 172.21.15.52:0/3505163782 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38780cbba0 con 0x7f38780b5450 2024-04-25T13:16:14.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.150+0000 7f3875d9b640 1 --2- 172.21.15.52:0/3505163782 >> v2:172.21.15.102:3300/0 conn(0x7f38780b3c00 0x7f38780b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.150+0000 7f3876d9d640 1 --2- 172.21.15.52:0/3505163782 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38780b5450 0x7f38780d08a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3870009870 tx=0x7f387002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7643101800a0b07d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.151+0000 7f387559a640 1 -- 172.21.15.52:0/3505163782 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3870037070 con 0x7f38780b5450 2024-04-25T13:16:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.151+0000 7f387559a640 1 -- 172.21.15.52:0/3505163782 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387002ae50 con 0x7f38780b5450 2024-04-25T13:16:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.151+0000 7f387559a640 1 -- 172.21.15.52:0/3505163782 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3870032860 con 0x7f38780b5450 2024-04-25T13:16:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.151+0000 7f387cbe1640 1 -- 172.21.15.52:0/3505163782 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38780b5450 msgr2=0x7f38780d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.151+0000 7f387cbe1640 1 --2- 172.21.15.52:0/3505163782 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38780b5450 0x7f38780d08a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3870009870 tx=0x7f387002a300 comp rx=0 tx=0).stop 2024-04-25T13:16:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.151+0000 7f387cbe1640 1 -- 172.21.15.52:0/3505163782 shutdown_connections 2024-04-25T13:16:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.151+0000 7f387cbe1640 1 --2- 172.21.15.52:0/3505163782 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38780b5450 0x7f38780d08a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.151+0000 7f387cbe1640 1 --2- 172.21.15.52:0/3505163782 >> v2:172.21.15.102:3300/0 conn(0x7f38780b3c00 0x7f38780b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.151+0000 7f387cbe1640 1 -- 172.21.15.52:0/3505163782 >> 172.21.15.52:0/3505163782 conn(0x7f3878074d50 msgr2=0x7f3878075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.151+0000 7f387cbe1640 1 -- 172.21.15.52:0/3505163782 shutdown_connections 2024-04-25T13:16:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.151+0000 7f387cbe1640 1 -- 172.21.15.52:0/3505163782 wait complete. 2024-04-25T13:16:14.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f387cbe1640 1 Processor -- start 2024-04-25T13:16:14.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f387cbe1640 1 -- start start 2024-04-25T13:16:14.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f387cbe1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38780b3c00 0x7f387815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f387cbe1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38780b5450 0x7f38781f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f387cbe1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38781554e0 0x7f38781f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f387cbe1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f38780b4710 con 0x7f38780b3c00 2024-04-25T13:16:14.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f387cbe1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f38780b4430 con 0x7f38780b5450 2024-04-25T13:16:14.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f387cbe1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f38780b3580 con 0x7f38781554e0 2024-04-25T13:16:14.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f387659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38780b3c00 0x7f387815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f387659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38780b3c00 0x7f387815bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55568/0 (socket says 172.21.15.52:55568) 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f387659c640 1 -- 172.21.15.52:0/2550002562 learned_addr learned my addr 172.21.15.52:0/2550002562 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f3876d9d640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38781554e0 0x7f38781f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.153+0000 7f3875d9b640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38780b5450 0x7f38781f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.154+0000 7f387659c640 1 -- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38781554e0 msgr2=0x7f38781f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.154+0000 7f387659c640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38781554e0 0x7f38781f4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.154+0000 7f387659c640 1 -- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38780b5450 msgr2=0x7f38781f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.154+0000 7f387659c640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38780b5450 0x7f38781f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.154+0000 7f387659c640 1 -- 172.21.15.52:0/2550002562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38780ca270 con 0x7f38780b3c00 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.154+0000 7f387659c640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38780b3c00 0x7f387815bf50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f386800c7c0 tx=0x7f386800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.154+0000 7f3866ffd640 1 -- 172.21.15.52:0/2550002562 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868016020 con 0x7f38780b3c00 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.154+0000 7f3866ffd640 1 -- 172.21.15.52:0/2550002562 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3868006d50 con 0x7f38780b3c00 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.154+0000 7f3866ffd640 1 -- 172.21.15.52:0/2550002562 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868003bb0 con 0x7f38780b3c00 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.154+0000 7f387cbe1640 1 -- 172.21.15.52:0/2550002562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38781f55a0 con 0x7f38780b3c00 2024-04-25T13:16:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.154+0000 7f387cbe1640 1 -- 172.21.15.52:0/2550002562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38780ca7f0 con 0x7f38780b3c00 2024-04-25T13:16:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.155+0000 7f387cbe1640 1 -- 172.21.15.52:0/2550002562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3878068e40 con 0x7f38780b3c00 2024-04-25T13:16:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.155+0000 7f3866ffd640 1 -- 172.21.15.52:0/2550002562 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f386800a850 con 0x7f38780b3c00 2024-04-25T13:16:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.156+0000 7f3866ffd640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f385806c8f0 0x7f385806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.156+0000 7f3866ffd640 1 -- 172.21.15.52:0/2550002562 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f386808ba40 con 0x7f38780b3c00 2024-04-25T13:16:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.156+0000 7f3875d9b640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f385806c8f0 0x7f385806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.157+0000 7f3875d9b640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f385806c8f0 0x7f385806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f386c009560 tx=0x7f386c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.161+0000 7f3866ffd640 1 -- 172.21.15.52:0/2550002562 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3868020020 con 0x7f38780b3c00 2024-04-25T13:16:14.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.384+0000 7f387cbe1640 1 -- 172.21.15.52:0/2550002562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38780cc260 con 0x7f38780b3c00 2024-04-25T13:16:14.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.384+0000 7f3866ffd640 1 -- 172.21.15.52:0/2550002562 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6828 (secure 0 0 0) 0x7f38781558c0 con 0x7f38780b3c00 2024-04-25T13:16:14.384 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:14.384 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2650846419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2650846419},{"type":"v1","addr":"172.21.15.102:6837","nonce":2650846419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6838/1508646651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":1508646651},{"type":"v1","addr":"172.21.15.102:6838","nonce":1508646651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/1980846137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1980846137},{"type":"v1","addr":"172.21.15.102:6839","nonce":1980846137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/714334205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":714334205},{"type":"v1","addr":"172.21.15.52:6835","nonce":714334205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/3228537118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3228537118},{"type":"v1","addr":"172.21.15.52:6834","nonce":3228537118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:07.352382+0000","modified":"2024-04-25T13:16:13.407386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6837/413759311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":413759311},{"type":"v1","addr":"172.21.15.52:6837","nonce":413759311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-25T13:16:14.384 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-04-25T13:16:14.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.386+0000 7f387cbe1640 1 -- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f385806c8f0 msgr2=0x7f385806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.386+0000 7f387cbe1640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f385806c8f0 0x7f385806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f386c009560 tx=0x7f386c009190 comp rx=0 tx=0).stop 2024-04-25T13:16:14.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.386+0000 7f387cbe1640 1 -- 172.21.15.52:0/2550002562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38780b3c00 msgr2=0x7f387815bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.386+0000 7f387cbe1640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38780b3c00 0x7f387815bf50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f386800c7c0 tx=0x7f386800cc80 comp rx=0 tx=0).stop 2024-04-25T13:16:14.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.386+0000 7f387cbe1640 1 -- 172.21.15.52:0/2550002562 shutdown_connections 2024-04-25T13:16:14.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.386+0000 7f387cbe1640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f385806c8f0 0x7f385806edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.386+0000 7f387cbe1640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38781554e0 0x7f38781f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.386+0000 7f387cbe1640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38780b5450 0x7f38781f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.386+0000 7f387cbe1640 1 --2- 172.21.15.52:0/2550002562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38780b3c00 0x7f387815bf50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.386+0000 7f387cbe1640 1 -- 172.21.15.52:0/2550002562 >> 172.21.15.52:0/2550002562 conn(0x7f3878074d50 msgr2=0x7f38780cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:14.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.386+0000 7f387cbe1640 1 -- 172.21.15.52:0/2550002562 shutdown_connections 2024-04-25T13:16:14.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.387+0000 7f387cbe1640 1 -- 172.21.15.52:0/2550002562 wait complete. 2024-04-25T13:16:14.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:14.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.498+0000 7ff4bf6cb640 1 Processor -- start 2024-04-25T13:16:14.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.499+0000 7ff4bf6cb640 1 -- start start 2024-04-25T13:16:14.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.499+0000 7ff4bf6cb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4b80b3c00 0x7ff4b80b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.499+0000 7ff4bf6cb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4b80b5450 0x7ff4b80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.499+0000 7ff4bf6cb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b81558c0 con 0x7ff4b81554e0 2024-04-25T13:16:14.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.499+0000 7ff4bf6cb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff4b80b4a80 con 0x7ff4b80b3c00 2024-04-25T13:16:14.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.499+0000 7ff4bf6cb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b80cb8c0 con 0x7ff4b80b5450 2024-04-25T13:16:14.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.499+0000 7ff4bcc66640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4b80b3c00 0x7ff4b80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.499+0000 7ff4bd467640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff4b81554e0 0x7ff4b815f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35804/0 (socket says 172.21.15.52:35804) 2024-04-25T13:16:14.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.499+0000 7ff4bcc66640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4b80b3c00 0x7ff4b80b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55574/0 (socket says 172.21.15.52:55574) 2024-04-25T13:16:14.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.499+0000 7ff4bd467640 1 -- 172.21.15.52:0/2832212732 learned_addr learned my addr 172.21.15.52:0/2832212732 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:14.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.500+0000 7ff4bdc68640 1 --2- 172.21.15.52:0/2832212732 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4b80b5450 0x7ff4b80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.500+0000 7ff4bcc66640 1 -- 172.21.15.52:0/2832212732 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4b80b5450 msgr2=0x7ff4b80d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:14.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.500+0000 7ff4bcc66640 1 --2- 172.21.15.52:0/2832212732 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4b80b5450 0x7ff4b80d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.500+0000 7ff4bcc66640 1 -- 172.21.15.52:0/2832212732 >> v1:172.21.15.52:6789/0 conn(0x7ff4b81554e0 legacy=0x7ff4b815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.500+0000 7ff4affff640 1 -- 172.21.15.52:0/2832212732 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424553386 0 0) 0x7ff4b4001110 con 0x7ff4b81554e0 2024-04-25T13:16:14.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.500+0000 7ff4bcc66640 1 -- 172.21.15.52:0/2832212732 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b80cbba0 con 0x7ff4b80b3c00 2024-04-25T13:16:14.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.500+0000 7ff4bcc66640 1 --2- 172.21.15.52:0/2832212732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4b80b3c00 0x7ff4b80b4f10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80097a0 tx=0x7ff4a802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab76b3ff4e813bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:14.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.501+0000 7ff4affff640 1 -- 172.21.15.52:0/2832212732 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8037070 con 0x7ff4b80b3c00 2024-04-25T13:16:14.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.501+0000 7ff4affff640 1 -- 172.21.15.52:0/2832212732 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a8032440 con 0x7ff4b80b3c00 2024-04-25T13:16:14.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.501+0000 7ff4affff640 1 -- 172.21.15.52:0/2832212732 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8032810 con 0x7ff4b80b3c00 2024-04-25T13:16:14.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.501+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/2832212732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4b80b3c00 msgr2=0x7ff4b80b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.501+0000 7ff4bf6cb640 1 --2- 172.21.15.52:0/2832212732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4b80b3c00 0x7ff4b80b4f10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80097a0 tx=0x7ff4a802a210 comp rx=0 tx=0).stop 2024-04-25T13:16:14.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.501+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/2832212732 shutdown_connections 2024-04-25T13:16:14.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.501+0000 7ff4bf6cb640 1 --2- 172.21.15.52:0/2832212732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4b80b3c00 0x7ff4b80b4f10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.501+0000 7ff4bf6cb640 1 --2- 172.21.15.52:0/2832212732 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4b80b5450 0x7ff4b80d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.501+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/2832212732 >> 172.21.15.52:0/2832212732 conn(0x7ff4b8074d50 msgr2=0x7ff4b8075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:14.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.501+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/2832212732 shutdown_connections 2024-04-25T13:16:14.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.501+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/2832212732 wait complete. 2024-04-25T13:16:14.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.502+0000 7ff4bf6cb640 1 Processor -- start 2024-04-25T13:16:14.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.502+0000 7ff4bf6cb640 1 -- start start 2024-04-25T13:16:14.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.503+0000 7ff4bf6cb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4b80b3c00 0x7ff4b8157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.503+0000 7ff4bf6cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4b80b5450 0x7ff4b81f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.503+0000 7ff4bf6cb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4b81554e0 0x7ff4b815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.503+0000 7ff4bf6cb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b80b4710 con 0x7ff4b80b5450 2024-04-25T13:16:14.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.503+0000 7ff4bf6cb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b80b4430 con 0x7ff4b80b3c00 2024-04-25T13:16:14.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.503+0000 7ff4bf6cb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b80b3580 con 0x7ff4b81554e0 2024-04-25T13:16:14.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.503+0000 7ff4bcc66640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4b80b5450 0x7ff4b81f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.503+0000 7ff4bcc66640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4b80b5450 0x7ff4b81f1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55590/0 (socket says 172.21.15.52:55590) 2024-04-25T13:16:14.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.503+0000 7ff4bcc66640 1 -- 172.21.15.52:0/1237115404 learned_addr learned my addr 172.21.15.52:0/1237115404 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:14.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4bdc68640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4b81554e0 0x7ff4b815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4bd467640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4b80b3c00 0x7ff4b8157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4bcc66640 1 -- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4b81554e0 msgr2=0x7ff4b815a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4bcc66640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4b81554e0 0x7ff4b815a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4bcc66640 1 -- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4b80b3c00 msgr2=0x7ff4b8157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4bcc66640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4b80b3c00 0x7ff4b8157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4bcc66640 1 -- 172.21.15.52:0/1237115404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b81583e0 con 0x7ff4b80b5450 2024-04-25T13:16:14.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4bcc66640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4b80b5450 0x7ff4b81f1590 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80098c0 tx=0x7ff4a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:14.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4adffb640 1 -- 172.21.15.52:0/1237115404 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8037040 con 0x7ff4b80b5450 2024-04-25T13:16:14.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4adffb640 1 -- 172.21.15.52:0/1237115404 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a8030770 con 0x7ff4b80b5450 2024-04-25T13:16:14.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4adffb640 1 -- 172.21.15.52:0/1237115404 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8030b40 con 0x7ff4b80b5450 2024-04-25T13:16:14.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/1237115404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b8158680 con 0x7ff4b80b5450 2024-04-25T13:16:14.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.504+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/1237115404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b8156b90 con 0x7ff4b80b5450 2024-04-25T13:16:14.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.505+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/1237115404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b8068e40 con 0x7ff4b80b5450 2024-04-25T13:16:14.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.505+0000 7ff4adffb640 1 -- 172.21.15.52:0/1237115404 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff4a8044020 con 0x7ff4b80b5450 2024-04-25T13:16:14.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.506+0000 7ff4adffb640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff49c06c8f0 0x7ff49c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.506+0000 7ff4adffb640 1 -- 172.21.15.52:0/1237115404 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff4a80ac420 con 0x7ff4b80b5450 2024-04-25T13:16:14.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.506+0000 7ff4bd467640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff49c06c8f0 0x7ff49c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.507+0000 7ff4bd467640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff49c06c8f0 0x7ff49c06edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4000f60 tx=0x7ff4b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:14.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.510+0000 7ff4adffb640 1 -- 172.21.15.52:0/1237115404 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff4a8032e20 con 0x7ff4b80b5450 2024-04-25T13:16:14.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.696+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/1237115404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4b80cd3e0 con 0x7ff4b80b5450 2024-04-25T13:16:14.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.698+0000 7ff4adffb640 1 -- 172.21.15.52:0/1237115404 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7ff4a807a510 con 0x7ff4b80b5450 2024-04-25T13:16:14.697 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:14.697 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":25,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:14.018518+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:14.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.700+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff49c06c8f0 msgr2=0x7ff49c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.700+0000 7ff4bf6cb640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff49c06c8f0 0x7ff49c06edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4000f60 tx=0x7ff4b4009040 comp rx=0 tx=0).stop 2024-04-25T13:16:14.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.700+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/1237115404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4b80b5450 msgr2=0x7ff4b81f1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.700+0000 7ff4bf6cb640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4b80b5450 0x7ff4b81f1590 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80098c0 tx=0x7ff4a80046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.700+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/1237115404 shutdown_connections 2024-04-25T13:16:14.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.700+0000 7ff4bf6cb640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff49c06c8f0 0x7ff49c06edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.700+0000 7ff4bf6cb640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4b81554e0 0x7ff4b815a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.700+0000 7ff4bf6cb640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4b80b5450 0x7ff4b81f1590 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.700+0000 7ff4bf6cb640 1 --2- 172.21.15.52:0/1237115404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4b80b3c00 0x7ff4b8157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.700+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/1237115404 >> 172.21.15.52:0/1237115404 conn(0x7ff4b8074d50 msgr2=0x7ff4b8153d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:14.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.700+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/1237115404 shutdown_connections 2024-04-25T13:16:14.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:14.700+0000 7ff4bf6cb640 1 -- 172.21.15.52:0/1237115404 wait complete. 2024-04-25T13:16:15.314 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:16:07.352382+0000', 'modified': '2024-04-25T13:16:13.407386+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.52:6837/413759311', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6836', 'nonce': 413759311}, {'type': 'v1', 'addr': '172.21.15.52:6837', 'nonce': 413759311}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-04-25T13:16:15.314 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T13:16:15.314 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-25T13:16:15.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.422+0000 7fea48ebb640 1 Processor -- start 2024-04-25T13:16:15.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.422+0000 7fea48ebb640 1 -- start start 2024-04-25T13:16:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.423+0000 7fea48ebb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea441553a0 0x7fea440c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.423+0000 7fea48ebb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea4415bb80 0x7fea440c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.423+0000 7fea48ebb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea4406c850 con 0x7fea440c8070 2024-04-25T13:16:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.423+0000 7fea48ebb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fea4406cb30 con 0x7fea441553a0 2024-04-25T13:16:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.423+0000 7fea48ebb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fea4406ce10 con 0x7fea4415bb80 2024-04-25T13:16:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.423+0000 7fea4259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea441553a0 0x7fea440c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.423+0000 7fea41d9b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fea440c8070 0x7fea440ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35810/0 (socket says 172.21.15.52:35810) 2024-04-25T13:16:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.423+0000 7fea4259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea441553a0 0x7fea440c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55600/0 (socket says 172.21.15.52:55600) 2024-04-25T13:16:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.423+0000 7fea41d9b640 1 -- 172.21.15.52:0/2199859336 learned_addr learned my addr 172.21.15.52:0/2199859336 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.423+0000 7fea4259c640 1 -- 172.21.15.52:0/2199859336 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea4415bb80 msgr2=0x7fea440c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.423+0000 7fea4259c640 1 --2- 172.21.15.52:0/2199859336 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea4415bb80 0x7fea440c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.423+0000 7fea4259c640 1 -- 172.21.15.52:0/2199859336 >> v1:172.21.15.52:6789/0 conn(0x7fea440c8070 legacy=0x7fea440ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.424+0000 7fea4259c640 1 -- 172.21.15.52:0/2199859336 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4406d0f0 con 0x7fea441553a0 2024-04-25T13:16:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.424+0000 7fea4159a640 1 -- 172.21.15.52:0/2199859336 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152685533 0 0) 0x7fea4406c850 con 0x7fea440c8070 2024-04-25T13:16:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.424+0000 7fea4259c640 1 --2- 172.21.15.52:0/2199859336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea441553a0 0x7fea440c8700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0097a0 tx=0x7fea3c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1f4112eb57e1b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.424+0000 7fea4159a640 1 -- 172.21.15.52:0/2199859336 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c037070 con 0x7fea441553a0 2024-04-25T13:16:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.424+0000 7fea4159a640 1 -- 172.21.15.52:0/2199859336 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c032440 con 0x7fea441553a0 2024-04-25T13:16:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.424+0000 7fea4159a640 1 -- 172.21.15.52:0/2199859336 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c032810 con 0x7fea441553a0 2024-04-25T13:16:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.425+0000 7fea48ebb640 1 -- 172.21.15.52:0/2199859336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea441553a0 msgr2=0x7fea440c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.425+0000 7fea48ebb640 1 --2- 172.21.15.52:0/2199859336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea441553a0 0x7fea440c8700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0097a0 tx=0x7fea3c02a210 comp rx=0 tx=0).stop 2024-04-25T13:16:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.425+0000 7fea48ebb640 1 -- 172.21.15.52:0/2199859336 shutdown_connections 2024-04-25T13:16:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.425+0000 7fea48ebb640 1 --2- 172.21.15.52:0/2199859336 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea4415bb80 0x7fea440c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.425+0000 7fea48ebb640 1 --2- 172.21.15.52:0/2199859336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea441553a0 0x7fea440c8700 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.425+0000 7fea48ebb640 1 -- 172.21.15.52:0/2199859336 >> 172.21.15.52:0/2199859336 conn(0x7fea44073010 msgr2=0x7fea44073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.425+0000 7fea48ebb640 1 -- 172.21.15.52:0/2199859336 shutdown_connections 2024-04-25T13:16:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.425+0000 7fea48ebb640 1 -- 172.21.15.52:0/2199859336 wait complete. 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.426+0000 7fea48ebb640 1 Processor -- start 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.426+0000 7fea48ebb640 1 -- start start 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea48ebb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea440c8070 0x7fea4414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea48ebb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea441553a0 0x7fea440c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea48ebb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4415bb80 0x7fea441f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea48ebb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea440cd4d0 con 0x7fea440c8070 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea48ebb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fea44155780 con 0x7fea4415bb80 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea48ebb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fea440cd650 con 0x7fea441553a0 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea4259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea440c8070 0x7fea4414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea4259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea440c8070 0x7fea4414e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55604/0 (socket says 172.21.15.52:55604) 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea4259c640 1 -- 172.21.15.52:0/1730825946 learned_addr learned my addr 172.21.15.52:0/1730825946 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea42d9d640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4415bb80 0x7fea441f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea41d9b640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea441553a0 0x7fea440c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea4259c640 1 -- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea441553a0 msgr2=0x7fea440c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea4259c640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea441553a0 0x7fea440c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea4259c640 1 -- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4415bb80 msgr2=0x7fea441f0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea4259c640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4415bb80 0x7fea441f0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.427+0000 7fea4259c640 1 -- 172.21.15.52:0/1730825946 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea440c7300 con 0x7fea440c8070 2024-04-25T13:16:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.428+0000 7fea4259c640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea440c8070 0x7fea4414e1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0097a0 tx=0x7fea3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.428+0000 7fea3affd640 1 -- 172.21.15.52:0/1730825946 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c041070 con 0x7fea440c8070 2024-04-25T13:16:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.428+0000 7fea3affd640 1 -- 172.21.15.52:0/1730825946 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c03c870 con 0x7fea440c8070 2024-04-25T13:16:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.428+0000 7fea48ebb640 1 -- 172.21.15.52:0/1730825946 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea44158540 con 0x7fea440c8070 2024-04-25T13:16:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.428+0000 7fea3affd640 1 -- 172.21.15.52:0/1730825946 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c037040 con 0x7fea440c8070 2024-04-25T13:16:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.428+0000 7fea48ebb640 1 -- 172.21.15.52:0/1730825946 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea441f4170 con 0x7fea440c8070 2024-04-25T13:16:15.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.429+0000 7fea3affd640 1 -- 172.21.15.52:0/1730825946 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fea3c044070 con 0x7fea440c8070 2024-04-25T13:16:15.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.430+0000 7fea3affd640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fea2406c8f0 0x7fea2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.430+0000 7fea3affd640 1 -- 172.21.15.52:0/1730825946 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fea3c0ac9c0 con 0x7fea440c8070 2024-04-25T13:16:15.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.430+0000 7fea41d9b640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fea2406c8f0 0x7fea2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.431+0000 7fea41d9b640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fea2406c8f0 0x7fea2406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fea44156ff0 tx=0x7fea2c007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.431+0000 7fea4bbcc740 1 Processor -- start 2024-04-25T13:16:15.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.431+0000 7fea4bbcc740 1 -- start start 2024-04-25T13:16:15.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea4bbcc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194690 0x5592a31d8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea4bbcc740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a3193fc0 0x5592a3197f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea4bbcc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194a70 0x5592a31e28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea4bbcc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5592a30fdc50 con 0x5592a3194a70 2024-04-25T13:16:15.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea4bbcc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5592a309a830 con 0x5592a3194690 2024-04-25T13:16:15.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea4bbcc740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5592a30f9c10 con 0x5592a3193fc0 2024-04-25T13:16:15.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea42d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194a70 0x5592a31e28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea42d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194a70 0x5592a31e28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55610/0 (socket says 172.21.15.52:55610) 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea42d9d640 1 -- 172.21.15.52:0/1495584123 learned_addr learned my addr 172.21.15.52:0/1495584123 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea4259c640 1 --2- 172.21.15.52:0/1495584123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194690 0x5592a31d8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea41d9b640 1 --2- 172.21.15.52:0/1495584123 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a3193fc0 0x5592a3197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea42d9d640 1 -- 172.21.15.52:0/1495584123 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a3193fc0 msgr2=0x5592a3197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea42d9d640 1 --2- 172.21.15.52:0/1495584123 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a3193fc0 0x5592a3197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea42d9d640 1 -- 172.21.15.52:0/1495584123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194690 msgr2=0x5592a31d8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea42d9d640 1 --2- 172.21.15.52:0/1495584123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194690 0x5592a31d8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea42d9d640 1 -- 172.21.15.52:0/1495584123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592a2e102d0 con 0x5592a3194a70 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea42d9d640 1 --2- 172.21.15.52:0/1495584123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194a70 0x5592a31e28a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea34009f80 tx=0x7fea3400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c445a0b8dd6238a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea23fff640 1 -- 172.21.15.52:0/1495584123 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34016420 con 0x5592a3194a70 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea23fff640 1 -- 172.21.15.52:0/1495584123 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea340165c0 con 0x5592a3194a70 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.432+0000 7fea23fff640 1 -- 172.21.15.52:0/1495584123 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea340169b0 con 0x5592a3194a70 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.433+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1495584123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194a70 msgr2=0x5592a31e28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.433+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/1495584123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194a70 0x5592a31e28a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea34009f80 tx=0x7fea3400c8b0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.433+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1495584123 shutdown_connections 2024-04-25T13:16:15.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.433+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/1495584123 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a3193fc0 0x5592a3197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.433+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/1495584123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194a70 0x5592a31e28a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.433+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/1495584123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194690 0x5592a31d8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.433+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1495584123 >> 172.21.15.52:0/1495584123 conn(0x5592a3195c80 msgr2=0x5592a3198580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.433+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1495584123 shutdown_connections 2024-04-25T13:16:15.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.433+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1495584123 wait complete. 2024-04-25T13:16:15.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.434+0000 7fea4bbcc740 1 -- start start 2024-04-25T13:16:15.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.434+0000 7fea4bbcc740 1 Processor -- start 2024-04-25T13:16:15.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea4bbcc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194690 0x5592a31badb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea4bbcc740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a3194a70 0x5592a31bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea4bbcc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a31bfc60 0x5592a31d9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea4bbcc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5592a31d9700 con 0x5592a31bfc60 2024-04-25T13:16:15.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea4bbcc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5592a3098470 con 0x5592a3194690 2024-04-25T13:16:15.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea4bbcc740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5592a31970e0 con 0x5592a3194a70 2024-04-25T13:16:15.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea4bbcc740 10 client.0 _ll_register_callbacks cb 0x5592a30bdf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:16:15.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea42d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a31bfc60 0x5592a31d9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea42d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a31bfc60 0x5592a31d9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55620/0 (socket says 172.21.15.52:55620) 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea42d9d640 1 -- 172.21.15.52:0/1416506571 learned_addr learned my addr 172.21.15.52:0/1416506571 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea41d9b640 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a3194a70 0x5592a31bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea4259c640 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194690 0x5592a31badb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea42d9d640 1 -- 172.21.15.52:0/1416506571 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a3194a70 msgr2=0x5592a31bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea42d9d640 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a3194a70 0x5592a31bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea42d9d640 1 -- 172.21.15.52:0/1416506571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194690 msgr2=0x5592a31badb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea42d9d640 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194690 0x5592a31badb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea42d9d640 1 -- 172.21.15.52:0/1416506571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592a2eda6b0 con 0x5592a31bfc60 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea42d9d640 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a31bfc60 0x5592a31d9880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea34000f80 tx=0x7fea34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677da16633e98be2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea217fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea217fa640 1 -- 172.21.15.52:0/1416506571 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34024020 con 0x5592a31bfc60 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea217fa640 1 -- 172.21.15.52:0/1416506571 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fea34017d40 con 0x5592a31bfc60 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.435+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1416506571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea340165c0 con 0x5592a31bfc60 2024-04-25T13:16:15.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea217fa640 1 -- 172.21.15.52:0/1416506571 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fea3402e050 con 0x5592a31bfc60 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea4bbcc740 10 client.4458 fetch_fsmap learned FSMap version 6 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1416506571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5592a31c0b30 con 0x5592a31bfc60 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea217fa640 1 -- 172.21.15.52:0/1416506571 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea340165c0 con 0x5592a31bfc60 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea217fa640 1 -- 172.21.15.52:0/1416506571 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7fea34031020 con 0x5592a31bfc60 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea4bbcc740 10 client.4458 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea4bbcc740 10 client.4458 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea4bbcc740 20 client.4458 populate_metadata read hostname 'smithi052' 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31b35e0 0x5592a31f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea4bbcc740 4 client.4458 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1416506571 --> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592a310b670 con 0x5592a31b35e0 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea4259c640 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31b35e0 0x5592a31f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea217fa640 10 client.4458 ms_handle_connect on v2:172.21.15.52:6836/413759311 2024-04-25T13:16:15.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:15.436+0000 7fea4259c640 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31b35e0 0x5592a31f92f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d155307d9a73a3fd server_cookie=8d1e3b9a433f64cf in_seq=0 out_seq=0 2024-04-25T13:16:18.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.409+0000 7fea217fa640 1 -- 172.21.15.52:0/1416506571 <== mds.0 v2:172.21.15.52:6836/413759311 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5592a310b670 con 0x5592a31b35e0 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.409+0000 7fea217fa640 10 client.4458 handle_command_reply: tid=0 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.409+0000 7fea4bbcc740 1 client.4458 shutdown 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.410+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1416506571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a31bfc60 msgr2=0x5592a31d9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.410+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a31bfc60 0x5592a31d9880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea34000f80 tx=0x7fea34004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.410+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1416506571 shutdown_connections 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.410+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31b35e0 0x5592a31f92f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.410+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a3194a70 0x5592a31bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.410+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a31bfc60 0x5592a31d9880 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.410+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/1416506571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194690 0x5592a31badb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.410+0000 7fea217fa640 0 client.4458 ms_handle_reset on v2:172.21.15.52:6836/413759311 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.410+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1416506571 >> 172.21.15.52:0/1416506571 conn(0x5592a3193fc0 msgr2=0x5592a31d8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.410+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1416506571 shutdown_connections 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.410+0000 7fea4bbcc740 1 -- 172.21.15.52:0/1416506571 wait complete. 2024-04-25T13:16:18.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.410+0000 7fea4bbcc740 20 client.4458 trim_cache size 0 max 16384 2024-04-25T13:16:18.427 INFO:tasks.ceph.mds.e.smithi052.stderr:2024-04-25T13:16:18.427+0000 7f78d9f68640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T13:16:18.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.430+0000 7fea4bbcc740 1 Processor -- start 2024-04-25T13:16:18.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.430+0000 7fea4bbcc740 1 -- start start 2024-04-25T13:16:18.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.431+0000 7fea4bbcc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 0x5592a3192940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.431+0000 7fea4bbcc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194a70 0x5592a3199b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.431+0000 7fea4bbcc740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a31bfc60 0x5592a319a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.431+0000 7fea4bbcc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea441fd8a0 con 0x5592a3194690 2024-04-25T13:16:18.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.431+0000 7fea4bbcc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5592a31db240 con 0x5592a3194a70 2024-04-25T13:16:18.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.431+0000 7fea4bbcc740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5592a31c10a0 con 0x5592a31bfc60 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.431+0000 7fea4259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 0x5592a3192940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.431+0000 7fea4259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 0x5592a3192940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55634/0 (socket says 172.21.15.52:55634) 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.431+0000 7fea4259c640 1 -- 172.21.15.52:0/3517056117 learned_addr learned my addr 172.21.15.52:0/3517056117 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.431+0000 7fea42d9d640 1 --2- 172.21.15.52:0/3517056117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a31bfc60 0x5592a319a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.431+0000 7fea41d9b640 1 --2- 172.21.15.52:0/3517056117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194a70 0x5592a3199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.432+0000 7fea4259c640 1 -- 172.21.15.52:0/3517056117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a31bfc60 msgr2=0x5592a319a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.432+0000 7fea4259c640 1 --2- 172.21.15.52:0/3517056117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a31bfc60 0x5592a319a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.432+0000 7fea4259c640 1 -- 172.21.15.52:0/3517056117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194a70 msgr2=0x5592a3199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.432+0000 7fea4259c640 1 --2- 172.21.15.52:0/3517056117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194a70 0x5592a3199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.432+0000 7fea4259c640 1 -- 172.21.15.52:0/3517056117 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592a318f960 con 0x5592a3194690 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.432+0000 7fea4259c640 1 --2- 172.21.15.52:0/3517056117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 0x5592a3192940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea3c07a3d0 tx=0x7fea3c0aab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc1df5825564f3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.432+0000 7fea237fe640 1 -- 172.21.15.52:0/3517056117 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c04b040 con 0x5592a3194690 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.432+0000 7fea237fe640 1 -- 172.21.15.52:0/3517056117 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c08ee50 con 0x5592a3194690 2024-04-25T13:16:18.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.432+0000 7fea237fe640 1 -- 172.21.15.52:0/3517056117 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c083020 con 0x5592a3194690 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.433+0000 7fea4bbcc740 1 -- 172.21.15.52:0/3517056117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 msgr2=0x5592a3192940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.433+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/3517056117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 0x5592a3192940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea3c07a3d0 tx=0x7fea3c0aab10 comp rx=0 tx=0).stop 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.433+0000 7fea4bbcc740 1 -- 172.21.15.52:0/3517056117 shutdown_connections 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.433+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/3517056117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a31bfc60 0x5592a319a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.433+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/3517056117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194a70 0x5592a3199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.433+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/3517056117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 0x5592a3192940 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.433+0000 7fea4bbcc740 1 -- 172.21.15.52:0/3517056117 >> 172.21.15.52:0/3517056117 conn(0x5592a3193fc0 msgr2=0x5592a31ad3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.433+0000 7fea4bbcc740 1 -- 172.21.15.52:0/3517056117 shutdown_connections 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.433+0000 7fea4bbcc740 1 -- 172.21.15.52:0/3517056117 wait complete. 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.434+0000 7fea4bbcc740 1 -- start start 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.434+0000 7fea4bbcc740 1 Processor -- start 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4bbcc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 0x5592a31f3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4bbcc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194a70 0x5592a31f3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4bbcc740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a31bfc60 0x5592a31f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4bbcc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5592a31da600 con 0x5592a3194690 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4bbcc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5592a31d9fb0 con 0x5592a3194a70 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4bbcc740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5592a31b3a20 con 0x5592a31bfc60 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4bbcc740 10 client.0 _ll_register_callbacks cb 0x7fea3c009480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 0x5592a31f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 0x5592a31f3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55636/0 (socket says 172.21.15.52:55636) 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4259c640 1 -- 172.21.15.52:0/4144998952 learned_addr learned my addr 172.21.15.52:0/4144998952 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea41d9b640 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194a70 0x5592a31f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea42d9d640 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a31bfc60 0x5592a31f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4259c640 1 -- 172.21.15.52:0/4144998952 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a31bfc60 msgr2=0x5592a31f3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4259c640 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a31bfc60 0x5592a31f3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4259c640 1 -- 172.21.15.52:0/4144998952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194a70 msgr2=0x5592a31f3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:18.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4259c640 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194a70 0x5592a31f3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4259c640 1 -- 172.21.15.52:0/4144998952 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592a3199580 con 0x5592a3194690 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea4259c640 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 0x5592a31f3050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0768a0 tx=0x7fea3c0ac040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ff27afad124a28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.435+0000 7fea217fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea217fa640 1 -- 172.21.15.52:0/4144998952 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0a9060 con 0x5592a3194690 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea217fa640 1 -- 172.21.15.52:0/4144998952 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fea3c076ab0 con 0x5592a3194690 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea4bbcc740 1 -- 172.21.15.52:0/4144998952 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea3c08ee50 con 0x5592a3194690 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea217fa640 1 -- 172.21.15.52:0/4144998952 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fea3c04b050 con 0x5592a3194690 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea4bbcc740 10 client.4464 fetch_fsmap learned FSMap version 6 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea4bbcc740 1 -- 172.21.15.52:0/4144998952 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5592a32558e0 con 0x5592a3194690 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea217fa640 1 -- 172.21.15.52:0/4144998952 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c08ee50 con 0x5592a3194690 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea217fa640 1 -- 172.21.15.52:0/4144998952 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7fea3c03cc60 con 0x5592a3194690 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea4bbcc740 10 client.4464 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea4bbcc740 10 client.4464 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea4bbcc740 20 client.4464 populate_metadata read hostname 'smithi052' 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31bded0 0x5592a31be2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea4bbcc740 4 client.4464 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea4bbcc740 1 -- 172.21.15.52:0/4144998952 --> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] -- command(tid 0: {"prefix": "status"}) -- 0x5592a31054e0 con 0x5592a31bded0 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.436+0000 7fea41d9b640 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31bded0 0x5592a31be2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.437+0000 7fea217fa640 10 client.4464 ms_handle_connect on v2:172.21.15.52:6836/413759311 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.437+0000 7fea41d9b640 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31bded0 0x5592a31be2b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=813d673a4794d4e0 server_cookie=c6e606fb3413d210 in_seq=0 out_seq=0 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.437+0000 7fea41d9b640 1 -- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31bded0 msgr2=0x5592a31be2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.437+0000 7fea41d9b640 1 -- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31bded0 msgr2=0x5592a31be2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.437+0000 7fea41d9b640 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31bded0 0x5592a31be2b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.437+0000 7fea41d9b640 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31bded0 0x5592a31be2b0 unknown :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.437+0000 7fea41d9b640 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31bded0 0x5592a31be2b0 unknown :-1 s=BANNER_CONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.437+0000 7fea217fa640 10 client.4464 ms_handle_connect on v2:172.21.15.52:6836/413759311 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.437+0000 7fea41d9b640 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31bded0 0x5592a31be2b0 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=813d673a4794d4e0 server_cookie=c6e606fb3413d210 in_seq=0 out_seq=1 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea217fa640 1 -- 172.21.15.52:0/4144998952 <== mds.0 v2:172.21.15.52:6836/413759311 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5592a31054e0 con 0x5592a31bded0 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea217fa640 10 client.4464 handle_command_reply: tid=0 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea4bbcc740 1 client.4464 shutdown 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea4bbcc740 1 -- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 msgr2=0x5592a31f3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 0x5592a31f3050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0768a0 tx=0x7fea3c0ac040 comp rx=0 tx=0).stop 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea4bbcc740 1 -- 172.21.15.52:0/4144998952 shutdown_connections 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x5592a31bded0 0x5592a31be2b0 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5592a31bfc60 0x5592a31f3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592a3194a70 0x5592a31f3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea4bbcc740 1 --2- 172.21.15.52:0/4144998952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5592a3194690 0x5592a31f3050 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea217fa640 0 client.4464 ms_handle_reset on v2:172.21.15.52:6836/413759311 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea4bbcc740 1 -- 172.21.15.52:0/4144998952 >> 172.21.15.52:0/4144998952 conn(0x5592a3193fc0 msgr2=0x5592a31fc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea4bbcc740 1 -- 172.21.15.52:0/4144998952 shutdown_connections 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea4bbcc740 1 -- 172.21.15.52:0/4144998952 wait complete. 2024-04-25T13:16:18.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.438+0000 7fea4bbcc740 20 client.4464 trim_cache size 0 max 16384 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "223f60a6-8e09-4413-a2a5-fc4244f2a674", 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4290, 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.433022078, 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 6, 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 25, 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 24, 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 17.019752265000001 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.439+0000 7fea48ebb640 1 -- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fea2406c8f0 msgr2=0x7fea2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.439+0000 7fea48ebb640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fea2406c8f0 0x7fea2406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fea44156ff0 tx=0x7fea2c007b50 comp rx=0 tx=0).stop 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.439+0000 7fea48ebb640 1 -- 172.21.15.52:0/1730825946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea440c8070 msgr2=0x7fea4414e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.439+0000 7fea48ebb640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea440c8070 0x7fea4414e1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0097a0 tx=0x7fea3c0046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.439+0000 7fea48ebb640 1 -- 172.21.15.52:0/1730825946 shutdown_connections 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.439+0000 7fea48ebb640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fea2406c8f0 0x7fea2406edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.439+0000 7fea48ebb640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea441553a0 0x7fea440c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.439+0000 7fea48ebb640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4415bb80 0x7fea441f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.439+0000 7fea48ebb640 1 --2- 172.21.15.52:0/1730825946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea440c8070 0x7fea4414e1c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.439+0000 7fea48ebb640 1 -- 172.21.15.52:0/1730825946 >> 172.21.15.52:0/1730825946 conn(0x7fea44073010 msgr2=0x7fea44153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.439+0000 7fea48ebb640 1 -- 172.21.15.52:0/1730825946 shutdown_connections 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.439+0000 7fea48ebb640 1 -- 172.21.15.52:0/1730825946 wait complete. 2024-04-25T13:16:18.452 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:16:18.452 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:18.453 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:16:18.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.560+0000 7f0fb589a640 1 Processor -- start 2024-04-25T13:16:18.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.560+0000 7f0fb589a640 1 -- start start 2024-04-25T13:16:18.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0fb589a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0fb00c8870 0x7f0fb015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0fb589a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0fb015ca00 0x7f0fb0073a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0fb589a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb0158fe0 con 0x7f0fb0152f70 2024-04-25T13:16:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0fb589a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0fb01592c0 con 0x7f0fb015ca00 2024-04-25T13:16:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0fb589a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0fb01595a0 con 0x7f0fb00c8870 2024-04-25T13:16:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0faf7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0fb015ca00 0x7f0fb0073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0faeffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0fb0152f70 0x7f0fb00c5b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35820/0 (socket says 172.21.15.52:35820) 2024-04-25T13:16:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0faeffd640 1 -- 172.21.15.52:0/4037447095 learned_addr learned my addr 172.21.15.52:0/4037447095 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0fae7fc640 1 --2- 172.21.15.52:0/4037447095 >> v2:172.21.15.102:3300/0 conn(0x7f0fb00c8870 0x7f0fb015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0faf7fe640 1 -- 172.21.15.52:0/4037447095 >> v2:172.21.15.102:3300/0 conn(0x7f0fb00c8870 msgr2=0x7f0fb015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0faf7fe640 1 --2- 172.21.15.52:0/4037447095 >> v2:172.21.15.102:3300/0 conn(0x7f0fb00c8870 0x7f0fb015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0faf7fe640 1 -- 172.21.15.52:0/4037447095 >> v1:172.21.15.52:6789/0 conn(0x7f0fb0152f70 legacy=0x7f0fb00c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0faf7fe640 1 -- 172.21.15.52:0/4037447095 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb0159880 con 0x7f0fb015ca00 2024-04-25T13:16:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.561+0000 7f0fadffb640 1 -- 172.21.15.52:0/4037447095 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2147880730 0 0) 0x7f0fb0158fe0 con 0x7f0fb0152f70 2024-04-25T13:16:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.562+0000 7f0faf7fe640 1 --2- 172.21.15.52:0/4037447095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fb015ca00 0x7f0fb0073a30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0071af0 tx=0x7f0fa802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9caaf8abc6ae51f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.562+0000 7f0fadffb640 1 -- 172.21.15.52:0/4037447095 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8007740 con 0x7f0fb015ca00 2024-04-25T13:16:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.562+0000 7f0fadffb640 1 -- 172.21.15.52:0/4037447095 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa80078e0 con 0x7f0fb015ca00 2024-04-25T13:16:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.562+0000 7f0fadffb640 1 -- 172.21.15.52:0/4037447095 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8007cb0 con 0x7f0fb015ca00 2024-04-25T13:16:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.562+0000 7f0fb589a640 1 -- 172.21.15.52:0/4037447095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fb015ca00 msgr2=0x7f0fb0073a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.562+0000 7f0fb589a640 1 --2- 172.21.15.52:0/4037447095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fb015ca00 0x7f0fb0073a30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0071af0 tx=0x7f0fa802a680 comp rx=0 tx=0).stop 2024-04-25T13:16:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.563+0000 7f0fb589a640 1 -- 172.21.15.52:0/4037447095 shutdown_connections 2024-04-25T13:16:18.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.563+0000 7f0fb589a640 1 --2- 172.21.15.52:0/4037447095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fb015ca00 0x7f0fb0073a30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.563+0000 7f0fb589a640 1 --2- 172.21.15.52:0/4037447095 >> v2:172.21.15.102:3300/0 conn(0x7f0fb00c8870 0x7f0fb015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.563+0000 7f0fb589a640 1 -- 172.21.15.52:0/4037447095 >> 172.21.15.52:0/4037447095 conn(0x7f0fb0074d50 msgr2=0x7f0fb0075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.563+0000 7f0fb589a640 1 -- 172.21.15.52:0/4037447095 shutdown_connections 2024-04-25T13:16:18.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.563+0000 7f0fb589a640 1 -- 172.21.15.52:0/4037447095 wait complete. 2024-04-25T13:16:18.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.564+0000 7f0fb589a640 1 Processor -- start 2024-04-25T13:16:18.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.564+0000 7f0fb589a640 1 -- start start 2024-04-25T13:16:18.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0fb589a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fb00c8870 0x7f0fb00cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0fb589a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fb0152f70 0x7f0fb014fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0fb589a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb015ca00 0x7f0fb01480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0fb589a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb0153350 con 0x7f0fb00c8870 2024-04-25T13:16:18.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0fb589a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb015ce20 con 0x7f0fb0152f70 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0fb589a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb01534d0 con 0x7f0fb015ca00 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0faeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fb00c8870 0x7f0fb00cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0faeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fb00c8870 0x7f0fb00cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55658/0 (socket says 172.21.15.52:55658) 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0faeffd640 1 -- 172.21.15.52:0/509842690 learned_addr learned my addr 172.21.15.52:0/509842690 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0fae7fc640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fb0152f70 0x7f0fb014fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0faf7fe640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb015ca00 0x7f0fb01480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0faeffd640 1 -- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb015ca00 msgr2=0x7f0fb01480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0faeffd640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb015ca00 0x7f0fb01480e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0faeffd640 1 -- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fb0152f70 msgr2=0x7f0fb014fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0faeffd640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fb0152f70 0x7f0fb014fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0faeffd640 1 -- 172.21.15.52:0/509842690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb0150360 con 0x7f0fb00c8870 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0faeffd640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fb00c8870 0x7f0fb00cb200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000c500 tx=0x7f0fa000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0f97fff640 1 -- 172.21.15.52:0/509842690 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0018070 con 0x7f0fb00c8870 2024-04-25T13:16:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0f97fff640 1 -- 172.21.15.52:0/509842690 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa0007580 con 0x7f0fb00c8870 2024-04-25T13:16:18.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0f97fff640 1 -- 172.21.15.52:0/509842690 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0004a20 con 0x7f0fb00c8870 2024-04-25T13:16:18.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.565+0000 7f0fb589a640 1 -- 172.21.15.52:0/509842690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb014f660 con 0x7f0fb00c8870 2024-04-25T13:16:18.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.566+0000 7f0fb589a640 1 -- 172.21.15.52:0/509842690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb014e080 con 0x7f0fb00c8870 2024-04-25T13:16:18.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.567+0000 7f0fb589a640 1 -- 172.21.15.52:0/509842690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb0068e40 con 0x7f0fb00c8870 2024-04-25T13:16:18.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.567+0000 7f0f97fff640 1 -- 172.21.15.52:0/509842690 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0fa001b070 con 0x7f0fb00c8870 2024-04-25T13:16:18.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.568+0000 7f0f97fff640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f0f9c06c8f0 0x7f0f9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.568+0000 7f0f97fff640 1 -- 172.21.15.52:0/509842690 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0fa008b050 con 0x7f0fb00c8870 2024-04-25T13:16:18.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.568+0000 7f0fae7fc640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f0f9c06c8f0 0x7f0f9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.568+0000 7f0fae7fc640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f0f9c06c8f0 0x7f0f9c06edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0148a00 tx=0x7f0fa4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.572+0000 7f0f97fff640 1 -- 172.21.15.52:0/509842690 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0fb0150360 con 0x7f0fb00c8870 2024-04-25T13:16:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.799+0000 7f0fb589a640 1 -- 172.21.15.52:0/509842690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0fb01479a0 con 0x7f0fb00c8870 2024-04-25T13:16:18.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.800+0000 7f0f97fff640 1 -- 172.21.15.52:0/509842690 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f0fa0058b80 con 0x7f0fb00c8870 2024-04-25T13:16:18.800 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T13:16:18.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.802+0000 7f0fb589a640 1 -- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f0f9c06c8f0 msgr2=0x7f0f9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.802+0000 7f0fb589a640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f0f9c06c8f0 0x7f0f9c06edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0148a00 tx=0x7f0fa4008040 comp rx=0 tx=0).stop 2024-04-25T13:16:18.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.802+0000 7f0fb589a640 1 -- 172.21.15.52:0/509842690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fb00c8870 msgr2=0x7f0fb00cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.802+0000 7f0fb589a640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fb00c8870 0x7f0fb00cb200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000c500 tx=0x7f0fa000c9c0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.802+0000 7f0fb589a640 1 -- 172.21.15.52:0/509842690 shutdown_connections 2024-04-25T13:16:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.802+0000 7f0fb589a640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f0f9c06c8f0 0x7f0f9c06edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.802+0000 7f0fb589a640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb015ca00 0x7f0fb01480e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.802+0000 7f0fb589a640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fb0152f70 0x7f0fb014fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.802+0000 7f0fb589a640 1 --2- 172.21.15.52:0/509842690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fb00c8870 0x7f0fb00cb200 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.802+0000 7f0fb589a640 1 -- 172.21.15.52:0/509842690 >> 172.21.15.52:0/509842690 conn(0x7f0fb0074d50 msgr2=0x7f0fb00c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.802+0000 7f0fb589a640 1 -- 172.21.15.52:0/509842690 shutdown_connections 2024-04-25T13:16:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18.802+0000 7f0fb589a640 1 -- 172.21.15.52:0/509842690 wait complete. 2024-04-25T13:16:18.813 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T13:16:18.813 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:16:18.813 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-04-25T13:16:18.813 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T13:16:18.813 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:18.813 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T13:16:18.813 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:16:18.813 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:16:18.813 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T13:16:18.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:18.814 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-04-25T13:16:18.829 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:16:18.829 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:16:18.829 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:16:18.829 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:16:18.829 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-04-25T13:16:18.829 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:16:18.829 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42709sec preferred_lft 42709sec 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link noprefixroute 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:16:18.830 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-04-25T13:16:18.831 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-04-25T13:16:18.831 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:16:18.831 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:18.831 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T13:16:18.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:16:18.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2024-04-25T13:16:18.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2024-04-25T13:16:18.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:16:18.832 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T13:16:18.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:19.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:19.012 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:16:19.037 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:19.039 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-04-25T13:16:19.114 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-04-25T13:16:19.114 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:16:19.114 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T13:16:19.114 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T13:16:19.114 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:16:19.115 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:19.115 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T13:16:19.115 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T13:16:19.115 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T13:16:19.115 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T13:16:19.115 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T13:16:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:19.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:19.376 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-04-25T13:16:19.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:19.391 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2024-04-25T13:16:19.446 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:19.446 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T13:16:19.446 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:19.446 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T13:16:19.446 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T13:16:19.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:19.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:19.565 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T13:16:19.565 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:19.565 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T13:16:19.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T13:16:19.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:16:19.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T13:16:19.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T13:16:19.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T13:16:19.565 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T13:16:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:19.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:19.709 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:19.709 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T13:16:19.709 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-04-25T13:16:19.709 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:16:19.709 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T13:16:19.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:19.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:19.787 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T13:16:19.787 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:16:19.788 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T13:16:19.802 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:16:19.802 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:19.857 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-04-25T13:16:19.923 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:16:19.978 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/selinux 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:16:19.979 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:16:19.980 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:16:19.981 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:16:19.981 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2024-04-25T13:16:19.981 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:19.981 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:19.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:19.981 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-04-25T13:16:20.034 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T13:16:20.034 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T13:16:20.076 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-04-25T13:16:20.101 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:16:20.157 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2024-04-25T13:16:20.157 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2024-04-25T13:16:20.157 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2024-04-25T13:16:20.157 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2024-04-25T13:16:20.157 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2024-04-25T13:16:20.157 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2024-04-25T13:16:20.157 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2024-04-25T13:16:20.157 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2024-04-25T13:16:20.157 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2024-04-25T13:16:20.157 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2024-04-25T13:16:20.157 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2024-04-25T13:16:20.158 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/selinux 2024-04-25T13:16:20.158 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:16:20.158 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2024-04-25T13:16:20.158 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2024-04-25T13:16:20.158 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2024-04-25T13:16:20.158 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2024-04-25T13:16:20.158 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:16:20.158 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2024-04-25T13:16:20.158 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2024-04-25T13:16:20.158 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:16:20.158 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:16:20.158 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:16:20.159 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:16:20.159 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2024-04-25T13:16:20.159 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2024-04-25T13:16:20.159 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:16:20.159 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:16:20.159 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:16:20.159 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:16:20.159 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2024-04-25T13:16:20.159 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:20.159 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:20.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:20.160 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-04-25T13:16:20.165 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi052.stderr:2024-04-25T13:16:20.165+0000 7f916f84a480 -1 init, newargv = 0x558689ae4720 newargc=15 2024-04-25T13:16:20.165 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi052.stderr:ceph-fuse[41131]: starting ceph client 2024-04-25T13:16:20.171 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi052.stderr:ceph-fuse[41131]: starting fuse 2024-04-25T13:16:20.181 INFO:teuthology.orchestra.run.smithi052.stdout:43 2024-04-25T13:16:20.181 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-25T13:16:20.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo stdin-killer -- python3 -c ' 2024-04-25T13:16:20.181 DEBUG:teuthology.orchestra.run.smithi052:> import glob 2024-04-25T13:16:20.181 DEBUG:teuthology.orchestra.run.smithi052:> import re 2024-04-25T13:16:20.181 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-04-25T13:16:20.181 DEBUG:teuthology.orchestra.run.smithi052:> import subprocess 2024-04-25T13:16:20.181 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> def _find_admin_socket(client_name): 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> files = glob.glob(asok_path) 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> # Given a non-glob path, it better be there 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> if "*" not in asok_path: 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> assert(len(files) == 1) 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> return files[0] 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> for f in files: 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T13:16:20.182 DEBUG:teuthology.orchestra.run.smithi052:> contents = proc_f.read() 2024-04-25T13:16:20.183 DEBUG:teuthology.orchestra.run.smithi052:> if mountpoint in contents: 2024-04-25T13:16:20.183 DEBUG:teuthology.orchestra.run.smithi052:> return f 2024-04-25T13:16:20.183 DEBUG:teuthology.orchestra.run.smithi052:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T13:16:20.183 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-25T13:16:20.183 DEBUG:teuthology.orchestra.run.smithi052:> print(_find_admin_socket("client.admin")) 2024-04-25T13:16:20.183 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-04-25T13:16:20.300 INFO:teuthology.orchestra.run.smithi052.stdout:/var/run/ceph/ceph-client.admin.41131.asok 2024-04-25T13:16:20.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:20.311 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41131.asok 2024-04-25T13:16:20.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:20.311 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41131.asok status 2024-04-25T13:16:20.447 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": { 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: "entity_id": "admin", 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: "hostname": "smithi052", 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: "pid": "41131", 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: "root": "/" 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_count": 0, 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_pinned_count": 0, 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4479, 2024-04-25T13:16:20.448 INFO:teuthology.orchestra.run.smithi052.stdout: "inst": { 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: "name": { 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "client", 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: "num": 4479 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 2013292250 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 2013292250 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T13:16:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: "inst_str": "client.4479 192.168.0.1:0/2013292250", 2024-04-25T13:16:20.450 INFO:teuthology.orchestra.run.smithi052.stdout: "addr_str": "192.168.0.1:0/2013292250", 2024-04-25T13:16:20.450 INFO:teuthology.orchestra.run.smithi052.stdout: "inode_count": 1, 2024-04-25T13:16:20.450 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_epoch": 6, 2024-04-25T13:16:20.450 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch": 25, 2024-04-25T13:16:20.450 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch_barrier": 0, 2024-04-25T13:16:20.450 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklisted": false, 2024-04-25T13:16:20.450 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs" 2024-04-25T13:16:20.450 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:16:20.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:20.456 DEBUG:teuthology.orchestra.run.smithi052:> stat --file-system '--printf=%T 2024-04-25T13:16:20.456 DEBUG:teuthology.orchestra.run.smithi052:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:20.472 INFO:teuthology.orchestra.run.smithi052.stdout:fuseblk 2024-04-25T13:16:20.472 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:20.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:20.472 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:20.537 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T13:16:20.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:16:21.052 INFO:teuthology.orchestra.run.smithi052.stdout:# file: . 2024-04-25T13:16:21.053 INFO:teuthology.orchestra.run.smithi052.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T13:16:21.053 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:21.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:21.059 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:16:21.059 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:16:21.076 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:21.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.218+0000 7f0130df7640 1 Processor -- start 2024-04-25T13:16:21.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.218+0000 7f0130df7640 1 -- start start 2024-04-25T13:16:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.219+0000 7f0130df7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f012c0d08a0 0x7f012c0d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.219+0000 7f0130df7640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f012c1558c0 con 0x7f012c1554e0 2024-04-25T13:16:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.219+0000 7f0130df7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f012c0cb8c0 con 0x7f012c0b3c00 2024-04-25T13:16:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.219+0000 7f0130df7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f012c0b4a80 con 0x7f012c0d08a0 2024-04-25T13:16:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.219+0000 7f012a59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f012c1554e0 0x7f012c15f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50984/0 (socket says 172.21.15.52:50984) 2024-04-25T13:16:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.219+0000 7f012a59c640 1 -- 172.21.15.52:0/929661513 learned_addr learned my addr 172.21.15.52:0/929661513 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.219+0000 7f012ad9d640 1 --2- 172.21.15.52:0/929661513 >> v2:172.21.15.102:3300/0 conn(0x7f012c0d08a0 0x7f012c0d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.219+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937196620 0 0) 0x7f0124001110 con 0x7f012c1554e0 2024-04-25T13:16:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.219+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0118003520 con 0x7f012c1554e0 2024-04-25T13:16:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1830479948 0 0) 0x7f0118003520 con 0x7f012c1554e0 2024-04-25T13:16:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 >> v2:172.21.15.102:3300/0 conn(0x7f012c0d08a0 msgr2=0x7f012c0d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 --2- 172.21.15.52:0/929661513 >> v2:172.21.15.102:3300/0 conn(0x7f012c0d08a0 0x7f012c0d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 >> v1:172.21.15.102:6789/0 conn(0x7f012c0b3c00 legacy=0x7f012c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012c0cbba0 con 0x7f012c1554e0 2024-04-25T13:16:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f0124001840 con 0x7f012c1554e0 2024-04-25T13:16:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 >> v1:172.21.15.52:6789/0 conn(0x7f012c1554e0 legacy=0x7f012c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 --2- 172.21.15.52:0/929661513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01180039b0 0x7f0118003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 --2- 172.21.15.52:0/929661513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 0x7f0118004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 --2- 172.21.15.52:0/929661513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01180051c0 0x7f011800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f012c0b4a80 con 0x7f0118004800 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f011800c070 con 0x7f01180039b0 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f011800c270 con 0x7f01180051c0 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f0129d9b640 1 --2- 172.21.15.52:0/929661513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 0x7f0118004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012a59c640 1 --2- 172.21.15.52:0/929661513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01180039b0 0x7f0118003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012ad9d640 1 --2- 172.21.15.52:0/929661513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01180051c0 0x7f011800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f0129d9b640 1 -- 172.21.15.52:0/929661513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01180051c0 msgr2=0x7f011800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f0129d9b640 1 --2- 172.21.15.52:0/929661513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01180051c0 0x7f011800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f0129d9b640 1 -- 172.21.15.52:0/929661513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01180039b0 msgr2=0x7f0118003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f0129d9b640 1 --2- 172.21.15.52:0/929661513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01180039b0 0x7f0118003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f0129d9b640 1 -- 172.21.15.52:0/929661513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0118003520 con 0x7f0118004800 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.220+0000 7f012ad9d640 1 -- 172.21.15.52:0/929661513 reap_dead start 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.221+0000 7f0129d9b640 1 --2- 172.21.15.52:0/929661513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 0x7f0118004c80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0114001750 tx=0x7f0118005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b315a8f5da65c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.221+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0114001370 con 0x7f0118004800 2024-04-25T13:16:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.221+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01140052d0 con 0x7f0118004800 2024-04-25T13:16:21.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.221+0000 7f012959a640 1 -- 172.21.15.52:0/929661513 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011402abc0 con 0x7f0118004800 2024-04-25T13:16:21.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.221+0000 7f0130df7640 1 -- 172.21.15.52:0/929661513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 msgr2=0x7f0118004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.221+0000 7f0130df7640 1 --2- 172.21.15.52:0/929661513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 0x7f0118004c80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0114001750 tx=0x7f0118005830 comp rx=0 tx=0).stop 2024-04-25T13:16:21.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.222+0000 7f0130df7640 1 -- 172.21.15.52:0/929661513 shutdown_connections 2024-04-25T13:16:21.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.222+0000 7f0130df7640 1 --2- 172.21.15.52:0/929661513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 0x7f0118004c80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.222+0000 7f0130df7640 1 -- 172.21.15.52:0/929661513 >> 172.21.15.52:0/929661513 conn(0x7f012c074d50 msgr2=0x7f012c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:21.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.222+0000 7f0130df7640 1 -- 172.21.15.52:0/929661513 shutdown_connections 2024-04-25T13:16:21.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.222+0000 7f0130df7640 1 -- 172.21.15.52:0/929661513 wait complete. 2024-04-25T13:16:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.223+0000 7f0130df7640 1 Processor -- start 2024-04-25T13:16:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.223+0000 7f0130df7640 1 -- start start 2024-04-25T13:16:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f0130df7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 0x7f012c14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f0130df7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f012c0caac0 0x7f012c1f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f0130df7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f012c14f410 0x7f012c14af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f0130df7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f012c0b4710 con 0x7f0118004800 2024-04-25T13:16:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f0130df7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f012c0b4430 con 0x7f012c0caac0 2024-04-25T13:16:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f0130df7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f012c0b3580 con 0x7f012c14f410 2024-04-25T13:16:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f012a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 0x7f012c14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f012a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 0x7f012c14ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38844/0 (socket says 172.21.15.52:38844) 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f012a59c640 1 -- 172.21.15.52:0/3283620920 learned_addr learned my addr 172.21.15.52:0/3283620920 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f0129d9b640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f012c0caac0 0x7f012c1f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f012ad9d640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f012c14f410 0x7f012c14af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f012a59c640 1 -- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f012c14f410 msgr2=0x7f012c14af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f012a59c640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f012c14f410 0x7f012c14af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f012a59c640 1 -- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f012c0caac0 msgr2=0x7f012c1f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f012a59c640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f012c0caac0 0x7f012c1f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f012a59c640 1 -- 172.21.15.52:0/3283620920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012c0c8cd0 con 0x7f0118004800 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f0129d9b640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f012c0caac0 0x7f012c1f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f012ad9d640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f012c14f410 0x7f012c14af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.224+0000 7f012a59c640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 0x7f012c14ddd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0124007290 tx=0x7f0124007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.225+0000 7f0122ffd640 1 -- 172.21.15.52:0/3283620920 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124001230 con 0x7f0118004800 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.225+0000 7f0122ffd640 1 -- 172.21.15.52:0/3283620920 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0124018070 con 0x7f0118004800 2024-04-25T13:16:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.225+0000 7f0130df7640 1 -- 172.21.15.52:0/3283620920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012c0c89f0 con 0x7f0118004800 2024-04-25T13:16:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.225+0000 7f0122ffd640 1 -- 172.21.15.52:0/3283620920 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012400fba0 con 0x7f0118004800 2024-04-25T13:16:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.225+0000 7f0130df7640 1 -- 172.21.15.52:0/3283620920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012c14c210 con 0x7f0118004800 2024-04-25T13:16:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.225+0000 7f0130df7640 1 -- 172.21.15.52:0/3283620920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f012c068e40 con 0x7f0118004800 2024-04-25T13:16:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.226+0000 7f0122ffd640 1 -- 172.21.15.52:0/3283620920 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f012400fd40 con 0x7f0118004800 2024-04-25T13:16:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.227+0000 7f0122ffd640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f010c06c8f0 0x7f010c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.227+0000 7f0122ffd640 1 -- 172.21.15.52:0/3283620920 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f012408be10 con 0x7f0118004800 2024-04-25T13:16:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.227+0000 7f0129d9b640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f010c06c8f0 0x7f010c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.227+0000 7f0129d9b640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f010c06c8f0 0x7f010c06edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0114032000 tx=0x7f011402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.231+0000 7f0122ffd640 1 -- 172.21.15.52:0/3283620920 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f012c1558c0 con 0x7f0118004800 2024-04-25T13:16:21.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.417+0000 7f0130df7640 1 -- 172.21.15.52:0/3283620920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f012c0cc260 con 0x7f0118004800 2024-04-25T13:16:21.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.418+0000 7f0122ffd640 1 -- 172.21.15.52:0/3283620920 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f01240598b0 con 0x7f0118004800 2024-04-25T13:16:21.418 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:21.419 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":25,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:14.018518+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:21.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.420+0000 7f0130df7640 1 -- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f010c06c8f0 msgr2=0x7f010c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.420+0000 7f0130df7640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f010c06c8f0 0x7f010c06edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0114032000 tx=0x7f011402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.420+0000 7f0130df7640 1 -- 172.21.15.52:0/3283620920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 msgr2=0x7f012c14ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.420+0000 7f0130df7640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 0x7f012c14ddd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0124007290 tx=0x7f0124007750 comp rx=0 tx=0).stop 2024-04-25T13:16:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.420+0000 7f0130df7640 1 -- 172.21.15.52:0/3283620920 shutdown_connections 2024-04-25T13:16:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.420+0000 7f0130df7640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f010c06c8f0 0x7f010c06edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.420+0000 7f0130df7640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f012c14f410 0x7f012c14af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.420+0000 7f0130df7640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f012c0caac0 0x7f012c1f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.420+0000 7f0130df7640 1 --2- 172.21.15.52:0/3283620920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0118004800 0x7f012c14ddd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.420+0000 7f0130df7640 1 -- 172.21.15.52:0/3283620920 >> 172.21.15.52:0/3283620920 conn(0x7f012c074d50 msgr2=0x7f012c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.420+0000 7f0130df7640 1 -- 172.21.15.52:0/3283620920 shutdown_connections 2024-04-25T13:16:21.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.420+0000 7f0130df7640 1 -- 172.21.15.52:0/3283620920 wait complete. 2024-04-25T13:16:21.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.833544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:05.935596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:06.297991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:10.015464+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:16:21.431 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.536+0000 7fdd3139b640 1 Processor -- start 2024-04-25T13:16:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.536+0000 7fdd3139b640 1 -- start start 2024-04-25T13:16:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd3139b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd2c151fc0 0x7fdd2c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd3139b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd2c159d00 0x7fdd2c0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd3139b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2c15b420 con 0x7fdd2c0ca470 2024-04-25T13:16:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd3139b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdd2c15b700 con 0x7fdd2c159d00 2024-04-25T13:16:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd3139b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2c15b9e0 con 0x7fdd2c151fc0 2024-04-25T13:16:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd2b7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd2c159d00 0x7fdd2c0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd23fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdd2c0ca470 0x7fdd2c1595f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50996/0 (socket says 172.21.15.52:50996) 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd23fff640 1 -- 172.21.15.52:0/4162394907 learned_addr learned my addr 172.21.15.52:0/4162394907 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd2affd640 1 --2- 172.21.15.52:0/4162394907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd2c151fc0 0x7fdd2c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd2b7fe640 1 -- 172.21.15.52:0/4162394907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd2c151fc0 msgr2=0x7fdd2c0c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd2b7fe640 1 --2- 172.21.15.52:0/4162394907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd2c151fc0 0x7fdd2c0c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd2b7fe640 1 -- 172.21.15.52:0/4162394907 >> v1:172.21.15.52:6789/0 conn(0x7fdd2c0ca470 legacy=0x7fdd2c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd2b7fe640 1 -- 172.21.15.52:0/4162394907 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c15bcc0 con 0x7fdd2c159d00 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd2a7fc640 1 -- 172.21.15.52:0/4162394907 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3048687542 0 0) 0x7fdd2c15b420 con 0x7fdd2c0ca470 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.537+0000 7fdd2affd640 1 --2- 172.21.15.52:0/4162394907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd2c151fc0 0x7fdd2c0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.538+0000 7fdd2b7fe640 1 --2- 172.21.15.52:0/4162394907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2c159d00 0x7fdd2c0c8660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009d90 tx=0x7fdd2402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9774a4eef82060fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.538+0000 7fdd2a7fc640 1 -- 172.21.15.52:0/4162394907 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24007740 con 0x7fdd2c159d00 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.538+0000 7fdd2a7fc640 1 -- 172.21.15.52:0/4162394907 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd240078e0 con 0x7fdd2c159d00 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.538+0000 7fdd2a7fc640 1 -- 172.21.15.52:0/4162394907 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24007cb0 con 0x7fdd2c159d00 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.539+0000 7fdd3139b640 1 -- 172.21.15.52:0/4162394907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2c159d00 msgr2=0x7fdd2c0c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.539+0000 7fdd3139b640 1 --2- 172.21.15.52:0/4162394907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2c159d00 0x7fdd2c0c8660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009d90 tx=0x7fdd2402a6f0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.539+0000 7fdd3139b640 1 -- 172.21.15.52:0/4162394907 shutdown_connections 2024-04-25T13:16:21.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.539+0000 7fdd3139b640 1 --2- 172.21.15.52:0/4162394907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2c159d00 0x7fdd2c0c8660 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.539+0000 7fdd3139b640 1 --2- 172.21.15.52:0/4162394907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd2c151fc0 0x7fdd2c0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.539+0000 7fdd3139b640 1 -- 172.21.15.52:0/4162394907 >> 172.21.15.52:0/4162394907 conn(0x7fdd2c06b920 msgr2=0x7fdd2c06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.539+0000 7fdd3139b640 1 -- 172.21.15.52:0/4162394907 shutdown_connections 2024-04-25T13:16:21.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.539+0000 7fdd3139b640 1 -- 172.21.15.52:0/4162394907 wait complete. 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.540+0000 7fdd3139b640 1 Processor -- start 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.540+0000 7fdd3139b640 1 -- start start 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd3139b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2c0ca470 0x7fdd2c1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd3139b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c151fc0 0x7fdd2c1f2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd3139b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd2c159d00 0x7fdd2c1e3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd3139b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c1523a0 con 0x7fdd2c0ca470 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd3139b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c158b80 con 0x7fdd2c151fc0 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd3139b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2c1f24b0 con 0x7fdd2c159d00 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd2affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2c0ca470 0x7fdd2c1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd2affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2c0ca470 0x7fdd2c1547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38868/0 (socket says 172.21.15.52:38868) 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd2affd640 1 -- 172.21.15.52:0/3735411441 learned_addr learned my addr 172.21.15.52:0/3735411441 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd23fff640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c151fc0 0x7fdd2c1f2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd2b7fe640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd2c159d00 0x7fdd2c1e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd2affd640 1 -- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd2c159d00 msgr2=0x7fdd2c1e3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd2affd640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd2c159d00 0x7fdd2c1e3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd2affd640 1 -- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c151fc0 msgr2=0x7fdd2c1f2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd2affd640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c151fc0 0x7fdd2c1f2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd2affd640 1 -- 172.21.15.52:0/3735411441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c0ca210 con 0x7fdd2c0ca470 2024-04-25T13:16:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd2affd640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2c0ca470 0x7fdd2c1547b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00e7e0 tx=0x7fdd1c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd237fe640 1 -- 172.21.15.52:0/3735411441 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c00f040 con 0x7fdd2c0ca470 2024-04-25T13:16:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd237fe640 1 -- 172.21.15.52:0/3735411441 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1c004030 con 0x7fdd2c0ca470 2024-04-25T13:16:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.541+0000 7fdd3139b640 1 -- 172.21.15.52:0/3735411441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2c1f21b0 con 0x7fdd2c0ca470 2024-04-25T13:16:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.542+0000 7fdd237fe640 1 -- 172.21.15.52:0/3735411441 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c004400 con 0x7fdd2c0ca470 2024-04-25T13:16:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.542+0000 7fdd3139b640 1 -- 172.21.15.52:0/3735411441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd2c0c6fe0 con 0x7fdd2c0ca470 2024-04-25T13:16:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.542+0000 7fdd3139b640 1 -- 172.21.15.52:0/3735411441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd2c0c7320 con 0x7fdd2c0ca470 2024-04-25T13:16:21.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.543+0000 7fdd237fe640 1 -- 172.21.15.52:0/3735411441 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd1c00c6d0 con 0x7fdd2c0ca470 2024-04-25T13:16:21.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.543+0000 7fdd237fe640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fdd0c06c8f0 0x7fdd0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.543+0000 7fdd237fe640 1 -- 172.21.15.52:0/3735411441 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdd1c08bcd0 con 0x7fdd2c0ca470 2024-04-25T13:16:21.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.544+0000 7fdd23fff640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fdd0c06c8f0 0x7fdd0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.544+0000 7fdd23fff640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fdd0c06c8f0 0x7fdd0c06edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0c4410 tx=0x7fdd14007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.548+0000 7fdd237fe640 1 -- 172.21.15.52:0/3735411441 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd2c0c7320 con 0x7fdd2c0ca470 2024-04-25T13:16:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.738+0000 7fdd3139b640 1 -- 172.21.15.52:0/3735411441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd2c068f50 con 0x7fdd2c0ca470 2024-04-25T13:16:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.738+0000 7fdd237fe640 1 -- 172.21.15.52:0/3735411441 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fdd1c017020 con 0x7fdd2c0ca470 2024-04-25T13:16:21.739 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T13:16:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.740+0000 7fdd3139b640 1 -- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fdd0c06c8f0 msgr2=0x7fdd0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.740+0000 7fdd3139b640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fdd0c06c8f0 0x7fdd0c06edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0c4410 tx=0x7fdd14007d50 comp rx=0 tx=0).stop 2024-04-25T13:16:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.740+0000 7fdd3139b640 1 -- 172.21.15.52:0/3735411441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2c0ca470 msgr2=0x7fdd2c1547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.740+0000 7fdd3139b640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2c0ca470 0x7fdd2c1547b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00e7e0 tx=0x7fdd1c00eca0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.740+0000 7fdd3139b640 1 -- 172.21.15.52:0/3735411441 shutdown_connections 2024-04-25T13:16:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.740+0000 7fdd3139b640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fdd0c06c8f0 0x7fdd0c06edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.740+0000 7fdd3139b640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd2c159d00 0x7fdd2c1e3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.740+0000 7fdd3139b640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c151fc0 0x7fdd2c1f2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.740+0000 7fdd3139b640 1 --2- 172.21.15.52:0/3735411441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2c0ca470 0x7fdd2c1547b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.740+0000 7fdd3139b640 1 -- 172.21.15.52:0/3735411441 >> 172.21.15.52:0/3735411441 conn(0x7fdd2c06b920 msgr2=0x7fdd2c14f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.740+0000 7fdd3139b640 1 -- 172.21.15.52:0/3735411441 shutdown_connections 2024-04-25T13:16:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.740+0000 7fdd3139b640 1 -- 172.21.15.52:0/3735411441 wait complete. 2024-04-25T13:16:21.751 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:16:21.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.855+0000 7fb244119640 1 Processor -- start 2024-04-25T13:16:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.855+0000 7fb244119640 1 -- start start 2024-04-25T13:16:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.856+0000 7fb244119640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb23c16bd20 0x7fb23c0cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.856+0000 7fb244119640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23c0c3480 con 0x7fb23c0ccb30 2024-04-25T13:16:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.856+0000 7fb244119640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23c16c170 con 0x7fb23c1654e0 2024-04-25T13:16:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.856+0000 7fb244119640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb23c0c3250 con 0x7fb23c16bd20 2024-04-25T13:16:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.856+0000 7fb2426b6640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb23c0ccb30 0x7fb23c172640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51004/0 (socket says 172.21.15.52:51004) 2024-04-25T13:16:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.856+0000 7fb2426b6640 1 -- 172.21.15.52:0/165188593 learned_addr learned my addr 172.21.15.52:0/165188593 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.856+0000 7fb2416b4640 1 --2- 172.21.15.52:0/165188593 >> v2:172.21.15.102:3300/0 conn(0x7fb23c16bd20 0x7fb23c0cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.856+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659991950 0 0) 0x7fb23c0c3480 con 0x7fb23c0ccb30 2024-04-25T13:16:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb228003500 con 0x7fb23c0ccb30 2024-04-25T13:16:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450050331 0 0) 0x7fb23c16c170 con 0x7fb23c1654e0 2024-04-25T13:16:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb23c0c3480 con 0x7fb23c1654e0 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1141328990 0 0) 0x7fb228003500 con 0x7fb23c0ccb30 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 >> v2:172.21.15.102:3300/0 conn(0x7fb23c16bd20 msgr2=0x7fb23c0cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 --2- 172.21.15.52:0/165188593 >> v2:172.21.15.102:3300/0 conn(0x7fb23c16bd20 0x7fb23c0cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 >> v1:172.21.15.102:6789/0 conn(0x7fb23c1654e0 legacy=0x7fb23c071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c167da0 con 0x7fb23c0ccb30 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7fb234001a10 con 0x7fb23c0ccb30 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 >> v1:172.21.15.52:6789/0 conn(0x7fb23c0ccb30 legacy=0x7fb23c172640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 --2- 172.21.15.52:0/165188593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 0x7fb2280040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 --2- 172.21.15.52:0/165188593 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb228004610 0x7fb22800d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 --2- 172.21.15.52:0/165188593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb22800d950 0x7fb22800fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb228010440 con 0x7fb228003cd0 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb2280105f0 con 0x7fb22800d950 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb2280107f0 con 0x7fb228004610 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb241eb5640 1 --2- 172.21.15.52:0/165188593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 0x7fb2280040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb2426b6640 1 --2- 172.21.15.52:0/165188593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb22800d950 0x7fb22800fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.880+0000 7fb2416b4640 1 --2- 172.21.15.52:0/165188593 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb228004610 0x7fb22800d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.881+0000 7fb241eb5640 1 -- 172.21.15.52:0/165188593 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb228004610 msgr2=0x7fb22800d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.881+0000 7fb241eb5640 1 --2- 172.21.15.52:0/165188593 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb228004610 0x7fb22800d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.881+0000 7fb241eb5640 1 -- 172.21.15.52:0/165188593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb22800d950 msgr2=0x7fb22800fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.881+0000 7fb241eb5640 1 --2- 172.21.15.52:0/165188593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb22800d950 0x7fb22800fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.881+0000 7fb241eb5640 1 -- 172.21.15.52:0/165188593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb228003500 con 0x7fb228003cd0 2024-04-25T13:16:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.881+0000 7fb2426b6640 1 -- 172.21.15.52:0/165188593 reap_dead start 2024-04-25T13:16:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.881+0000 7fb241eb5640 1 --2- 172.21.15.52:0/165188593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 0x7fb2280040d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb2380018d0 tx=0x7fb228004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff07f3b0ca2052e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.881+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2380014f0 con 0x7fb228003cd0 2024-04-25T13:16:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.881+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2380052d0 con 0x7fb228003cd0 2024-04-25T13:16:21.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.882+0000 7fb240eb3640 1 -- 172.21.15.52:0/165188593 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23802ac70 con 0x7fb228003cd0 2024-04-25T13:16:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.882+0000 7fb244119640 1 -- 172.21.15.52:0/165188593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 msgr2=0x7fb2280040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.882+0000 7fb244119640 1 --2- 172.21.15.52:0/165188593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 0x7fb2280040d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb2380018d0 tx=0x7fb228004d50 comp rx=0 tx=0).stop 2024-04-25T13:16:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.882+0000 7fb244119640 1 -- 172.21.15.52:0/165188593 shutdown_connections 2024-04-25T13:16:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.882+0000 7fb244119640 1 --2- 172.21.15.52:0/165188593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 0x7fb2280040d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.882+0000 7fb244119640 1 -- 172.21.15.52:0/165188593 >> 172.21.15.52:0/165188593 conn(0x7fb23c068360 msgr2=0x7fb23c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.882+0000 7fb244119640 1 -- 172.21.15.52:0/165188593 shutdown_connections 2024-04-25T13:16:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.882+0000 7fb244119640 1 -- 172.21.15.52:0/165188593 wait complete. 2024-04-25T13:16:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.883+0000 7fb244119640 1 Processor -- start 2024-04-25T13:16:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.883+0000 7fb244119640 1 -- start start 2024-04-25T13:16:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb244119640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 0x7fb23c0c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb244119640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c1fd9c0 0x7fb23c0c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb244119640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb23c0c67f0 0x7fb23c16a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb244119640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c1658c0 con 0x7fb228003cd0 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb244119640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c0734d0 con 0x7fb23c0c67f0 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb244119640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb23c1686b0 con 0x7fb23c1fd9c0 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb241eb5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 0x7fb23c0c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb241eb5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 0x7fb23c0c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38882/0 (socket says 172.21.15.52:38882) 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb241eb5640 1 -- 172.21.15.52:0/2751149662 learned_addr learned my addr 172.21.15.52:0/2751149662 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb2426b6640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb23c0c67f0 0x7fb23c16a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb2416b4640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c1fd9c0 0x7fb23c0c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb241eb5640 1 -- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c1fd9c0 msgr2=0x7fb23c0c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb241eb5640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c1fd9c0 0x7fb23c0c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb241eb5640 1 -- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb23c0c67f0 msgr2=0x7fb23c16a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb241eb5640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb23c0c67f0 0x7fb23c16a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb241eb5640 1 -- 172.21.15.52:0/2751149662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c0c59b0 con 0x7fb228003cd0 2024-04-25T13:16:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.884+0000 7fb2416b4640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c1fd9c0 0x7fb23c0c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.885+0000 7fb241eb5640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 0x7fb23c0c5470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb238005040 tx=0x7fb2380012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.885+0000 7fb2327fc640 1 -- 172.21.15.52:0/2751149662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238037040 con 0x7fb228003cd0 2024-04-25T13:16:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.885+0000 7fb2327fc640 1 -- 172.21.15.52:0/2751149662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb238005480 con 0x7fb228003cd0 2024-04-25T13:16:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.885+0000 7fb244119640 1 -- 172.21.15.52:0/2751149662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23c161f60 con 0x7fb228003cd0 2024-04-25T13:16:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.885+0000 7fb2327fc640 1 -- 172.21.15.52:0/2751149662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2380014f0 con 0x7fb228003cd0 2024-04-25T13:16:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.885+0000 7fb244119640 1 -- 172.21.15.52:0/2751149662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23c0cab60 con 0x7fb228003cd0 2024-04-25T13:16:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.886+0000 7fb2327fc640 1 -- 172.21.15.52:0/2751149662 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb238044020 con 0x7fb228003cd0 2024-04-25T13:16:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.886+0000 7fb244119640 1 -- 172.21.15.52:0/2751149662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23c068e40 con 0x7fb228003cd0 2024-04-25T13:16:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.887+0000 7fb2327fc640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb22006c920 0x7fb22006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.887+0000 7fb2327fc640 1 -- 172.21.15.52:0/2751149662 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb2380ab980 con 0x7fb228003cd0 2024-04-25T13:16:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.887+0000 7fb2416b4640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb22006c920 0x7fb22006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.888+0000 7fb2416b4640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb22006c920 0x7fb22006ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb23c16b010 tx=0x7fb22c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:21.891+0000 7fb2327fc640 1 -- 172.21.15.52:0/2751149662 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb23804b020 con 0x7fb228003cd0 2024-04-25T13:16:22.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.077+0000 7fb244119640 1 -- 172.21.15.52:0/2751149662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb23c0c2fb0 con 0x7fb228003cd0 2024-04-25T13:16:22.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.077+0000 7fb2327fc640 1 -- 172.21.15.52:0/2751149662 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fb238079a70 con 0x7fb228003cd0 2024-04-25T13:16:22.077 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T13:16:22.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.079+0000 7fb244119640 1 -- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb22006c920 msgr2=0x7fb22006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.079+0000 7fb244119640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb22006c920 0x7fb22006ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb23c16b010 tx=0x7fb22c008040 comp rx=0 tx=0).stop 2024-04-25T13:16:22.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.079+0000 7fb244119640 1 -- 172.21.15.52:0/2751149662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 msgr2=0x7fb23c0c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.079+0000 7fb244119640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 0x7fb23c0c5470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb238005040 tx=0x7fb2380012d0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.079+0000 7fb244119640 1 -- 172.21.15.52:0/2751149662 shutdown_connections 2024-04-25T13:16:22.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.079+0000 7fb244119640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb22006c920 0x7fb22006ede0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.079+0000 7fb244119640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c1fd9c0 0x7fb23c0c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.079+0000 7fb244119640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb23c0c67f0 0x7fb23c16a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.079+0000 7fb244119640 1 --2- 172.21.15.52:0/2751149662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb228003cd0 0x7fb23c0c5470 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.079+0000 7fb244119640 1 -- 172.21.15.52:0/2751149662 >> 172.21.15.52:0/2751149662 conn(0x7fb23c068360 msgr2=0x7fb23c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:22.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.079+0000 7fb244119640 1 -- 172.21.15.52:0/2751149662 shutdown_connections 2024-04-25T13:16:22.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.079+0000 7fb244119640 1 -- 172.21.15.52:0/2751149662 wait complete. 2024-04-25T13:16:22.090 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:16:22.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.192+0000 7fd71c4cb640 1 Processor -- start 2024-04-25T13:16:22.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.192+0000 7fd71c4cb640 1 -- start start 2024-04-25T13:16:22.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.193+0000 7fd71c4cb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd71406cc00 0x7fd71415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.193+0000 7fd71c4cb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd71406cfe0 0x7fd714154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.193+0000 7fd71c4cb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd71415f500 con 0x7fd7140cbc00 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.193+0000 7fd71c4cb640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd7140cd140 con 0x7fd71406cc00 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.193+0000 7fd71c4cb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd71415b190 con 0x7fd71406cfe0 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd71aa68640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd7140cbc00 0x7fd7140c5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51010/0 (socket says 172.21.15.52:51010) 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd71aa68640 1 -- 172.21.15.52:0/312762010 learned_addr learned my addr 172.21.15.52:0/312762010 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd71a267640 1 --2- 172.21.15.52:0/312762010 >> v2:172.21.15.102:3300/0 conn(0x7fd71406cc00 0x7fd71415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 13235052 0 0) 0x7fd704001490 con 0x7fd7140cbc00 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719a66640 1 --2- 172.21.15.52:0/312762010 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd71406cfe0 0x7fd714154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6fc003520 con 0x7fd7140cbc00 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3976302192 0 0) 0x7fd6fc003520 con 0x7fd7140cbc00 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd71406cfe0 msgr2=0x7fd714154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 --2- 172.21.15.52:0/312762010 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd71406cfe0 0x7fd714154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 >> v2:172.21.15.102:3300/0 conn(0x7fd71406cc00 msgr2=0x7fd71415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 --2- 172.21.15.52:0/312762010 >> v2:172.21.15.102:3300/0 conn(0x7fd71406cc00 0x7fd71415efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71415b470 con 0x7fd7140cbc00 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7fd704001bc0 con 0x7fd7140cbc00 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 >> v1:172.21.15.52:6789/0 conn(0x7fd7140cbc00 legacy=0x7fd7140c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 --2- 172.21.15.52:0/312762010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6fc0039b0 0x7fd6fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 --2- 172.21.15.52:0/312762010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc004800 0x7fd6fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 --2- 172.21.15.52:0/312762010 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd71406cfe0 0x7fd6fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd7140cd140 con 0x7fd6fc0039b0 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd71415b190 con 0x7fd6fc004800 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd6fc00ba40 con 0x7fd71406cfe0 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd71a267640 1 --2- 172.21.15.52:0/312762010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6fc0039b0 0x7fd6fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd719a66640 1 --2- 172.21.15.52:0/312762010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc004800 0x7fd6fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.194+0000 7fd71aa68640 1 --2- 172.21.15.52:0/312762010 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd71406cfe0 0x7fd6fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.195+0000 7fd71a267640 1 -- 172.21.15.52:0/312762010 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd71406cfe0 msgr2=0x7fd6fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:22.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.195+0000 7fd71a267640 1 --2- 172.21.15.52:0/312762010 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd71406cfe0 0x7fd6fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.195+0000 7fd71a267640 1 -- 172.21.15.52:0/312762010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc004800 msgr2=0x7fd6fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:22.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.195+0000 7fd71a267640 1 --2- 172.21.15.52:0/312762010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc004800 0x7fd6fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.195+0000 7fd71a267640 1 -- 172.21.15.52:0/312762010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6fc003520 con 0x7fd6fc0039b0 2024-04-25T13:16:22.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.195+0000 7fd71a267640 1 --2- 172.21.15.52:0/312762010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6fc0039b0 0x7fd6fc003dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009ac0 tx=0x7fd6fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b197e4b412359 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:22.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.195+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c036070 con 0x7fd6fc0039b0 2024-04-25T13:16:22.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.195+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd70c031400 con 0x7fd6fc0039b0 2024-04-25T13:16:22.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.195+0000 7fd719265640 1 -- 172.21.15.52:0/312762010 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c009690 con 0x7fd6fc0039b0 2024-04-25T13:16:22.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.196+0000 7fd71c4cb640 1 -- 172.21.15.52:0/312762010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6fc0039b0 msgr2=0x7fd6fc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.196+0000 7fd71c4cb640 1 --2- 172.21.15.52:0/312762010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6fc0039b0 0x7fd6fc003dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009ac0 tx=0x7fd6fc005830 comp rx=0 tx=0).stop 2024-04-25T13:16:22.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.196+0000 7fd71aa68640 1 -- 172.21.15.52:0/312762010 reap_dead start 2024-04-25T13:16:22.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.196+0000 7fd71c4cb640 1 -- 172.21.15.52:0/312762010 shutdown_connections 2024-04-25T13:16:22.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.196+0000 7fd71c4cb640 1 -- 172.21.15.52:0/312762010 >> 172.21.15.52:0/312762010 conn(0x7fd714075570 msgr2=0x7fd714073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:22.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.196+0000 7fd71c4cb640 1 -- 172.21.15.52:0/312762010 shutdown_connections 2024-04-25T13:16:22.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.196+0000 7fd71c4cb640 1 -- 172.21.15.52:0/312762010 wait complete. 2024-04-25T13:16:22.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.197+0000 7fd71c4cb640 1 Processor -- start 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.197+0000 7fd71c4cb640 1 -- start start 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71c4cb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc0039b0 0x7fd7140c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71c4cb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7141513d0 0x7fd7140c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71c4cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71415d1f0 0x7fd71415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71c4cb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd71415bd10 con 0x7fd71415d1f0 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71c4cb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd71415ba30 con 0x7fd6fc0039b0 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71c4cb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd7140c6010 con 0x7fd7141513d0 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71aa68640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71415d1f0 0x7fd71415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71aa68640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71415d1f0 0x7fd71415d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38900/0 (socket says 172.21.15.52:38900) 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71aa68640 1 -- 172.21.15.52:0/1247281874 learned_addr learned my addr 172.21.15.52:0/1247281874 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd719a66640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7141513d0 0x7fd7140c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71aa68640 1 -- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7141513d0 msgr2=0x7fd7140c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71aa68640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7141513d0 0x7fd7140c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71aa68640 1 -- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc0039b0 msgr2=0x7fd7140c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71aa68640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc0039b0 0x7fd7140c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71aa68640 1 -- 172.21.15.52:0/1247281874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7141f4bc0 con 0x7fd71415d1f0 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.198+0000 7fd71aa68640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71415d1f0 0x7fd71415d6a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd714074180 tx=0x7fd70400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.199+0000 7fd712ffd640 1 -- 172.21.15.52:0/1247281874 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704007920 con 0x7fd71415d1f0 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.199+0000 7fd712ffd640 1 -- 172.21.15.52:0/1247281874 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd704018070 con 0x7fd71415d1f0 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.199+0000 7fd71c4cb640 1 -- 172.21.15.52:0/1247281874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7141f4e60 con 0x7fd71415d1f0 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.199+0000 7fd712ffd640 1 -- 172.21.15.52:0/1247281874 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704013630 con 0x7fd71415d1f0 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.199+0000 7fd71c4cb640 1 -- 172.21.15.52:0/1247281874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd71415eea0 con 0x7fd71415d1f0 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.200+0000 7fd71c4cb640 1 -- 172.21.15.52:0/1247281874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd714068f50 con 0x7fd71415d1f0 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.200+0000 7fd712ffd640 1 -- 172.21.15.52:0/1247281874 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd7040137d0 con 0x7fd71415d1f0 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.200+0000 7fd712ffd640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd70006c8f0 0x7fd70006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.201+0000 7fd712ffd640 1 -- 172.21.15.52:0/1247281874 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd70408c4a0 con 0x7fd71415d1f0 2024-04-25T13:16:22.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.201+0000 7fd71a267640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd70006c8f0 0x7fd70006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.201+0000 7fd71a267640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd70006c8f0 0x7fd70006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd70c033000 tx=0x7fd70c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:22.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.205+0000 7fd712ffd640 1 -- 172.21.15.52:0/1247281874 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd71415f500 con 0x7fd71415d1f0 2024-04-25T13:16:22.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.389+0000 7fd71c4cb640 1 -- 172.21.15.52:0/1247281874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd7140cc2b0 con 0x7fd71415d1f0 2024-04-25T13:16:22.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.389+0000 7fd712ffd640 1 -- 172.21.15.52:0/1247281874 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fd70405a620 con 0x7fd71415d1f0 2024-04-25T13:16:22.390 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-25T13:16:22.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.391+0000 7fd71c4cb640 1 -- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd70006c8f0 msgr2=0x7fd70006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.391+0000 7fd71c4cb640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd70006c8f0 0x7fd70006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd70c033000 tx=0x7fd70c02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.391+0000 7fd71c4cb640 1 -- 172.21.15.52:0/1247281874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71415d1f0 msgr2=0x7fd71415d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.391+0000 7fd71c4cb640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71415d1f0 0x7fd71415d6a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd714074180 tx=0x7fd70400aec0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.391+0000 7fd71c4cb640 1 -- 172.21.15.52:0/1247281874 shutdown_connections 2024-04-25T13:16:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.391+0000 7fd71c4cb640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd70006c8f0 0x7fd70006edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.391+0000 7fd71c4cb640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7141513d0 0x7fd7140c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.391+0000 7fd71c4cb640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71415d1f0 0x7fd71415d6a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.391+0000 7fd71c4cb640 1 --2- 172.21.15.52:0/1247281874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc0039b0 0x7fd7140c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.391+0000 7fd71c4cb640 1 -- 172.21.15.52:0/1247281874 >> 172.21.15.52:0/1247281874 conn(0x7fd714075570 msgr2=0x7fd714151e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.391+0000 7fd71c4cb640 1 -- 172.21.15.52:0/1247281874 shutdown_connections 2024-04-25T13:16:22.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.391+0000 7fd71c4cb640 1 -- 172.21.15.52:0/1247281874 wait complete. 2024-04-25T13:16:22.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:16:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.505+0000 7fa1e6f6f640 1 Processor -- start 2024-04-25T13:16:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.505+0000 7fa1e6f6f640 1 -- start start 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1e6f6f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00cb270 0x7fa1e006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1e6f6f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1e00c60c0 0x7fa1e00c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1e6f6f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e00c5900 con 0x7fa1e0155220 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1e6f6f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e015c040 con 0x7fa1e00c60c0 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1e6f6f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e00ccb70 con 0x7fa1e00cb270 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1e550c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1e00c60c0 0x7fa1e00c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1e550c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1e00c60c0 0x7fa1e00c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38916/0 (socket says 172.21.15.52:38916) 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1e550c640 1 -- 172.21.15.52:0/4154023154 learned_addr learned my addr 172.21.15.52:0/4154023154 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1dffff640 1 --2- 172.21.15.52:0/4154023154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00cb270 0x7fa1e006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1e550c640 1 -- 172.21.15.52:0/4154023154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00cb270 msgr2=0x7fa1e006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1e550c640 1 --2- 172.21.15.52:0/4154023154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00cb270 0x7fa1e006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1e550c640 1 -- 172.21.15.52:0/4154023154 >> v1:172.21.15.102:6789/0 conn(0x7fa1e0155220 legacy=0x7fa1e00d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1e550c640 1 -- 172.21.15.52:0/4154023154 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e00cc4f0 con 0x7fa1e00c60c0 2024-04-25T13:16:22.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.506+0000 7fa1dffff640 1 --2- 172.21.15.52:0/4154023154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00cb270 0x7fa1e006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.507+0000 7fa1e550c640 1 --2- 172.21.15.52:0/4154023154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1e00c60c0 0x7fa1e00c6550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009870 tx=0x7fa1c802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b181a522aa4812 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.507+0000 7fa1df7fe640 1 -- 172.21.15.52:0/4154023154 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8037070 con 0x7fa1e00c60c0 2024-04-25T13:16:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.507+0000 7fa1df7fe640 1 -- 172.21.15.52:0/4154023154 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c802ae50 con 0x7fa1e00c60c0 2024-04-25T13:16:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.507+0000 7fa1df7fe640 1 -- 172.21.15.52:0/4154023154 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8032860 con 0x7fa1e00c60c0 2024-04-25T13:16:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.508+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/4154023154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1e00c60c0 msgr2=0x7fa1e00c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.508+0000 7fa1e6f6f640 1 --2- 172.21.15.52:0/4154023154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1e00c60c0 0x7fa1e00c6550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009870 tx=0x7fa1c802a300 comp rx=0 tx=0).stop 2024-04-25T13:16:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.508+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/4154023154 shutdown_connections 2024-04-25T13:16:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.508+0000 7fa1e6f6f640 1 --2- 172.21.15.52:0/4154023154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1e00c60c0 0x7fa1e00c6550 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.508+0000 7fa1e6f6f640 1 --2- 172.21.15.52:0/4154023154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00cb270 0x7fa1e006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.508+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/4154023154 >> 172.21.15.52:0/4154023154 conn(0x7fa1e0075170 msgr2=0x7fa1e0075580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.508+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/4154023154 shutdown_connections 2024-04-25T13:16:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.508+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/4154023154 wait complete. 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.509+0000 7fa1e6f6f640 1 Processor -- start 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.509+0000 7fa1e6f6f640 1 -- start start 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e6f6f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1e00c60c0 0x7fa1e014cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e6f6f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1e00cb270 0x7fa1e015ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e6f6f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e0155220 0x7fa1e0151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e6f6f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e015bd60 con 0x7fa1e00c60c0 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e6f6f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e00c5c30 con 0x7fa1e00cb270 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e6f6f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e0155600 con 0x7fa1e0155220 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e4d0b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1e00c60c0 0x7fa1e014cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e4d0b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1e00c60c0 0x7fa1e014cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38918/0 (socket says 172.21.15.52:38918) 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e4d0b640 1 -- 172.21.15.52:0/1323997254 learned_addr learned my addr 172.21.15.52:0/1323997254 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e550c640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e0155220 0x7fa1e0151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1dffff640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1e00cb270 0x7fa1e015ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e4d0b640 1 -- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e0155220 msgr2=0x7fa1e0151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e4d0b640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e0155220 0x7fa1e0151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e4d0b640 1 -- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1e00cb270 msgr2=0x7fa1e015ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e4d0b640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1e00cb270 0x7fa1e015ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e4d0b640 1 -- 172.21.15.52:0/1323997254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e00cf840 con 0x7fa1e00c60c0 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.510+0000 7fa1e550c640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e0155220 0x7fa1e0151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.511+0000 7fa1e4d0b640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1e00c60c0 0x7fa1e014cf40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800c760 tx=0x7fa1d800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.511+0000 7fa1dd7fa640 1 -- 172.21.15.52:0/1323997254 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8016020 con 0x7fa1e00c60c0 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.511+0000 7fa1dd7fa640 1 -- 172.21.15.52:0/1323997254 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d8006d50 con 0x7fa1e00c60c0 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.511+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/1323997254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e01f1920 con 0x7fa1e00c60c0 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.511+0000 7fa1dd7fa640 1 -- 172.21.15.52:0/1323997254 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8003bb0 con 0x7fa1e00c60c0 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.511+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/1323997254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e01f0b60 con 0x7fa1e00c60c0 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.512+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/1323997254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e0068e40 con 0x7fa1e00c60c0 2024-04-25T13:16:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.512+0000 7fa1dd7fa640 1 -- 172.21.15.52:0/1323997254 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa1d800a850 con 0x7fa1e00c60c0 2024-04-25T13:16:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.513+0000 7fa1dd7fa640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa1c006c920 0x7fa1c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.513+0000 7fa1dd7fa640 1 -- 172.21.15.52:0/1323997254 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa1d808ba30 con 0x7fa1e00c60c0 2024-04-25T13:16:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.513+0000 7fa1dffff640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa1c006c920 0x7fa1c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.513+0000 7fa1dffff640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa1c006c920 0x7fa1c006ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00b3370 tx=0x7fa1d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.517+0000 7fa1dd7fa640 1 -- 172.21.15.52:0/1323997254 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa1d8020020 con 0x7fa1e00c60c0 2024-04-25T13:16:22.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.701+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/1323997254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa1e00cb7a0 con 0x7fa1e00c60c0 2024-04-25T13:16:22.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.701+0000 7fa1dd7fa640 1 -- 172.21.15.52:0/1323997254 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fa1d8059b30 con 0x7fa1e00c60c0 2024-04-25T13:16:22.702 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T13:16:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.703+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa1c006c920 msgr2=0x7fa1c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.703+0000 7fa1e6f6f640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa1c006c920 0x7fa1c006ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00b3370 tx=0x7fa1d0008040 comp rx=0 tx=0).stop 2024-04-25T13:16:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.703+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/1323997254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1e00c60c0 msgr2=0x7fa1e014cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.703+0000 7fa1e6f6f640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1e00c60c0 0x7fa1e014cf40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800c760 tx=0x7fa1d800cc20 comp rx=0 tx=0).stop 2024-04-25T13:16:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.703+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/1323997254 shutdown_connections 2024-04-25T13:16:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.703+0000 7fa1e6f6f640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa1c006c920 0x7fa1c006ede0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.703+0000 7fa1e6f6f640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e0155220 0x7fa1e0151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.703+0000 7fa1e6f6f640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1e00cb270 0x7fa1e015ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.703+0000 7fa1e6f6f640 1 --2- 172.21.15.52:0/1323997254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1e00c60c0 0x7fa1e014cf40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.703+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/1323997254 >> 172.21.15.52:0/1323997254 conn(0x7fa1e0075170 msgr2=0x7fa1e00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.703+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/1323997254 shutdown_connections 2024-04-25T13:16:22.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.703+0000 7fa1e6f6f640 1 -- 172.21.15.52:0/1323997254 wait complete. 2024-04-25T13:16:22.714 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:16:22.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.816+0000 7fbcfd064640 1 Processor -- start 2024-04-25T13:16:22.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.816+0000 7fbcfd064640 1 -- start start 2024-04-25T13:16:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcfd064640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbcf80cb330 0x7fbcf80cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcfd064640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf806d540 con 0x7fbcf8155230 2024-04-25T13:16:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcfd064640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf815b4c0 con 0x7fbcf815b030 2024-04-25T13:16:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcfd064640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf80c9a80 con 0x7fbcf80cb330 2024-04-25T13:16:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcf6d9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbcf8155230 0x7fbcf8071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51022/0 (socket says 172.21.15.52:51022) 2024-04-25T13:16:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcf6d9d640 1 -- 172.21.15.52:0/1404425609 learned_addr learned my addr 172.21.15.52:0/1404425609 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcf759e640 1 --2- 172.21.15.52:0/1404425609 >> v2:172.21.15.102:3300/0 conn(0x7fbcf80cb330 0x7fbcf80cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcf659c640 1 -- 172.21.15.52:0/1404425609 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588500520 0 0) 0x7fbcf806d540 con 0x7fbcf8155230 2024-04-25T13:16:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcf659c640 1 -- 172.21.15.52:0/1404425609 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbce4003520 con 0x7fbcf8155230 2024-04-25T13:16:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcf659c640 1 -- 172.21.15.52:0/1404425609 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1352800765 0 0) 0x7fbce4003520 con 0x7fbcf8155230 2024-04-25T13:16:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcf759e640 1 -- 172.21.15.52:0/1404425609 >> v1:172.21.15.102:6789/0 conn(0x7fbcf815b030 legacy=0x7fbcf815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcf759e640 1 -- 172.21.15.52:0/1404425609 >> v1:172.21.15.52:6789/0 conn(0x7fbcf8155230 legacy=0x7fbcf8071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.817+0000 7fbcf759e640 1 -- 172.21.15.52:0/1404425609 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf815b7a0 con 0x7fbcf80cb330 2024-04-25T13:16:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.818+0000 7fbcf759e640 1 --2- 172.21.15.52:0/1404425609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcf80cb330 0x7fbcf80cb7e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009dc0 tx=0x7fbcf002a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74531515a3cfd847 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.818+0000 7fbcf659c640 1 -- 172.21.15.52:0/1404425609 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8001670 con 0x7fbcf80cb330 2024-04-25T13:16:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.818+0000 7fbcf659c640 1 -- 172.21.15.52:0/1404425609 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf0007540 con 0x7fbcf80cb330 2024-04-25T13:16:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.818+0000 7fbcf659c640 1 -- 172.21.15.52:0/1404425609 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00078f0 con 0x7fbcf80cb330 2024-04-25T13:16:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.819+0000 7fbcfd064640 1 -- 172.21.15.52:0/1404425609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcf80cb330 msgr2=0x7fbcf80cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.819+0000 7fbcfd064640 1 --2- 172.21.15.52:0/1404425609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcf80cb330 0x7fbcf80cb7e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009dc0 tx=0x7fbcf002a6c0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.819+0000 7fbcfd064640 1 -- 172.21.15.52:0/1404425609 shutdown_connections 2024-04-25T13:16:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.819+0000 7fbcfd064640 1 --2- 172.21.15.52:0/1404425609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcf80cb330 0x7fbcf80cb7e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.819+0000 7fbcfd064640 1 -- 172.21.15.52:0/1404425609 >> 172.21.15.52:0/1404425609 conn(0x7fbcf8074f30 msgr2=0x7fbcf8075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.819+0000 7fbcfd064640 1 -- 172.21.15.52:0/1404425609 shutdown_connections 2024-04-25T13:16:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.819+0000 7fbcfd064640 1 -- 172.21.15.52:0/1404425609 wait complete. 2024-04-25T13:16:22.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.820+0000 7fbcfd064640 1 Processor -- start 2024-04-25T13:16:22.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.820+0000 7fbcfd064640 1 -- start start 2024-04-25T13:16:22.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcfd064640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbcf80cb330 0x7fbcf81f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcfd064640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcf8155230 0x7fbcf8148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcfd064640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf815cbb0 0x7fbcf8149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcfd064640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf815e7c0 con 0x7fbcf815cbb0 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcfd064640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf815bd60 con 0x7fbcf8155230 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcfd064640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf815f3f0 con 0x7fbcf80cb330 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcf759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf815cbb0 0x7fbcf8149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcf759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf815cbb0 0x7fbcf8149bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38928/0 (socket says 172.21.15.52:38928) 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcf759e640 1 -- 172.21.15.52:0/3265430986 learned_addr learned my addr 172.21.15.52:0/3265430986 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcf6d9d640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbcf80cb330 0x7fbcf81f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbceffff640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcf8155230 0x7fbcf8148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcf759e640 1 -- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbcf80cb330 msgr2=0x7fbcf81f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcf759e640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbcf80cb330 0x7fbcf81f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcf759e640 1 -- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcf8155230 msgr2=0x7fbcf8148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcf759e640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcf8155230 0x7fbcf8148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbcf759e640 1 -- 172.21.15.52:0/3265430986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf8149910 con 0x7fbcf815cbb0 2024-04-25T13:16:22.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.821+0000 7fbceffff640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcf8155230 0x7fbcf8148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:22.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.822+0000 7fbcf759e640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf815cbb0 0x7fbcf8149bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbcf002acb0 tx=0x7fbcf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:22.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.822+0000 7fbcef7fe640 1 -- 172.21.15.52:0/3265430986 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0009450 con 0x7fbcf815cbb0 2024-04-25T13:16:22.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.822+0000 7fbcef7fe640 1 -- 172.21.15.52:0/3265430986 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf0004260 con 0x7fbcf815cbb0 2024-04-25T13:16:22.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.822+0000 7fbcfd064640 1 -- 172.21.15.52:0/3265430986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf81f0c00 con 0x7fbcf815cbb0 2024-04-25T13:16:22.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.822+0000 7fbcef7fe640 1 -- 172.21.15.52:0/3265430986 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0004650 con 0x7fbcf815cbb0 2024-04-25T13:16:22.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.822+0000 7fbcfd064640 1 -- 172.21.15.52:0/3265430986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf81f11c0 con 0x7fbcf815cbb0 2024-04-25T13:16:22.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.823+0000 7fbcfd064640 1 -- 172.21.15.52:0/3265430986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf81f13c0 con 0x7fbcf815cbb0 2024-04-25T13:16:22.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.823+0000 7fbcef7fe640 1 -- 172.21.15.52:0/3265430986 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbcf0039040 con 0x7fbcf815cbb0 2024-04-25T13:16:22.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.824+0000 7fbcef7fe640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbcd806c920 0x7fbcd806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.824+0000 7fbcef7fe640 1 -- 172.21.15.52:0/3265430986 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbcf00ad3d0 con 0x7fbcf815cbb0 2024-04-25T13:16:22.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.824+0000 7fbcf6d9d640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbcd806c920 0x7fbcd806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.825+0000 7fbcf6d9d640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbcd806c920 0x7fbcd806ede0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbce8005880 tx=0x7fbce8000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:22.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:22.828+0000 7fbcef7fe640 1 -- 172.21.15.52:0/3265430986 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbcf81f13c0 con 0x7fbcf815cbb0 2024-04-25T13:16:23.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.026+0000 7fbcfd064640 1 -- 172.21.15.52:0/3265430986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbcf8068e40 con 0x7fbcf815cbb0 2024-04-25T13:16:23.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.026+0000 7fbcef7fe640 1 -- 172.21.15.52:0/3265430986 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fbcf0040030 con 0x7fbcf815cbb0 2024-04-25T13:16:23.026 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-04-25T13:16:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.028+0000 7fbcfd064640 1 -- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbcd806c920 msgr2=0x7fbcd806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.028+0000 7fbcfd064640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbcd806c920 0x7fbcd806ede0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbce8005880 tx=0x7fbce8000bc0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.028+0000 7fbcfd064640 1 -- 172.21.15.52:0/3265430986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf815cbb0 msgr2=0x7fbcf8149bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.028+0000 7fbcfd064640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf815cbb0 0x7fbcf8149bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbcf002acb0 tx=0x7fbcf0004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.028+0000 7fbcfd064640 1 -- 172.21.15.52:0/3265430986 shutdown_connections 2024-04-25T13:16:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.028+0000 7fbcfd064640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbcd806c920 0x7fbcd806ede0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.028+0000 7fbcfd064640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf815cbb0 0x7fbcf8149bf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.028+0000 7fbcfd064640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcf8155230 0x7fbcf8148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.028+0000 7fbcfd064640 1 --2- 172.21.15.52:0/3265430986 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbcf80cb330 0x7fbcf81f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.028+0000 7fbcfd064640 1 -- 172.21.15.52:0/3265430986 >> 172.21.15.52:0/3265430986 conn(0x7fbcf8074f30 msgr2=0x7fbcf8073a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.028+0000 7fbcfd064640 1 -- 172.21.15.52:0/3265430986 shutdown_connections 2024-04-25T13:16:23.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.028+0000 7fbcfd064640 1 -- 172.21.15.52:0/3265430986 wait complete. 2024-04-25T13:16:23.039 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:16:23.039 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:16:23.055 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:23.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.195+0000 7fb5a359e640 1 Processor -- start 2024-04-25T13:16:23.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.195+0000 7fb5a359e640 1 -- start start 2024-04-25T13:16:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.196+0000 7fb5a359e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb59c155350 0x7fb59c0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.196+0000 7fb5a359e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb59c0c5a30 0x7fb59c0c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.196+0000 7fb5a359e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb59c15ef10 con 0x7fb59c0ccd20 2024-04-25T13:16:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.196+0000 7fb5a359e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb59c0cb0a0 con 0x7fb59c0c5a30 2024-04-25T13:16:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.196+0000 7fb5a359e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb59c15f1f0 con 0x7fb59c155350 2024-04-25T13:16:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.197+0000 7fb5a2d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb59c0c5a30 0x7fb59c0c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.197+0000 7fb5a2d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb59c0c5a30 0x7fb59c0c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38936/0 (socket says 172.21.15.52:38936) 2024-04-25T13:16:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.197+0000 7fb5a2d9d640 1 -- 172.21.15.52:0/894188659 learned_addr learned my addr 172.21.15.52:0/894188659 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.197+0000 7fb5a259c640 1 --2- 172.21.15.52:0/894188659 >> v2:172.21.15.102:3300/0 conn(0x7fb59c155350 0x7fb59c0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.197+0000 7fb5a2d9d640 1 -- 172.21.15.52:0/894188659 >> v2:172.21.15.102:3300/0 conn(0x7fb59c155350 msgr2=0x7fb59c0cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.197+0000 7fb5a2d9d640 1 --2- 172.21.15.52:0/894188659 >> v2:172.21.15.102:3300/0 conn(0x7fb59c155350 0x7fb59c0cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.197+0000 7fb5a2d9d640 1 -- 172.21.15.52:0/894188659 >> v1:172.21.15.102:6789/0 conn(0x7fb59c0ccd20 legacy=0x7fb59c06c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.197+0000 7fb5a2d9d640 1 -- 172.21.15.52:0/894188659 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59c0cb2f0 con 0x7fb59c0c5a30 2024-04-25T13:16:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.197+0000 7fb5a2d9d640 1 --2- 172.21.15.52:0/894188659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb59c0c5a30 0x7fb59c0c5f80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0cc590 tx=0x7fb59402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ada81b5138b87b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.198+0000 7fb5a159a640 1 -- 172.21.15.52:0/894188659 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594036070 con 0x7fb59c0c5a30 2024-04-25T13:16:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.198+0000 7fb5a159a640 1 -- 172.21.15.52:0/894188659 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb594031600 con 0x7fb59c0c5a30 2024-04-25T13:16:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.198+0000 7fb5a159a640 1 -- 172.21.15.52:0/894188659 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5940319d0 con 0x7fb59c0c5a30 2024-04-25T13:16:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.198+0000 7fb5a359e640 1 -- 172.21.15.52:0/894188659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb59c0c5a30 msgr2=0x7fb59c0c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.198+0000 7fb5a359e640 1 --2- 172.21.15.52:0/894188659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb59c0c5a30 0x7fb59c0c5f80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0cc590 tx=0x7fb59402a6f0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.198+0000 7fb5a359e640 1 -- 172.21.15.52:0/894188659 shutdown_connections 2024-04-25T13:16:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.198+0000 7fb5a359e640 1 --2- 172.21.15.52:0/894188659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb59c0c5a30 0x7fb59c0c5f80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.198+0000 7fb5a359e640 1 --2- 172.21.15.52:0/894188659 >> v2:172.21.15.102:3300/0 conn(0x7fb59c155350 0x7fb59c0cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.198+0000 7fb5a359e640 1 -- 172.21.15.52:0/894188659 >> 172.21.15.52:0/894188659 conn(0x7fb59c0d0720 msgr2=0x7fb59c0d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.198+0000 7fb5a359e640 1 -- 172.21.15.52:0/894188659 shutdown_connections 2024-04-25T13:16:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.198+0000 7fb5a359e640 1 -- 172.21.15.52:0/894188659 wait complete. 2024-04-25T13:16:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.200+0000 7fb5a359e640 1 Processor -- start 2024-04-25T13:16:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.200+0000 7fb5a359e640 1 -- start start 2024-04-25T13:16:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.200+0000 7fb5a359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb59c0c5a30 0x7fb59c1f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.200+0000 7fb5a359e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb59c0ccd20 0x7fb59c155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.200+0000 7fb5a359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb59c155350 0x7fb59c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.200+0000 7fb5a359e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c06cc30 con 0x7fb59c0c5a30 2024-04-25T13:16:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.200+0000 7fb5a359e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c0cb8b0 con 0x7fb59c155350 2024-04-25T13:16:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.200+0000 7fb5a359e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb59c06cdb0 con 0x7fb59c0ccd20 2024-04-25T13:16:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.200+0000 7fb5a259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb59c0c5a30 0x7fb59c1f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.200+0000 7fb5a259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb59c0c5a30 0x7fb59c1f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38952/0 (socket says 172.21.15.52:38952) 2024-04-25T13:16:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.200+0000 7fb5a259c640 1 -- 172.21.15.52:0/1106357276 learned_addr learned my addr 172.21.15.52:0/1106357276 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb5a2d9d640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb59c155350 0x7fb59c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb5a1d9b640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb59c0ccd20 0x7fb59c155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb5a259c640 1 -- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb59c0ccd20 msgr2=0x7fb59c155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb5a259c640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb59c0ccd20 0x7fb59c155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb5a259c640 1 -- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb59c155350 msgr2=0x7fb59c0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb5a259c640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb59c155350 0x7fb59c0b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb5a259c640 1 -- 172.21.15.52:0/1106357276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59c0b50c0 con 0x7fb59c0c5a30 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb5a259c640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb59c0c5a30 0x7fb59c1f1b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb59800c7f0 tx=0x7fb59800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb592ffd640 1 -- 172.21.15.52:0/1106357276 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598015070 con 0x7fb59c0c5a30 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb592ffd640 1 -- 172.21.15.52:0/1106357276 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb598004220 con 0x7fb59c0c5a30 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb592ffd640 1 -- 172.21.15.52:0/1106357276 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598003610 con 0x7fb59c0c5a30 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb5a359e640 1 -- 172.21.15.52:0/1106357276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb59c0b53a0 con 0x7fb59c0c5a30 2024-04-25T13:16:23.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.201+0000 7fb5a359e640 1 -- 172.21.15.52:0/1106357276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb59c0b5960 con 0x7fb59c0c5a30 2024-04-25T13:16:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.202+0000 7fb5a359e640 1 -- 172.21.15.52:0/1106357276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb59c0c7430 con 0x7fb59c0c5a30 2024-04-25T13:16:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.203+0000 7fb592ffd640 1 -- 172.21.15.52:0/1106357276 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb5980039c0 con 0x7fb59c0c5a30 2024-04-25T13:16:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.203+0000 7fb592ffd640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb58006c920 0x7fb58006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.203+0000 7fb592ffd640 1 -- 172.21.15.52:0/1106357276 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb59808bdc0 con 0x7fb59c0c5a30 2024-04-25T13:16:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.203+0000 7fb5a1d9b640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb58006c920 0x7fb58006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.204+0000 7fb5a1d9b640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb58006c920 0x7fb58006ede0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb59c152d20 tx=0x7fb58c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:23.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.207+0000 7fb592ffd640 1 -- 172.21.15.52:0/1106357276 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb59c0c7430 con 0x7fb59c0c5a30 2024-04-25T13:16:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.398+0000 7fb5a359e640 1 -- 172.21.15.52:0/1106357276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb59c068cc0 con 0x7fb59c0c5a30 2024-04-25T13:16:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.399+0000 7fb592ffd640 1 -- 172.21.15.52:0/1106357276 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fb598059f40 con 0x7fb59c0c5a30 2024-04-25T13:16:23.399 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:23.399 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":25,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:14.018518+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:23.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.401+0000 7fb5a359e640 1 -- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb58006c920 msgr2=0x7fb58006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.401+0000 7fb5a359e640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb58006c920 0x7fb58006ede0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb59c152d20 tx=0x7fb58c008040 comp rx=0 tx=0).stop 2024-04-25T13:16:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.401+0000 7fb5a359e640 1 -- 172.21.15.52:0/1106357276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb59c0c5a30 msgr2=0x7fb59c1f1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.401+0000 7fb5a359e640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb59c0c5a30 0x7fb59c1f1b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb59800c7f0 tx=0x7fb59800ccb0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.401+0000 7fb5a359e640 1 -- 172.21.15.52:0/1106357276 shutdown_connections 2024-04-25T13:16:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.401+0000 7fb5a359e640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb58006c920 0x7fb58006ede0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.401+0000 7fb5a359e640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb59c0ccd20 0x7fb59c155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.401+0000 7fb5a359e640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb59c155350 0x7fb59c0b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.401+0000 7fb5a359e640 1 --2- 172.21.15.52:0/1106357276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb59c0c5a30 0x7fb59c1f1b30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.401+0000 7fb5a359e640 1 -- 172.21.15.52:0/1106357276 >> 172.21.15.52:0/1106357276 conn(0x7fb59c0d0720 msgr2=0x7fb59c0c6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.401+0000 7fb5a359e640 1 -- 172.21.15.52:0/1106357276 shutdown_connections 2024-04-25T13:16:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.401+0000 7fb5a359e640 1 -- 172.21.15.52:0/1106357276 wait complete. 2024-04-25T13:16:23.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.833544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:05.935596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:06.297991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:10.015464+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:16:23.413 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:23.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.516+0000 7f6823e4e640 1 Processor -- start 2024-04-25T13:16:23.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.516+0000 7f6823e4e640 1 -- start start 2024-04-25T13:16:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f6823e4e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f681c06cc00 0x7f681c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f6823e4e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f681c06cfe0 0x7f681c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f6823e4e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f681c15f500 con 0x7f681c0cbc00 2024-04-25T13:16:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f6823e4e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f681c0cd140 con 0x7f681c06cfe0 2024-04-25T13:16:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f6823e4e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f681c15b190 con 0x7f681c06cc00 2024-04-25T13:16:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f68213e9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f681c06cfe0 0x7f681c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f68223eb640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f681c0cbc00 0x7f681c0c5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51032/0 (socket says 172.21.15.52:51032) 2024-04-25T13:16:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f68223eb640 1 -- 172.21.15.52:0/2412945695 learned_addr learned my addr 172.21.15.52:0/2412945695 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f6821bea640 1 --2- 172.21.15.52:0/2412945695 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f681c06cc00 0x7f681c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f68213e9640 1 -- 172.21.15.52:0/2412945695 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f681c06cc00 msgr2=0x7f681c15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:23.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f68213e9640 1 --2- 172.21.15.52:0/2412945695 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f681c06cc00 0x7f681c15efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f68213e9640 1 -- 172.21.15.52:0/2412945695 >> v1:172.21.15.52:6789/0 conn(0x7f681c0cbc00 legacy=0x7f681c0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f68213e9640 1 -- 172.21.15.52:0/2412945695 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681c15b470 con 0x7f681c06cfe0 2024-04-25T13:16:23.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f6820be8640 1 -- 172.21.15.52:0/2412945695 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386019118 0 0) 0x7f6814001490 con 0x7f681c0cbc00 2024-04-25T13:16:23.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.517+0000 7f6821bea640 1 --2- 172.21.15.52:0/2412945695 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f681c06cc00 0x7f681c15efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:23.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.518+0000 7f68213e9640 1 --2- 172.21.15.52:0/2412945695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c06cfe0 0x7f681c154f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f680c0097a0 tx=0x7f680c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c871af4a1e012d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:23.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.518+0000 7f6820be8640 1 -- 172.21.15.52:0/2412945695 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c037070 con 0x7f681c06cfe0 2024-04-25T13:16:23.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.518+0000 7f6820be8640 1 -- 172.21.15.52:0/2412945695 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f680c032440 con 0x7f681c06cfe0 2024-04-25T13:16:23.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.518+0000 7f6820be8640 1 -- 172.21.15.52:0/2412945695 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c032810 con 0x7f681c06cfe0 2024-04-25T13:16:23.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.519+0000 7f6823e4e640 1 -- 172.21.15.52:0/2412945695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c06cfe0 msgr2=0x7f681c154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.519+0000 7f6823e4e640 1 --2- 172.21.15.52:0/2412945695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c06cfe0 0x7f681c154f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f680c0097a0 tx=0x7f680c02a210 comp rx=0 tx=0).stop 2024-04-25T13:16:23.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.519+0000 7f6823e4e640 1 -- 172.21.15.52:0/2412945695 shutdown_connections 2024-04-25T13:16:23.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.519+0000 7f6823e4e640 1 --2- 172.21.15.52:0/2412945695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c06cfe0 0x7f681c154f20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.519+0000 7f6823e4e640 1 --2- 172.21.15.52:0/2412945695 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f681c06cc00 0x7f681c15efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.519+0000 7f6823e4e640 1 -- 172.21.15.52:0/2412945695 >> 172.21.15.52:0/2412945695 conn(0x7f681c075570 msgr2=0x7f681c073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:23.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.519+0000 7f6823e4e640 1 -- 172.21.15.52:0/2412945695 shutdown_connections 2024-04-25T13:16:23.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.519+0000 7f6823e4e640 1 -- 172.21.15.52:0/2412945695 wait complete. 2024-04-25T13:16:23.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.520+0000 7f6823e4e640 1 Processor -- start 2024-04-25T13:16:23.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.520+0000 7f6823e4e640 1 -- start start 2024-04-25T13:16:23.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6823e4e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c06cc00 0x7f681c1f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6823e4e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f681c06cfe0 0x7f681c15d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6823e4e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f681c0cbc00 0x7f681c14ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6823e4e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f681c15bd10 con 0x7f681c06cc00 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6823e4e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f681c15ba30 con 0x7f681c0cbc00 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6823e4e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f681c0c6010 con 0x7f681c06cfe0 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6821bea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c06cc00 0x7f681c1f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6821bea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c06cc00 0x7f681c1f4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38982/0 (socket says 172.21.15.52:38982) 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6821bea640 1 -- 172.21.15.52:0/1618215165 learned_addr learned my addr 172.21.15.52:0/1618215165 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f68223eb640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f681c0cbc00 0x7f681c14ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f68213e9640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f681c06cfe0 0x7f681c15d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6821bea640 1 -- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f681c06cfe0 msgr2=0x7f681c15d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6821bea640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f681c06cfe0 0x7f681c15d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6821bea640 1 -- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f681c0cbc00 msgr2=0x7f681c14ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6821bea640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f681c0cbc00 0x7f681c14ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6821bea640 1 -- 172.21.15.52:0/1618215165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681c1f42f0 con 0x7f681c06cc00 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f68213e9640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f681c06cfe0 0x7f681c15d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:23.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6821bea640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c06cc00 0x7f681c1f4ad0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f681800e810 tx=0x7f681800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:23.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f68127fc640 1 -- 172.21.15.52:0/1618215165 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681800f040 con 0x7f681c06cc00 2024-04-25T13:16:23.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f68127fc640 1 -- 172.21.15.52:0/1618215165 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6818004030 con 0x7f681c06cc00 2024-04-25T13:16:23.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f68127fc640 1 -- 172.21.15.52:0/1618215165 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818004400 con 0x7f681c06cc00 2024-04-25T13:16:23.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.521+0000 7f6823e4e640 1 -- 172.21.15.52:0/1618215165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681c14c2a0 con 0x7f681c06cc00 2024-04-25T13:16:23.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.522+0000 7f6823e4e640 1 -- 172.21.15.52:0/1618215165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f681c1f1960 con 0x7f681c06cc00 2024-04-25T13:16:23.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.523+0000 7f6823e4e640 1 -- 172.21.15.52:0/1618215165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f681c068f50 con 0x7f681c06cc00 2024-04-25T13:16:23.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.523+0000 7f68127fc640 1 -- 172.21.15.52:0/1618215165 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f681800c6d0 con 0x7f681c06cc00 2024-04-25T13:16:23.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.523+0000 7f68127fc640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f680006c8f0 0x7f680006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.523+0000 7f68127fc640 1 -- 172.21.15.52:0/1618215165 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f681808bba0 con 0x7f681c06cc00 2024-04-25T13:16:23.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.523+0000 7f68213e9640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f680006c8f0 0x7f680006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.524+0000 7f68213e9640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f680006c8f0 0x7f680006edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f680c034000 tx=0x7f680c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:23.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.528+0000 7f68127fc640 1 -- 172.21.15.52:0/1618215165 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6818017020 con 0x7f681c06cc00 2024-04-25T13:16:23.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.712+0000 7f6823e4e640 1 -- 172.21.15.52:0/1618215165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f681c0cc2b0 con 0x7f681c06cc00 2024-04-25T13:16:23.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.712+0000 7f68127fc640 1 -- 172.21.15.52:0/1618215165 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f681808b070 con 0x7f681c06cc00 2024-04-25T13:16:23.713 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T13:16:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.714+0000 7f6823e4e640 1 -- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f680006c8f0 msgr2=0x7f680006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.714+0000 7f6823e4e640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f680006c8f0 0x7f680006edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f680c034000 tx=0x7f680c02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.714+0000 7f6823e4e640 1 -- 172.21.15.52:0/1618215165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c06cc00 msgr2=0x7f681c1f4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.714+0000 7f6823e4e640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c06cc00 0x7f681c1f4ad0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f681800e810 tx=0x7f681800ecd0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.714+0000 7f6823e4e640 1 -- 172.21.15.52:0/1618215165 shutdown_connections 2024-04-25T13:16:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.714+0000 7f6823e4e640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f680006c8f0 0x7f680006edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.714+0000 7f6823e4e640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f681c06cfe0 0x7f681c15d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.714+0000 7f6823e4e640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f681c0cbc00 0x7f681c14ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.714+0000 7f6823e4e640 1 --2- 172.21.15.52:0/1618215165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f681c06cc00 0x7f681c1f4ad0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.714+0000 7f6823e4e640 1 -- 172.21.15.52:0/1618215165 >> 172.21.15.52:0/1618215165 conn(0x7f681c075570 msgr2=0x7f681c152770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.714+0000 7f6823e4e640 1 -- 172.21.15.52:0/1618215165 shutdown_connections 2024-04-25T13:16:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.714+0000 7f6823e4e640 1 -- 172.21.15.52:0/1618215165 wait complete. 2024-04-25T13:16:23.725 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:16:23.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.828+0000 7fe938701640 1 Processor -- start 2024-04-25T13:16:23.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.828+0000 7fe938701640 1 -- start start 2024-04-25T13:16:23.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.829+0000 7fe938701640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9301551f0 0x7fe9300704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.829+0000 7fe938701640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9300709e0 con 0x7fe9300ca470 2024-04-25T13:16:23.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.829+0000 7fe938701640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe93015b060 con 0x7fe9301555d0 2024-04-25T13:16:23.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.829+0000 7fe938701640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe93015b320 con 0x7fe9301551f0 2024-04-25T13:16:23.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.829+0000 7fe936c9e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe9300ca470 0x7fe93015e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51036/0 (socket says 172.21.15.52:51036) 2024-04-25T13:16:23.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.829+0000 7fe936c9e640 1 -- 172.21.15.52:0/1391148900 learned_addr learned my addr 172.21.15.52:0/1391148900 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93649d640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9301551f0 0x7fe9300704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1646642707 0 0) 0x7fe9300709e0 con 0x7fe9300ca470 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe918003520 con 0x7fe9300ca470 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2563395344 0 0) 0x7fe918003520 con 0x7fe9300ca470 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9301551f0 msgr2=0x7fe9300704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9301551f0 0x7fe9300704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 >> v1:172.21.15.102:6789/0 conn(0x7fe9301555d0 legacy=0x7fe9300c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93015b600 con 0x7fe9300ca470 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7fe9200019f0 con 0x7fe9300ca470 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 >> v1:172.21.15.52:6789/0 conn(0x7fe9300ca470 legacy=0x7fe93015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9180039e0 0x7fe918003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe918004390 0x7fe918004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9301551f0 0x7fe9180050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe93015b320 con 0x7fe918004390 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe91800b9c0 con 0x7fe9180039e0 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe91800bbc0 con 0x7fe9301551f0 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe935c9c640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe918004390 0x7fe918004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe93649d640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9180039e0 0x7fe918003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe936c9e640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9301551f0 0x7fe9180050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe935c9c640 1 -- 172.21.15.52:0/1391148900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9301551f0 msgr2=0x7fe9180050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe935c9c640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9301551f0 0x7fe9180050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe935c9c640 1 -- 172.21.15.52:0/1391148900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9180039e0 msgr2=0x7fe918003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe935c9c640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9180039e0 0x7fe918003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe935c9c640 1 -- 172.21.15.52:0/1391148900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe918003520 con 0x7fe918004390 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.830+0000 7fe936c9e640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9301551f0 0x7fe9180050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.831+0000 7fe935c9c640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe918004390 0x7fe918004860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe924001860 tx=0x7fe918005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b0e4b5e22e0211 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:23.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.831+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924037070 con 0x7fe918004390 2024-04-25T13:16:23.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.831+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe92402abf0 con 0x7fe918004390 2024-04-25T13:16:23.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.831+0000 7fe93549b640 1 -- 172.21.15.52:0/1391148900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924001430 con 0x7fe918004390 2024-04-25T13:16:23.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.832+0000 7fe938701640 1 -- 172.21.15.52:0/1391148900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe918004390 msgr2=0x7fe918004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.832+0000 7fe938701640 1 --2- 172.21.15.52:0/1391148900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe918004390 0x7fe918004860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe924001860 tx=0x7fe918005830 comp rx=0 tx=0).stop 2024-04-25T13:16:23.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.832+0000 7fe936c9e640 1 -- 172.21.15.52:0/1391148900 reap_dead start 2024-04-25T13:16:23.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.832+0000 7fe938701640 1 -- 172.21.15.52:0/1391148900 shutdown_connections 2024-04-25T13:16:23.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.832+0000 7fe938701640 1 -- 172.21.15.52:0/1391148900 >> 172.21.15.52:0/1391148900 conn(0x7fe93006bd10 msgr2=0x7fe93006c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:23.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.832+0000 7fe938701640 1 -- 172.21.15.52:0/1391148900 shutdown_connections 2024-04-25T13:16:23.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.832+0000 7fe938701640 1 -- 172.21.15.52:0/1391148900 wait complete. 2024-04-25T13:16:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.833+0000 7fe938701640 1 Processor -- start 2024-04-25T13:16:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.833+0000 7fe938701640 1 -- start start 2024-04-25T13:16:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe938701640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe918004390 0x7fe9300cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe938701640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9300c4960 0x7fe9301f0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe938701640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe930154330 0x7fe9301f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe938701640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe93015bea0 con 0x7fe9300c4960 2024-04-25T13:16:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe938701640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe93015bbc0 con 0x7fe930154330 2024-04-25T13:16:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe938701640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe93015ef80 con 0x7fe918004390 2024-04-25T13:16:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe935c9c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9300c4960 0x7fe9301f0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe935c9c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9300c4960 0x7fe9301f0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38992/0 (socket says 172.21.15.52:38992) 2024-04-25T13:16:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe935c9c640 1 -- 172.21.15.52:0/2683737884 learned_addr learned my addr 172.21.15.52:0/2683737884 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe93649d640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe918004390 0x7fe9300cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe936c9e640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe930154330 0x7fe9301f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe935c9c640 1 -- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe918004390 msgr2=0x7fe9300cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe935c9c640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe918004390 0x7fe9300cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe935c9c640 1 -- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe930154330 msgr2=0x7fe9301f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe935c9c640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe930154330 0x7fe9301f0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe935c9c640 1 -- 172.21.15.52:0/2683737884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93014ba90 con 0x7fe9300c4960 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe936c9e640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe930154330 0x7fe9301f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe935c9c640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9300c4960 0x7fe9301f0860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe924001950 tx=0x7fe924001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe92effd640 1 -- 172.21.15.52:0/2683737884 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92403f020 con 0x7fe9300c4960 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe92effd640 1 -- 172.21.15.52:0/2683737884 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe924005270 con 0x7fe9300c4960 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.834+0000 7fe938701640 1 -- 172.21.15.52:0/2683737884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9301f4a30 con 0x7fe9300c4960 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.835+0000 7fe92effd640 1 -- 172.21.15.52:0/2683737884 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924037040 con 0x7fe9300c4960 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.835+0000 7fe938701640 1 -- 172.21.15.52:0/2683737884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe930158930 con 0x7fe9300c4960 2024-04-25T13:16:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.836+0000 7fe938701640 1 -- 172.21.15.52:0/2683737884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe93015b050 con 0x7fe9300c4960 2024-04-25T13:16:23.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.836+0000 7fe92effd640 1 -- 172.21.15.52:0/2683737884 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe924042020 con 0x7fe9300c4960 2024-04-25T13:16:23.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.836+0000 7fe92effd640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe91c06c920 0x7fe91c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:23.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.837+0000 7fe92effd640 1 -- 172.21.15.52:0/2683737884 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe9240abb10 con 0x7fe9300c4960 2024-04-25T13:16:23.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.837+0000 7fe93649d640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe91c06c920 0x7fe91c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:23.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.837+0000 7fe93649d640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe91c06c920 0x7fe91c06ede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe928009bc0 tx=0x7fe928009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:23.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:23.841+0000 7fe92effd640 1 -- 172.21.15.52:0/2683737884 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe93015b050 con 0x7fe9300c4960 2024-04-25T13:16:24.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.030+0000 7fe938701640 1 -- 172.21.15.52:0/2683737884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe930068e40 con 0x7fe9300c4960 2024-04-25T13:16:24.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.031+0000 7fe92effd640 1 -- 172.21.15.52:0/2683737884 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fe924049030 con 0x7fe9300c4960 2024-04-25T13:16:24.031 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T13:16:24.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.033+0000 7fe938701640 1 -- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe91c06c920 msgr2=0x7fe91c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.033+0000 7fe938701640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe91c06c920 0x7fe91c06ede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe928009bc0 tx=0x7fe928009190 comp rx=0 tx=0).stop 2024-04-25T13:16:24.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.033+0000 7fe938701640 1 -- 172.21.15.52:0/2683737884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9300c4960 msgr2=0x7fe9301f0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.033+0000 7fe938701640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9300c4960 0x7fe9301f0860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe924001950 tx=0x7fe924001230 comp rx=0 tx=0).stop 2024-04-25T13:16:24.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.033+0000 7fe938701640 1 -- 172.21.15.52:0/2683737884 shutdown_connections 2024-04-25T13:16:24.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.033+0000 7fe938701640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe91c06c920 0x7fe91c06ede0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.033+0000 7fe938701640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe930154330 0x7fe9301f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.033+0000 7fe938701640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9300c4960 0x7fe9301f0860 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.033+0000 7fe938701640 1 --2- 172.21.15.52:0/2683737884 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe918004390 0x7fe9300cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.033+0000 7fe938701640 1 -- 172.21.15.52:0/2683737884 >> 172.21.15.52:0/2683737884 conn(0x7fe93006bd10 msgr2=0x7fe930147210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.033+0000 7fe938701640 1 -- 172.21.15.52:0/2683737884 shutdown_connections 2024-04-25T13:16:24.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.033+0000 7fe938701640 1 -- 172.21.15.52:0/2683737884 wait complete. 2024-04-25T13:16:24.044 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:16:24.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.147+0000 7f3371867640 1 Processor -- start 2024-04-25T13:16:24.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.147+0000 7f3371867640 1 -- start start 2024-04-25T13:16:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f3371867640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f336c1553b0 0x7f336c070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f3371867640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f336c15bca0 0x7f336c070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f3371867640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f336c0754d0 con 0x7f336c0722a0 2024-04-25T13:16:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f3371867640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f336c15e920 con 0x7f336c1553b0 2024-04-25T13:16:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f3371867640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f336c15ec00 con 0x7f336c15bca0 2024-04-25T13:16:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f336affd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f336c1553b0 0x7f336c070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f336affd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f336c1553b0 0x7f336c070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38996/0 (socket says 172.21.15.52:38996) 2024-04-25T13:16:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f336affd640 1 -- 172.21.15.52:0/852404709 learned_addr learned my addr 172.21.15.52:0/852404709 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f336b7fe640 1 --2- 172.21.15.52:0/852404709 >> v2:172.21.15.102:3300/0 conn(0x7f336c15bca0 0x7f336c070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f336affd640 1 -- 172.21.15.52:0/852404709 >> v2:172.21.15.102:3300/0 conn(0x7f336c15bca0 msgr2=0x7f336c070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:24.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f336affd640 1 --2- 172.21.15.52:0/852404709 >> v2:172.21.15.102:3300/0 conn(0x7f336c15bca0 0x7f336c070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f336affd640 1 -- 172.21.15.52:0/852404709 >> v1:172.21.15.102:6789/0 conn(0x7f336c0722a0 legacy=0x7f336c15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:24.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.148+0000 7f336affd640 1 -- 172.21.15.52:0/852404709 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c15eee0 con 0x7f336c1553b0 2024-04-25T13:16:24.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.149+0000 7f336affd640 1 --2- 172.21.15.52:0/852404709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f336c1553b0 0x7f336c070330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f336c072810 tx=0x7f336402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32eb7b4d382b046f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.149+0000 7f3369ffb640 1 -- 172.21.15.52:0/852404709 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3364037070 con 0x7f336c1553b0 2024-04-25T13:16:24.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.149+0000 7f3369ffb640 1 -- 172.21.15.52:0/852404709 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3364032440 con 0x7f336c1553b0 2024-04-25T13:16:24.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.149+0000 7f3369ffb640 1 -- 172.21.15.52:0/852404709 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3364032810 con 0x7f336c1553b0 2024-04-25T13:16:24.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.150+0000 7f3371867640 1 -- 172.21.15.52:0/852404709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f336c1553b0 msgr2=0x7f336c070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.150+0000 7f3371867640 1 --2- 172.21.15.52:0/852404709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f336c1553b0 0x7f336c070330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f336c072810 tx=0x7f336402a230 comp rx=0 tx=0).stop 2024-04-25T13:16:24.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.150+0000 7f3371867640 1 -- 172.21.15.52:0/852404709 shutdown_connections 2024-04-25T13:16:24.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.150+0000 7f3371867640 1 --2- 172.21.15.52:0/852404709 >> v2:172.21.15.102:3300/0 conn(0x7f336c15bca0 0x7f336c070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.150+0000 7f3371867640 1 --2- 172.21.15.52:0/852404709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f336c1553b0 0x7f336c070330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.150+0000 7f3371867640 1 -- 172.21.15.52:0/852404709 >> 172.21.15.52:0/852404709 conn(0x7f336c06e1a0 msgr2=0x7f336c06e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.150+0000 7f3371867640 1 -- 172.21.15.52:0/852404709 shutdown_connections 2024-04-25T13:16:24.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.150+0000 7f3371867640 1 -- 172.21.15.52:0/852404709 wait complete. 2024-04-25T13:16:24.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.151+0000 7f3371867640 1 Processor -- start 2024-04-25T13:16:24.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.151+0000 7f3371867640 1 -- start start 2024-04-25T13:16:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f3371867640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f336c0722a0 0x7f336c1f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f3371867640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f336c1553b0 0x7f336c153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f3371867640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f336c15bca0 0x7f336c0c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f3371867640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f336c155790 con 0x7f336c1553b0 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f3371867640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f336c15f4a0 con 0x7f336c0722a0 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f3371867640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f336c0759d0 con 0x7f336c15bca0 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f336a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f336c1553b0 0x7f336c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f336a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f336c1553b0 0x7f336c153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39008/0 (socket says 172.21.15.52:39008) 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f336a7fc640 1 -- 172.21.15.52:0/2113254142 learned_addr learned my addr 172.21.15.52:0/2113254142 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f336affd640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f336c0722a0 0x7f336c1f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f336b7fe640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f336c15bca0 0x7f336c0c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f336a7fc640 1 -- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f336c15bca0 msgr2=0x7f336c0c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f336a7fc640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f336c15bca0 0x7f336c0c56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f336a7fc640 1 -- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f336c0722a0 msgr2=0x7f336c1f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f336a7fc640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f336c0722a0 0x7f336c1f15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.152+0000 7f336a7fc640 1 -- 172.21.15.52:0/2113254142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c156990 con 0x7f336c1553b0 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.153+0000 7f336a7fc640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f336c1553b0 0x7f336c153880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f335400c460 tx=0x7f335400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.153+0000 7f3363fff640 1 -- 172.21.15.52:0/2113254142 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3354016020 con 0x7f336c1553b0 2024-04-25T13:16:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.153+0000 7f3363fff640 1 -- 172.21.15.52:0/2113254142 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3354012870 con 0x7f336c1553b0 2024-04-25T13:16:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.153+0000 7f3371867640 1 -- 172.21.15.52:0/2113254142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336c154370 con 0x7f336c1553b0 2024-04-25T13:16:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.153+0000 7f3363fff640 1 -- 172.21.15.52:0/2113254142 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3354012c60 con 0x7f336c1553b0 2024-04-25T13:16:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.153+0000 7f3371867640 1 -- 172.21.15.52:0/2113254142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f336c155bd0 con 0x7f336c1553b0 2024-04-25T13:16:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.154+0000 7f3371867640 1 -- 172.21.15.52:0/2113254142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f336c068f50 con 0x7f336c1553b0 2024-04-25T13:16:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.154+0000 7f3363fff640 1 -- 172.21.15.52:0/2113254142 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3354019020 con 0x7f336c1553b0 2024-04-25T13:16:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.155+0000 7f3363fff640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f334c06c8f0 0x7f334c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.155+0000 7f3363fff640 1 -- 172.21.15.52:0/2113254142 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f335408bf70 con 0x7f336c1553b0 2024-04-25T13:16:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.155+0000 7f336affd640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f334c06c8f0 0x7f334c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.155+0000 7f336affd640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f334c06c8f0 0x7f334c06edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3364034000 tx=0x7f336402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.159+0000 7f3363fff640 1 -- 172.21.15.52:0/2113254142 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3354020020 con 0x7f336c1553b0 2024-04-25T13:16:24.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.344+0000 7f3371867640 1 -- 172.21.15.52:0/2113254142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f336c0757b0 con 0x7f336c1553b0 2024-04-25T13:16:24.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.345+0000 7f3363fff640 1 -- 172.21.15.52:0/2113254142 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f33540182c0 con 0x7f336c1553b0 2024-04-25T13:16:24.345 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-25T13:16:24.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.347+0000 7f3371867640 1 -- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f334c06c8f0 msgr2=0x7f334c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.347+0000 7f3371867640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f334c06c8f0 0x7f334c06edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3364034000 tx=0x7f336402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:24.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.347+0000 7f3371867640 1 -- 172.21.15.52:0/2113254142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f336c1553b0 msgr2=0x7f336c153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.347+0000 7f3371867640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f336c1553b0 0x7f336c153880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f335400c460 tx=0x7f335400c920 comp rx=0 tx=0).stop 2024-04-25T13:16:24.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.347+0000 7f3371867640 1 -- 172.21.15.52:0/2113254142 shutdown_connections 2024-04-25T13:16:24.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.347+0000 7f3371867640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f334c06c8f0 0x7f334c06edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.347+0000 7f3371867640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f336c15bca0 0x7f336c0c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.347+0000 7f3371867640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f336c1553b0 0x7f336c153880 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.347+0000 7f3371867640 1 --2- 172.21.15.52:0/2113254142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f336c0722a0 0x7f336c1f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.347+0000 7f3371867640 1 -- 172.21.15.52:0/2113254142 >> 172.21.15.52:0/2113254142 conn(0x7f336c06e1a0 msgr2=0x7f336c0cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.347+0000 7f3371867640 1 -- 172.21.15.52:0/2113254142 shutdown_connections 2024-04-25T13:16:24.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.347+0000 7f3371867640 1 -- 172.21.15.52:0/2113254142 wait complete. 2024-04-25T13:16:24.358 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:16:24.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.462+0000 7fb625605640 1 Processor -- start 2024-04-25T13:16:24.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.462+0000 7fb625605640 1 -- start start 2024-04-25T13:16:24.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb625605640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb620155220 0x7fb62006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb625605640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6200cb270 0x7fb6200d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb625605640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6200c5900 con 0x7fb6200d12b0 2024-04-25T13:16:24.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb625605640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb62015c040 con 0x7fb6200cb270 2024-04-25T13:16:24.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb625605640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb6200ccb70 con 0x7fb620155220 2024-04-25T13:16:24.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb61e7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6200cb270 0x7fb6200d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb61e7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6200cb270 0x7fb6200d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39022/0 (socket says 172.21.15.52:39022) 2024-04-25T13:16:24.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb61e7fc640 1 -- 172.21.15.52:0/3250639142 learned_addr learned my addr 172.21.15.52:0/3250639142 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:24.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb61effd640 1 --2- 172.21.15.52:0/3250639142 >> v2:172.21.15.102:3300/0 conn(0x7fb620155220 0x7fb62006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb61e7fc640 1 -- 172.21.15.52:0/3250639142 >> v2:172.21.15.102:3300/0 conn(0x7fb620155220 msgr2=0x7fb62006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:24.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb61e7fc640 1 --2- 172.21.15.52:0/3250639142 >> v2:172.21.15.102:3300/0 conn(0x7fb620155220 0x7fb62006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb61e7fc640 1 -- 172.21.15.52:0/3250639142 >> v1:172.21.15.102:6789/0 conn(0x7fb6200d12b0 legacy=0x7fb6200c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:24.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb61e7fc640 1 -- 172.21.15.52:0/3250639142 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6200cc4f0 con 0x7fb6200cb270 2024-04-25T13:16:24.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.463+0000 7fb61effd640 1 --2- 172.21.15.52:0/3250639142 >> v2:172.21.15.102:3300/0 conn(0x7fb620155220 0x7fb62006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:24.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.464+0000 7fb61e7fc640 1 --2- 172.21.15.52:0/3250639142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6200cb270 0x7fb6200d0d70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb6200c7b50 tx=0x7fb60802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5998e6bba44648d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.464+0000 7fb61dffb640 1 -- 172.21.15.52:0/3250639142 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608037070 con 0x7fb6200cb270 2024-04-25T13:16:24.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.464+0000 7fb61dffb640 1 -- 172.21.15.52:0/3250639142 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb608032440 con 0x7fb6200cb270 2024-04-25T13:16:24.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.464+0000 7fb61dffb640 1 -- 172.21.15.52:0/3250639142 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608032810 con 0x7fb6200cb270 2024-04-25T13:16:24.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.465+0000 7fb625605640 1 -- 172.21.15.52:0/3250639142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6200cb270 msgr2=0x7fb6200d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.465+0000 7fb625605640 1 --2- 172.21.15.52:0/3250639142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6200cb270 0x7fb6200d0d70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb6200c7b50 tx=0x7fb60802a2c0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.465+0000 7fb625605640 1 -- 172.21.15.52:0/3250639142 shutdown_connections 2024-04-25T13:16:24.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.465+0000 7fb625605640 1 --2- 172.21.15.52:0/3250639142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6200cb270 0x7fb6200d0d70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.465+0000 7fb625605640 1 --2- 172.21.15.52:0/3250639142 >> v2:172.21.15.102:3300/0 conn(0x7fb620155220 0x7fb62006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.465+0000 7fb625605640 1 -- 172.21.15.52:0/3250639142 >> 172.21.15.52:0/3250639142 conn(0x7fb620075170 msgr2=0x7fb620075580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.465+0000 7fb625605640 1 -- 172.21.15.52:0/3250639142 shutdown_connections 2024-04-25T13:16:24.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.465+0000 7fb625605640 1 -- 172.21.15.52:0/3250639142 wait complete. 2024-04-25T13:16:24.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.466+0000 7fb625605640 1 Processor -- start 2024-04-25T13:16:24.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.466+0000 7fb625605640 1 -- start start 2024-04-25T13:16:24.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb625605640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6200cb270 0x7fb6200b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb625605640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6200d12b0 0x7fb6200b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb625605640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb620155220 0x7fb620148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb625605640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb62015bd60 con 0x7fb6200cb270 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb625605640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb6200c5c30 con 0x7fb620155220 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb625605640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb620155600 con 0x7fb6200d12b0 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb61effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6200cb270 0x7fb6200b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb61effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6200cb270 0x7fb6200b4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39036/0 (socket says 172.21.15.52:39036) 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb61effd640 1 -- 172.21.15.52:0/1925469349 learned_addr learned my addr 172.21.15.52:0/1925469349 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb61e7fc640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6200d12b0 0x7fb6200b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb61f7fe640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb620155220 0x7fb620148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb61effd640 1 -- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6200d12b0 msgr2=0x7fb6200b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb61effd640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6200d12b0 0x7fb6200b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb61effd640 1 -- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb620155220 msgr2=0x7fb620148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb61effd640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb620155220 0x7fb620148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb61effd640 1 -- 172.21.15.52:0/1925469349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb620152340 con 0x7fb6200cb270 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb61effd640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6200cb270 0x7fb6200b4960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb61800c820 tx=0x7fb61800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb6177fe640 1 -- 172.21.15.52:0/1925469349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618015070 con 0x7fb6200cb270 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb6177fe640 1 -- 172.21.15.52:0/1925469349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6180079d0 con 0x7fb6200cb270 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb625605640 1 -- 172.21.15.52:0/1925469349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb620152600 con 0x7fb6200cb270 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.467+0000 7fb6177fe640 1 -- 172.21.15.52:0/1925469349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618007d80 con 0x7fb6200cb270 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.468+0000 7fb625605640 1 -- 172.21.15.52:0/1925469349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6200c9840 con 0x7fb6200cb270 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.469+0000 7fb625605640 1 -- 172.21.15.52:0/1925469349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6200c9a80 con 0x7fb6200cb270 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.469+0000 7fb6177fe640 1 -- 172.21.15.52:0/1925469349 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb618018070 con 0x7fb6200cb270 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.469+0000 7fb6177fe640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb60006c8f0 0x7fb60006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.470+0000 7fb6177fe640 1 -- 172.21.15.52:0/1925469349 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb61808bc90 con 0x7fb6200cb270 2024-04-25T13:16:24.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.470+0000 7fb61e7fc640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb60006c8f0 0x7fb60006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.470+0000 7fb61e7fc640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb60006c8f0 0x7fb60006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb608034000 tx=0x7fb60802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.474+0000 7fb6177fe640 1 -- 172.21.15.52:0/1925469349 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb618059d80 con 0x7fb6200cb270 2024-04-25T13:16:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.660+0000 7fb625605640 1 -- 172.21.15.52:0/1925469349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb6200c9370 con 0x7fb6200cb270 2024-04-25T13:16:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.661+0000 7fb6177fe640 1 -- 172.21.15.52:0/1925469349 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fb618059680 con 0x7fb6200cb270 2024-04-25T13:16:24.661 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T13:16:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.662+0000 7fb625605640 1 -- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb60006c8f0 msgr2=0x7fb60006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.662+0000 7fb625605640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb60006c8f0 0x7fb60006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb608034000 tx=0x7fb60802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.662+0000 7fb625605640 1 -- 172.21.15.52:0/1925469349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6200cb270 msgr2=0x7fb6200b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.662+0000 7fb625605640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6200cb270 0x7fb6200b4960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb61800c820 tx=0x7fb61800cce0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.662+0000 7fb625605640 1 -- 172.21.15.52:0/1925469349 shutdown_connections 2024-04-25T13:16:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.662+0000 7fb625605640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb60006c8f0 0x7fb60006edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.662+0000 7fb625605640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6200d12b0 0x7fb6200b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.662+0000 7fb625605640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb620155220 0x7fb620148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.662+0000 7fb625605640 1 --2- 172.21.15.52:0/1925469349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6200cb270 0x7fb6200b4960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.663+0000 7fb625605640 1 -- 172.21.15.52:0/1925469349 >> 172.21.15.52:0/1925469349 conn(0x7fb620075170 msgr2=0x7fb620075550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.663+0000 7fb625605640 1 -- 172.21.15.52:0/1925469349 shutdown_connections 2024-04-25T13:16:24.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.663+0000 7fb625605640 1 -- 172.21.15.52:0/1925469349 wait complete. 2024-04-25T13:16:24.674 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:16:24.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.775+0000 7fb969c23640 1 Processor -- start 2024-04-25T13:16:24.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.775+0000 7fb969c23640 1 -- start start 2024-04-25T13:16:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb969c23640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9641553a0 0x7fb9640c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb969c23640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb96415bb80 0x7fb9640c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb969c23640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb96406c850 con 0x7fb9640c8070 2024-04-25T13:16:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb969c23640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb96406cb30 con 0x7fb9641553a0 2024-04-25T13:16:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb969c23640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb96406ce10 con 0x7fb96415bb80 2024-04-25T13:16:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb9637fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9641553a0 0x7fb9640c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb9637fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9641553a0 0x7fb9640c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39052/0 (socket says 172.21.15.52:39052) 2024-04-25T13:16:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb9637fe640 1 -- 172.21.15.52:0/545987958 learned_addr learned my addr 172.21.15.52:0/545987958 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb963fff640 1 --2- 172.21.15.52:0/545987958 >> v2:172.21.15.102:3300/0 conn(0x7fb96415bb80 0x7fb9640c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb9637fe640 1 -- 172.21.15.52:0/545987958 >> v2:172.21.15.102:3300/0 conn(0x7fb96415bb80 msgr2=0x7fb9640c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb9637fe640 1 --2- 172.21.15.52:0/545987958 >> v2:172.21.15.102:3300/0 conn(0x7fb96415bb80 0x7fb9640c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb9637fe640 1 -- 172.21.15.52:0/545987958 >> v1:172.21.15.102:6789/0 conn(0x7fb9640c8070 legacy=0x7fb9640ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb9637fe640 1 -- 172.21.15.52:0/545987958 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96406d0f0 con 0x7fb9641553a0 2024-04-25T13:16:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.776+0000 7fb963fff640 1 --2- 172.21.15.52:0/545987958 >> v2:172.21.15.102:3300/0 conn(0x7fb96415bb80 0x7fb9640c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.777+0000 7fb9637fe640 1 --2- 172.21.15.52:0/545987958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9641553a0 0x7fb9640c8700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9640cae70 tx=0x7fb94c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f75916841907be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.777+0000 7fb9627fc640 1 -- 172.21.15.52:0/545987958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c037070 con 0x7fb9641553a0 2024-04-25T13:16:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.777+0000 7fb9627fc640 1 -- 172.21.15.52:0/545987958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c02ae50 con 0x7fb9641553a0 2024-04-25T13:16:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.777+0000 7fb9627fc640 1 -- 172.21.15.52:0/545987958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c032860 con 0x7fb9641553a0 2024-04-25T13:16:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.778+0000 7fb969c23640 1 -- 172.21.15.52:0/545987958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9641553a0 msgr2=0x7fb9640c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.778+0000 7fb969c23640 1 --2- 172.21.15.52:0/545987958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9641553a0 0x7fb9640c8700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9640cae70 tx=0x7fb94c02a300 comp rx=0 tx=0).stop 2024-04-25T13:16:24.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.778+0000 7fb969c23640 1 -- 172.21.15.52:0/545987958 shutdown_connections 2024-04-25T13:16:24.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.778+0000 7fb969c23640 1 --2- 172.21.15.52:0/545987958 >> v2:172.21.15.102:3300/0 conn(0x7fb96415bb80 0x7fb9640c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.778+0000 7fb969c23640 1 --2- 172.21.15.52:0/545987958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9641553a0 0x7fb9640c8700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.778+0000 7fb969c23640 1 -- 172.21.15.52:0/545987958 >> 172.21.15.52:0/545987958 conn(0x7fb964073010 msgr2=0x7fb964073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.778+0000 7fb969c23640 1 -- 172.21.15.52:0/545987958 shutdown_connections 2024-04-25T13:16:24.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.778+0000 7fb969c23640 1 -- 172.21.15.52:0/545987958 wait complete. 2024-04-25T13:16:24.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.779+0000 7fb969c23640 1 Processor -- start 2024-04-25T13:16:24.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.779+0000 7fb969c23640 1 -- start start 2024-04-25T13:16:24.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb969c23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9640c8070 0x7fb964148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb969c23640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9641553a0 0x7fb96414f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb969c23640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb96415bb80 0x7fb9641595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb969c23640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb9640cd4d0 con 0x7fb9640c8070 2024-04-25T13:16:24.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb969c23640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb964155780 con 0x7fb9641553a0 2024-04-25T13:16:24.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb969c23640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb9640cd650 con 0x7fb96415bb80 2024-04-25T13:16:24.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb9637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9640c8070 0x7fb964148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb9637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9640c8070 0x7fb964148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39066/0 (socket says 172.21.15.52:39066) 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb9637fe640 1 -- 172.21.15.52:0/779848052 learned_addr learned my addr 172.21.15.52:0/779848052 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb962ffd640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9641553a0 0x7fb96414f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb963fff640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb96415bb80 0x7fb9641595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb9637fe640 1 -- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb96415bb80 msgr2=0x7fb9641595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb9637fe640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb96415bb80 0x7fb9641595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb9637fe640 1 -- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9641553a0 msgr2=0x7fb96414f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb9637fe640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9641553a0 0x7fb96414f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb9637fe640 1 -- 172.21.15.52:0/779848052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9641f11e0 con 0x7fb9640c8070 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb963fff640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb96415bb80 0x7fb9641595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb9637fe640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9640c8070 0x7fb964148c20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb94c02a340 tx=0x7fb94c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.780+0000 7fb95bfff640 1 -- 172.21.15.52:0/779848052 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c041070 con 0x7fb9640c8070 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.781+0000 7fb95bfff640 1 -- 172.21.15.52:0/779848052 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c03c670 con 0x7fb9640c8070 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.781+0000 7fb969c23640 1 -- 172.21.15.52:0/779848052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb964151170 con 0x7fb9640c8070 2024-04-25T13:16:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.781+0000 7fb95bfff640 1 -- 172.21.15.52:0/779848052 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c037040 con 0x7fb9640c8070 2024-04-25T13:16:24.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.781+0000 7fb969c23640 1 -- 172.21.15.52:0/779848052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9641f14a0 con 0x7fb9640c8070 2024-04-25T13:16:24.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.782+0000 7fb969c23640 1 -- 172.21.15.52:0/779848052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb964068e40 con 0x7fb9640c8070 2024-04-25T13:16:24.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.782+0000 7fb95bfff640 1 -- 172.21.15.52:0/779848052 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb94c044070 con 0x7fb9640c8070 2024-04-25T13:16:24.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.782+0000 7fb95bfff640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb94406c920 0x7fb94406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.783+0000 7fb95bfff640 1 -- 172.21.15.52:0/779848052 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb94c0ac590 con 0x7fb9640c8070 2024-04-25T13:16:24.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.783+0000 7fb962ffd640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb94406c920 0x7fb94406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.783+0000 7fb962ffd640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb94406c920 0x7fb94406ede0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9640cdbc0 tx=0x7fb954009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.787+0000 7fb95bfff640 1 -- 172.21.15.52:0/779848052 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb94c07a0c0 con 0x7fb9640c8070 2024-04-25T13:16:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.987+0000 7fb969c23640 1 -- 172.21.15.52:0/779848052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb96414e730 con 0x7fb9640c8070 2024-04-25T13:16:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.988+0000 7fb95bfff640 1 -- 172.21.15.52:0/779848052 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fb94c07e3c0 con 0x7fb9640c8070 2024-04-25T13:16:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-04-25T13:16:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.990+0000 7fb969c23640 1 -- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb94406c920 msgr2=0x7fb94406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.990+0000 7fb969c23640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb94406c920 0x7fb94406ede0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9640cdbc0 tx=0x7fb954009040 comp rx=0 tx=0).stop 2024-04-25T13:16:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.990+0000 7fb969c23640 1 -- 172.21.15.52:0/779848052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9640c8070 msgr2=0x7fb964148c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.990+0000 7fb969c23640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9640c8070 0x7fb964148c20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb94c02a340 tx=0x7fb94c0046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.990+0000 7fb969c23640 1 -- 172.21.15.52:0/779848052 shutdown_connections 2024-04-25T13:16:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.990+0000 7fb969c23640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb94406c920 0x7fb94406ede0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.990+0000 7fb969c23640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb96415bb80 0x7fb9641595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.990+0000 7fb969c23640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9641553a0 0x7fb96414f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.990+0000 7fb969c23640 1 --2- 172.21.15.52:0/779848052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9640c8070 0x7fb964148c20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.990+0000 7fb969c23640 1 -- 172.21.15.52:0/779848052 >> 172.21.15.52:0/779848052 conn(0x7fb964073010 msgr2=0x7fb9640cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.990+0000 7fb969c23640 1 -- 172.21.15.52:0/779848052 shutdown_connections 2024-04-25T13:16:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:24.990+0000 7fb969c23640 1 -- 172.21.15.52:0/779848052 wait complete. 2024-04-25T13:16:25.001 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi052.front.sepia.ceph.com... 2024-04-25T13:16:25.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:25.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:25.024 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi052.stderr:ceph-fuse[41131]: fuse finished with error 0 and tester_r 0 2024-04-25T13:16:25.026 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:16:31.127 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:16:31.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:31.128 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T13:16:31.152 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:31.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.297+0000 7f14c02b4640 1 Processor -- start 2024-04-25T13:16:31.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.297+0000 7f14c02b4640 1 -- start start 2024-04-25T13:16:31.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.298+0000 7f14c02b4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14b8151ea0 0x7f14b80c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.298+0000 7f14c02b4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f14b80c3cb0 0x7f14b80c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.298+0000 7f14c02b4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14b815b610 con 0x7f14b8152280 2024-04-25T13:16:31.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.298+0000 7f14c02b4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f14b806f300 con 0x7f14b80c3cb0 2024-04-25T13:16:31.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.298+0000 7f14c02b4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f14b806e6f0 con 0x7f14b8151ea0 2024-04-25T13:16:31.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.298+0000 7f14be050640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14b8151ea0 0x7f14b80c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.298+0000 7f14be851640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f14b80c3cb0 0x7f14b80c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.298+0000 7f14be050640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14b8151ea0 0x7f14b80c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:45388/0 (socket says 172.21.15.52:45388) 2024-04-25T13:16:31.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.298+0000 7f14be050640 1 -- 172.21.15.52:0/2830850253 learned_addr learned my addr 172.21.15.52:0/2830850253 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:31.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.299+0000 7f14be851640 1 -- 172.21.15.52:0/2830850253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14b8151ea0 msgr2=0x7f14b80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:31.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.299+0000 7f14be851640 1 --2- 172.21.15.52:0/2830850253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14b8151ea0 0x7f14b80c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.299+0000 7f14be851640 1 -- 172.21.15.52:0/2830850253 >> v1:172.21.15.102:6789/0 conn(0x7f14b8152280 legacy=0x7f14b81591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.299+0000 7f14be851640 1 -- 172.21.15.52:0/2830850253 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b806e9d0 con 0x7f14b80c3cb0 2024-04-25T13:16:31.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.299+0000 7f14be050640 1 --2- 172.21.15.52:0/2830850253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14b8151ea0 0x7f14b80c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:31.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.299+0000 7f14be851640 1 --2- 172.21.15.52:0/2830850253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b80c3cb0 0x7f14b80c8450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f14b806f480 tx=0x7f14b002a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a15ca7428e62136e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:31.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.300+0000 7f14bd04e640 1 -- 172.21.15.52:0/2830850253 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0037070 con 0x7f14b80c3cb0 2024-04-25T13:16:31.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.300+0000 7f14bd04e640 1 -- 172.21.15.52:0/2830850253 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b0032440 con 0x7f14b80c3cb0 2024-04-25T13:16:31.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.300+0000 7f14bd04e640 1 -- 172.21.15.52:0/2830850253 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0032810 con 0x7f14b80c3cb0 2024-04-25T13:16:31.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.300+0000 7f14c02b4640 1 -- 172.21.15.52:0/2830850253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b80c3cb0 msgr2=0x7f14b80c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.300+0000 7f14c02b4640 1 --2- 172.21.15.52:0/2830850253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b80c3cb0 0x7f14b80c8450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f14b806f480 tx=0x7f14b002a200 comp rx=0 tx=0).stop 2024-04-25T13:16:31.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.300+0000 7f14c02b4640 1 -- 172.21.15.52:0/2830850253 shutdown_connections 2024-04-25T13:16:31.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.300+0000 7f14c02b4640 1 --2- 172.21.15.52:0/2830850253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b80c3cb0 0x7f14b80c8450 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.300+0000 7f14c02b4640 1 --2- 172.21.15.52:0/2830850253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14b8151ea0 0x7f14b80c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.300+0000 7f14c02b4640 1 -- 172.21.15.52:0/2830850253 >> 172.21.15.52:0/2830850253 conn(0x7f14b80c8f00 msgr2=0x7f14b80c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:31.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.300+0000 7f14c02b4640 1 -- 172.21.15.52:0/2830850253 shutdown_connections 2024-04-25T13:16:31.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.300+0000 7f14c02b4640 1 -- 172.21.15.52:0/2830850253 wait complete. 2024-04-25T13:16:31.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.301+0000 7f14c02b4640 1 Processor -- start 2024-04-25T13:16:31.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.301+0000 7f14c02b4640 1 -- start start 2024-04-25T13:16:31.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.302+0000 7f14c02b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b80c3cb0 0x7f14b81ee690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.302+0000 7f14c02b4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14b8151ea0 0x7f14b81f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.302+0000 7f14c02b4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14b815a1b0 0x7f14b80ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.302+0000 7f14c02b4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f14b80c8cb0 con 0x7f14b815a1b0 2024-04-25T13:16:31.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.302+0000 7f14c02b4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14b806ef90 con 0x7f14b80c3cb0 2024-04-25T13:16:31.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.302+0000 7f14c02b4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f14b815b2d0 con 0x7f14b8151ea0 2024-04-25T13:16:31.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.302+0000 7f14be851640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14b815a1b0 0x7f14b80ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.302+0000 7f14be851640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14b815a1b0 0x7f14b80ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49608/0 (socket says 172.21.15.52:49608) 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.302+0000 7f14be851640 1 -- 172.21.15.52:0/4134940720 learned_addr learned my addr 172.21.15.52:0/4134940720 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.302+0000 7f14be050640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b80c3cb0 0x7f14b81ee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.302+0000 7f14bd84f640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14b8151ea0 0x7f14b81f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.303+0000 7f14be851640 1 -- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14b8151ea0 msgr2=0x7f14b81f1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.303+0000 7f14be851640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14b8151ea0 0x7f14b81f1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.303+0000 7f14be851640 1 -- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b80c3cb0 msgr2=0x7f14b81ee690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.303+0000 7f14be851640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b80c3cb0 0x7f14b81ee690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.303+0000 7f14be851640 1 -- 172.21.15.52:0/4134940720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b81f16c0 con 0x7f14b815a1b0 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.303+0000 7f14be851640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14b815a1b0 0x7f14b80ca9d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f14b0009890 tx=0x7f14b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.303+0000 7f14b6ffd640 1 -- 172.21.15.52:0/4134940720 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0039800 con 0x7f14b815a1b0 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.303+0000 7f14b6ffd640 1 -- 172.21.15.52:0/4134940720 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b00399c0 con 0x7f14b815a1b0 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.303+0000 7f14c02b4640 1 -- 172.21.15.52:0/4134940720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b815a9e0 con 0x7f14b815a1b0 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.303+0000 7f14b6ffd640 1 -- 172.21.15.52:0/4134940720 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0039db0 con 0x7f14b815a1b0 2024-04-25T13:16:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.303+0000 7f14c02b4640 1 -- 172.21.15.52:0/4134940720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b81596d0 con 0x7f14b815a1b0 2024-04-25T13:16:31.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.304+0000 7f14c02b4640 1 -- 172.21.15.52:0/4134940720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b8068e40 con 0x7f14b815a1b0 2024-04-25T13:16:31.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.305+0000 7f14b6ffd640 1 -- 172.21.15.52:0/4134940720 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14b004d3f0 con 0x7f14b815a1b0 2024-04-25T13:16:31.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.305+0000 7f14b6ffd640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f14a406c8f0 0x7f14a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.305+0000 7f14b6ffd640 1 -- 172.21.15.52:0/4134940720 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f14b00ae4c0 con 0x7f14b815a1b0 2024-04-25T13:16:31.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.305+0000 7f14be050640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f14a406c8f0 0x7f14a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.306+0000 7f14be050640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f14a406c8f0 0x7f14a406edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14a80072c0 tx=0x7f14a800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:31.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.309+0000 7f14b6ffd640 1 -- 172.21.15.52:0/4134940720 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f14b007bff0 con 0x7f14b815a1b0 2024-04-25T13:16:31.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.499+0000 7f14c02b4640 1 -- 172.21.15.52:0/4134940720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14b8071280 con 0x7f14b815a1b0 2024-04-25T13:16:31.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.500+0000 7f14b6ffd640 1 -- 172.21.15.52:0/4134940720 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f14b00802f0 con 0x7f14b815a1b0 2024-04-25T13:16:31.500 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:31.501 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":25,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:14.018518+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.502+0000 7f14c02b4640 1 -- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f14a406c8f0 msgr2=0x7f14a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.502+0000 7f14c02b4640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f14a406c8f0 0x7f14a406edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14a80072c0 tx=0x7f14a800b040 comp rx=0 tx=0).stop 2024-04-25T13:16:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.502+0000 7f14c02b4640 1 -- 172.21.15.52:0/4134940720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14b815a1b0 msgr2=0x7f14b80ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.502+0000 7f14c02b4640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14b815a1b0 0x7f14b80ca9d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f14b0009890 tx=0x7f14b00046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.502+0000 7f14c02b4640 1 -- 172.21.15.52:0/4134940720 shutdown_connections 2024-04-25T13:16:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.502+0000 7f14c02b4640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f14a406c8f0 0x7f14a406edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.502+0000 7f14c02b4640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14b8151ea0 0x7f14b81f1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.502+0000 7f14c02b4640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14b815a1b0 0x7f14b80ca9d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.502+0000 7f14c02b4640 1 --2- 172.21.15.52:0/4134940720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b80c3cb0 0x7f14b81ee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.502+0000 7f14c02b4640 1 -- 172.21.15.52:0/4134940720 >> 172.21.15.52:0/4134940720 conn(0x7f14b80c8f00 msgr2=0x7f14b8151150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:31.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.502+0000 7f14c02b4640 1 -- 172.21.15.52:0/4134940720 shutdown_connections 2024-04-25T13:16:31.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.502+0000 7f14c02b4640 1 -- 172.21.15.52:0/4134940720 wait complete. 2024-04-25T13:16:31.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:31.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.615+0000 7ff8a7e6b640 1 Processor -- start 2024-04-25T13:16:31.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.615+0000 7ff8a7e6b640 1 -- start start 2024-04-25T13:16:31.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a7e6b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff8a01554e0 0x7ff8a015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a7e6b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8a00b3c00 0x7ff8a00b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a7e6b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8a00b5450 0x7ff8a00d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a7e6b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff8a00b4a80 con 0x7ff8a00b3c00 2024-04-25T13:16:31.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a7e6b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff8a01558c0 con 0x7ff8a01554e0 2024-04-25T13:16:31.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a7e6b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff8a015f630 con 0x7ff8a00b5450 2024-04-25T13:16:31.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a5406640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8a00b3c00 0x7ff8a00b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a5406640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8a00b3c00 0x7ff8a00b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49616/0 (socket says 172.21.15.52:49616) 2024-04-25T13:16:31.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a5406640 1 -- 172.21.15.52:0/3673494541 learned_addr learned my addr 172.21.15.52:0/3673494541 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:31.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a6408640 1 --2- 172.21.15.52:0/3673494541 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8a00b5450 0x7ff8a00d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a5c07640 1 --2- 172.21.15.52:0/3673494541 >> v2:172.21.15.102:3300/0 conn(0x7ff8a01554e0 0x7ff8a015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a5406640 1 -- 172.21.15.52:0/3673494541 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8a00b5450 msgr2=0x7ff8a00d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:31.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a5406640 1 --2- 172.21.15.52:0/3673494541 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8a00b5450 0x7ff8a00d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a5406640 1 -- 172.21.15.52:0/3673494541 >> v2:172.21.15.102:3300/0 conn(0x7ff8a01554e0 msgr2=0x7ff8a015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:31.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a5406640 1 --2- 172.21.15.52:0/3673494541 >> v2:172.21.15.102:3300/0 conn(0x7ff8a01554e0 0x7ff8a015f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a5406640 1 -- 172.21.15.52:0/3673494541 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a00cb8c0 con 0x7ff8a00b3c00 2024-04-25T13:16:31.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a6408640 1 --2- 172.21.15.52:0/3673494541 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8a00b5450 0x7ff8a00d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:31.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.616+0000 7ff8a5c07640 1 --2- 172.21.15.52:0/3673494541 >> v2:172.21.15.102:3300/0 conn(0x7ff8a01554e0 0x7ff8a015f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:31.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.617+0000 7ff8a5406640 1 --2- 172.21.15.52:0/3673494541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8a00b3c00 0x7ff8a00b4f10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff8a008e520 tx=0x7ff89402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb616c7d24b0b43d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:31.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.617+0000 7ff8a4c05640 1 -- 172.21.15.52:0/3673494541 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894037070 con 0x7ff8a00b3c00 2024-04-25T13:16:31.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.617+0000 7ff8a4c05640 1 -- 172.21.15.52:0/3673494541 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff894032440 con 0x7ff8a00b3c00 2024-04-25T13:16:31.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.617+0000 7ff8a4c05640 1 -- 172.21.15.52:0/3673494541 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894032810 con 0x7ff8a00b3c00 2024-04-25T13:16:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.618+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/3673494541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8a00b3c00 msgr2=0x7ff8a00b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.618+0000 7ff8a7e6b640 1 --2- 172.21.15.52:0/3673494541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8a00b3c00 0x7ff8a00b4f10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff8a008e520 tx=0x7ff89402a270 comp rx=0 tx=0).stop 2024-04-25T13:16:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.618+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/3673494541 shutdown_connections 2024-04-25T13:16:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.618+0000 7ff8a7e6b640 1 --2- 172.21.15.52:0/3673494541 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8a00b5450 0x7ff8a00d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.618+0000 7ff8a7e6b640 1 --2- 172.21.15.52:0/3673494541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8a00b3c00 0x7ff8a00b4f10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.618+0000 7ff8a7e6b640 1 --2- 172.21.15.52:0/3673494541 >> v2:172.21.15.102:3300/0 conn(0x7ff8a01554e0 0x7ff8a015f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.618+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/3673494541 >> 172.21.15.52:0/3673494541 conn(0x7ff8a0074d50 msgr2=0x7ff8a0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.618+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/3673494541 shutdown_connections 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.618+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/3673494541 wait complete. 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.619+0000 7ff8a7e6b640 1 Processor -- start 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.619+0000 7ff8a7e6b640 1 -- start start 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a7e6b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8a00b3c00 0x7ff8a00c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a7e6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8a00b5450 0x7ff8a01e4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a7e6b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8a01554e0 0x7ff8a0157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a7e6b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a00b4430 con 0x7ff8a00b5450 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a7e6b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a00b4150 con 0x7ff8a00b3c00 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a7e6b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff8a00b4710 con 0x7ff8a01554e0 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a5406640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8a00b5450 0x7ff8a01e4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a5406640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8a00b5450 0x7ff8a01e4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49632/0 (socket says 172.21.15.52:49632) 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a5406640 1 -- 172.21.15.52:0/1980714694 learned_addr learned my addr 172.21.15.52:0/1980714694 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a5c07640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8a00b3c00 0x7ff8a00c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a6408640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8a01554e0 0x7ff8a0157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a5406640 1 -- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8a01554e0 msgr2=0x7ff8a0157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a5406640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8a01554e0 0x7ff8a0157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a5406640 1 -- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8a00b3c00 msgr2=0x7ff8a00c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a5406640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8a00b3c00 0x7ff8a00c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a5406640 1 -- 172.21.15.52:0/1980714694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a0073f10 con 0x7ff8a00b5450 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.620+0000 7ff8a5c07640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8a00b3c00 0x7ff8a00c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.621+0000 7ff8a5406640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8a00b5450 0x7ff8a01e4e60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff89402a2b0 tx=0x7ff8940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.621+0000 7ff89e7fc640 1 -- 172.21.15.52:0/1980714694 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894037040 con 0x7ff8a00b5450 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.621+0000 7ff89e7fc640 1 -- 172.21.15.52:0/1980714694 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff894042070 con 0x7ff8a00b5450 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.621+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/1980714694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a01f1000 con 0x7ff8a00b5450 2024-04-25T13:16:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.621+0000 7ff89e7fc640 1 -- 172.21.15.52:0/1980714694 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894030bb0 con 0x7ff8a00b5450 2024-04-25T13:16:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.621+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/1980714694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a01f15c0 con 0x7ff8a00b5450 2024-04-25T13:16:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.622+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/1980714694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a0069310 con 0x7ff8a00b5450 2024-04-25T13:16:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.622+0000 7ff89e7fc640 1 -- 172.21.15.52:0/1980714694 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff894047460 con 0x7ff8a00b5450 2024-04-25T13:16:31.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.623+0000 7ff89e7fc640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff88c06c920 0x7ff88c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.623+0000 7ff89e7fc640 1 -- 172.21.15.52:0/1980714694 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff8940aca20 con 0x7ff8a00b5450 2024-04-25T13:16:31.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.623+0000 7ff8a5c07640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff88c06c920 0x7ff88c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.623+0000 7ff8a5c07640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff88c06c920 0x7ff88c06ede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff89000e550 tx=0x7ff890007ab0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:31.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.627+0000 7ff89e7fc640 1 -- 172.21.15.52:0/1980714694 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff8a0069310 con 0x7ff8a00b5450 2024-04-25T13:16:31.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.816+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/1980714694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8a0068e40 con 0x7ff8a00b5450 2024-04-25T13:16:31.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.817+0000 7ff89e7fc640 1 -- 172.21.15.52:0/1980714694 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7ff8a0073f10 con 0x7ff8a00b5450 2024-04-25T13:16:31.818 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:31.818 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":25,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:14.018518+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.820+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff88c06c920 msgr2=0x7ff88c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.820+0000 7ff8a7e6b640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff88c06c920 0x7ff88c06ede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff89000e550 tx=0x7ff890007ab0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.820+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/1980714694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8a00b5450 msgr2=0x7ff8a01e4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.820+0000 7ff8a7e6b640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8a00b5450 0x7ff8a01e4e60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff89402a2b0 tx=0x7ff8940046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.820+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/1980714694 shutdown_connections 2024-04-25T13:16:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.820+0000 7ff8a7e6b640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff88c06c920 0x7ff88c06ede0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.820+0000 7ff8a7e6b640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8a01554e0 0x7ff8a0157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.820+0000 7ff8a7e6b640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8a00b5450 0x7ff8a01e4e60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.820+0000 7ff8a7e6b640 1 --2- 172.21.15.52:0/1980714694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8a00b3c00 0x7ff8a00c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.820+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/1980714694 >> 172.21.15.52:0/1980714694 conn(0x7ff8a0074d50 msgr2=0x7ff8a0152830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.820+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/1980714694 shutdown_connections 2024-04-25T13:16:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.820+0000 7ff8a7e6b640 1 -- 172.21.15.52:0/1980714694 wait complete. 2024-04-25T13:16:31.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T13:16:31.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.934+0000 7efd341bf640 1 Processor -- start 2024-04-25T13:16:31.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.934+0000 7efd341bf640 1 -- start start 2024-04-25T13:16:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd341bf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd2c1553c0 0x7efd2c15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd341bf640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efd2c15f310 0x7efd2c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd341bf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efd2c15b070 0x7efd2c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd341bf640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7efd2c15e660 con 0x7efd2c15b070 2024-04-25T13:16:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd341bf640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efd2c1557a0 con 0x7efd2c15f310 2024-04-25T13:16:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd341bf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efd2c0c5c80 con 0x7efd2c1553c0 2024-04-25T13:16:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd3275c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efd2c15b070 0x7efd2c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd3275c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efd2c15b070 0x7efd2c0cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49638/0 (socket says 172.21.15.52:49638) 2024-04-25T13:16:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd3275c640 1 -- 172.21.15.52:0/1531857895 learned_addr learned my addr 172.21.15.52:0/1531857895 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd3175a640 1 --2- 172.21.15.52:0/1531857895 >> v2:172.21.15.102:3300/0 conn(0x7efd2c15f310 0x7efd2c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd31f5b640 1 --2- 172.21.15.52:0/1531857895 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd2c1553c0 0x7efd2c15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd3275c640 1 -- 172.21.15.52:0/1531857895 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd2c1553c0 msgr2=0x7efd2c15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd3275c640 1 --2- 172.21.15.52:0/1531857895 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd2c1553c0 0x7efd2c15edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd3275c640 1 -- 172.21.15.52:0/1531857895 >> v2:172.21.15.102:3300/0 conn(0x7efd2c15f310 msgr2=0x7efd2c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd3275c640 1 --2- 172.21.15.52:0/1531857895 >> v2:172.21.15.102:3300/0 conn(0x7efd2c15f310 0x7efd2c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd3275c640 1 -- 172.21.15.52:0/1531857895 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c15b5d0 con 0x7efd2c15b070 2024-04-25T13:16:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.935+0000 7efd3175a640 1 --2- 172.21.15.52:0/1531857895 >> v2:172.21.15.102:3300/0 conn(0x7efd2c15f310 0x7efd2c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.936+0000 7efd3275c640 1 --2- 172.21.15.52:0/1531857895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15b070 0x7efd2c0cbae0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0ce3a0 tx=0x7efd1c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed46866fad540d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.936+0000 7efd30f59640 1 -- 172.21.15.52:0/1531857895 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c036070 con 0x7efd2c15b070 2024-04-25T13:16:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.936+0000 7efd30f59640 1 -- 172.21.15.52:0/1531857895 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c031600 con 0x7efd2c15b070 2024-04-25T13:16:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.936+0000 7efd30f59640 1 -- 172.21.15.52:0/1531857895 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0319d0 con 0x7efd2c15b070 2024-04-25T13:16:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.937+0000 7efd341bf640 1 -- 172.21.15.52:0/1531857895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15b070 msgr2=0x7efd2c0cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.937+0000 7efd341bf640 1 --2- 172.21.15.52:0/1531857895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15b070 0x7efd2c0cbae0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0ce3a0 tx=0x7efd1c02a610 comp rx=0 tx=0).stop 2024-04-25T13:16:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.937+0000 7efd341bf640 1 -- 172.21.15.52:0/1531857895 shutdown_connections 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.937+0000 7efd341bf640 1 --2- 172.21.15.52:0/1531857895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15b070 0x7efd2c0cbae0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.937+0000 7efd341bf640 1 --2- 172.21.15.52:0/1531857895 >> v2:172.21.15.102:3300/0 conn(0x7efd2c15f310 0x7efd2c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.937+0000 7efd341bf640 1 --2- 172.21.15.52:0/1531857895 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd2c1553c0 0x7efd2c15edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.937+0000 7efd341bf640 1 -- 172.21.15.52:0/1531857895 >> 172.21.15.52:0/1531857895 conn(0x7efd2c072360 msgr2=0x7efd2c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.937+0000 7efd341bf640 1 -- 172.21.15.52:0/1531857895 shutdown_connections 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.937+0000 7efd341bf640 1 -- 172.21.15.52:0/1531857895 wait complete. 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.938+0000 7efd341bf640 1 Processor -- start 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.938+0000 7efd341bf640 1 -- start start 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd341bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd2c1553c0 0x7efd2c1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd341bf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd2c15b070 0x7efd2c1f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd341bf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15f310 0x7efd2c15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd341bf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c15be70 con 0x7efd2c15f310 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd341bf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c15bb90 con 0x7efd2c1553c0 2024-04-25T13:16:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd341bf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efd2c15e8b0 con 0x7efd2c15b070 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd3275c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15f310 0x7efd2c15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd3275c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15f310 0x7efd2c15cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49646/0 (socket says 172.21.15.52:49646) 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd3275c640 1 -- 172.21.15.52:0/3190325753 learned_addr learned my addr 172.21.15.52:0/3190325753 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd31f5b640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd2c1553c0 0x7efd2c1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd3175a640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd2c15b070 0x7efd2c1f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd3275c640 1 -- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd2c15b070 msgr2=0x7efd2c1f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd3275c640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd2c15b070 0x7efd2c1f4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd3275c640 1 -- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd2c1553c0 msgr2=0x7efd2c1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd3275c640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd2c1553c0 0x7efd2c1586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd3275c640 1 -- 172.21.15.52:0/3190325753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c0d0770 con 0x7efd2c15f310 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd3175a640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd2c15b070 0x7efd2c1f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.939+0000 7efd3275c640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15f310 0x7efd2c15cc40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009f40 tx=0x7efd1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.940+0000 7efd2a7fc640 1 -- 172.21.15.52:0/3190325753 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c036050 con 0x7efd2c15f310 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.940+0000 7efd2a7fc640 1 -- 172.21.15.52:0/3190325753 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c042070 con 0x7efd2c15f310 2024-04-25T13:16:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.940+0000 7efd2a7fc640 1 -- 172.21.15.52:0/3190325753 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c009510 con 0x7efd2c15f310 2024-04-25T13:16:31.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.940+0000 7efd341bf640 1 -- 172.21.15.52:0/3190325753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c0cf830 con 0x7efd2c15f310 2024-04-25T13:16:31.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.940+0000 7efd341bf640 1 -- 172.21.15.52:0/3190325753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c0d0250 con 0x7efd2c15f310 2024-04-25T13:16:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.941+0000 7efd341bf640 1 -- 172.21.15.52:0/3190325753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd2c075d60 con 0x7efd2c15f310 2024-04-25T13:16:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.941+0000 7efd2a7fc640 1 -- 172.21.15.52:0/3190325753 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd1c007bd0 con 0x7efd2c15f310 2024-04-25T13:16:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.942+0000 7efd2a7fc640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efd1806c920 0x7efd1806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.942+0000 7efd2a7fc640 1 -- 172.21.15.52:0/3190325753 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efd1c0acd90 con 0x7efd2c15f310 2024-04-25T13:16:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.942+0000 7efd31f5b640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efd1806c920 0x7efd1806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.942+0000 7efd31f5b640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efd1806c920 0x7efd1806ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efd2400aa40 tx=0x7efd24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:31.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:31.946+0000 7efd2a7fc640 1 -- 172.21.15.52:0/3190325753 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efd2c075d60 con 0x7efd2c15f310 2024-04-25T13:16:32.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:32.174+0000 7efd341bf640 1 -- 172.21.15.52:0/3190325753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7efd2c068f50 con 0x7efd2c15f310 2024-04-25T13:16:33.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.070+0000 7efd2a7fc640 1 -- 172.21.15.52:0/3190325753 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7efd1c07ae70 con 0x7efd2c15f310 2024-04-25T13:16:33.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.073+0000 7efd341bf640 1 -- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efd1806c920 msgr2=0x7efd1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.073+0000 7efd341bf640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efd1806c920 0x7efd1806ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efd2400aa40 tx=0x7efd24008040 comp rx=0 tx=0).stop 2024-04-25T13:16:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.073+0000 7efd341bf640 1 -- 172.21.15.52:0/3190325753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15f310 msgr2=0x7efd2c15cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.073+0000 7efd341bf640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15f310 0x7efd2c15cc40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009f40 tx=0x7efd1c004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.073+0000 7efd341bf640 1 -- 172.21.15.52:0/3190325753 shutdown_connections 2024-04-25T13:16:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.073+0000 7efd341bf640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efd1806c920 0x7efd1806ede0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.073+0000 7efd341bf640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd2c15b070 0x7efd2c1f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.073+0000 7efd341bf640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15f310 0x7efd2c15cc40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.073+0000 7efd341bf640 1 --2- 172.21.15.52:0/3190325753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd2c1553c0 0x7efd2c1586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.073+0000 7efd341bf640 1 -- 172.21.15.52:0/3190325753 >> 172.21.15.52:0/3190325753 conn(0x7efd2c072360 msgr2=0x7efd2c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.073+0000 7efd341bf640 1 -- 172.21.15.52:0/3190325753 shutdown_connections 2024-04-25T13:16:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.073+0000 7efd341bf640 1 -- 172.21.15.52:0/3190325753 wait complete. 2024-04-25T13:16:33.086 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-04-25T13:16:33.087 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-25T13:16:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.197+0000 7fd02ebf9640 1 Processor -- start 2024-04-25T13:16:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.197+0000 7fd02ebf9640 1 -- start start 2024-04-25T13:16:33.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd02ebf9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd028155530 0x7fd02815f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:33.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd02ebf9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd0280cccf0 0x7fd0280d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:33.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd02ebf9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0280cbe10 con 0x7fd0280d0f00 2024-04-25T13:16:33.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd02ebf9640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd02815bf10 con 0x7fd028155530 2024-04-25T13:16:33.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd02ebf9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd0280cc0d0 con 0x7fd0280cccf0 2024-04-25T13:16:33.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd02c995640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd028155530 0x7fd02815f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:33.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd02c995640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd028155530 0x7fd02815f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49656/0 (socket says 172.21.15.52:49656) 2024-04-25T13:16:33.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd02c995640 1 -- 172.21.15.52:0/2480868573 learned_addr learned my addr 172.21.15.52:0/2480868573 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:33.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd027fff640 1 --2- 172.21.15.52:0/2480868573 >> v2:172.21.15.102:3300/0 conn(0x7fd0280cccf0 0x7fd0280d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:33.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd02c995640 1 -- 172.21.15.52:0/2480868573 >> v2:172.21.15.102:3300/0 conn(0x7fd0280cccf0 msgr2=0x7fd0280d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:33.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd02c995640 1 --2- 172.21.15.52:0/2480868573 >> v2:172.21.15.102:3300/0 conn(0x7fd0280cccf0 0x7fd0280d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:33.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd02c995640 1 -- 172.21.15.52:0/2480868573 >> v1:172.21.15.102:6789/0 conn(0x7fd0280d0f00 legacy=0x7fd0280c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:33.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.198+0000 7fd02c995640 1 -- 172.21.15.52:0/2480868573 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02815b5e0 con 0x7fd028155530 2024-04-25T13:16:33.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.199+0000 7fd02c995640 1 --2- 172.21.15.52:0/2480868573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd028155530 0x7fd02815f210 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd0280b4a20 tx=0x7fd01c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9bbac693989712 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:33.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.199+0000 7fd0277fe640 1 -- 172.21.15.52:0/2480868573 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c037070 con 0x7fd028155530 2024-04-25T13:16:33.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.199+0000 7fd0277fe640 1 -- 172.21.15.52:0/2480868573 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd01c032440 con 0x7fd028155530 2024-04-25T13:16:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.199+0000 7fd0277fe640 1 -- 172.21.15.52:0/2480868573 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c032810 con 0x7fd028155530 2024-04-25T13:16:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.200+0000 7fd02ebf9640 1 -- 172.21.15.52:0/2480868573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd028155530 msgr2=0x7fd02815f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.200+0000 7fd02ebf9640 1 --2- 172.21.15.52:0/2480868573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd028155530 0x7fd02815f210 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd0280b4a20 tx=0x7fd01c02a230 comp rx=0 tx=0).stop 2024-04-25T13:16:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.200+0000 7fd02ebf9640 1 -- 172.21.15.52:0/2480868573 shutdown_connections 2024-04-25T13:16:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.200+0000 7fd02ebf9640 1 --2- 172.21.15.52:0/2480868573 >> v2:172.21.15.102:3300/0 conn(0x7fd0280cccf0 0x7fd0280d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.200+0000 7fd02ebf9640 1 --2- 172.21.15.52:0/2480868573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd028155530 0x7fd02815f210 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.200+0000 7fd02ebf9640 1 -- 172.21.15.52:0/2480868573 >> 172.21.15.52:0/2480868573 conn(0x7fd02806d350 msgr2=0x7fd028073110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.200+0000 7fd02ebf9640 1 -- 172.21.15.52:0/2480868573 shutdown_connections 2024-04-25T13:16:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.200+0000 7fd02ebf9640 1 -- 172.21.15.52:0/2480868573 wait complete. 2024-04-25T13:16:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.201+0000 7fd02ebf9640 1 Processor -- start 2024-04-25T13:16:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.201+0000 7fd02ebf9640 1 -- start start 2024-04-25T13:16:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02ebf9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0280cccf0 0x7fd0280c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02ebf9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0280d0f00 0x7fd0281584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02ebf9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd028155530 0x7fd028152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02ebf9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd02815b290 con 0x7fd028155530 2024-04-25T13:16:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02ebf9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd02815bba0 con 0x7fd0280d0f00 2024-04-25T13:16:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02ebf9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd0280cba90 con 0x7fd0280cccf0 2024-04-25T13:16:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02d196640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd028155530 0x7fd028152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02d196640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd028155530 0x7fd028152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49664/0 (socket says 172.21.15.52:49664) 2024-04-25T13:16:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02d196640 1 -- 172.21.15.52:0/4196926075 learned_addr learned my addr 172.21.15.52:0/4196926075 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd027fff640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0280d0f00 0x7fd0281584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02c995640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0280cccf0 0x7fd0280c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02d196640 1 -- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0280cccf0 msgr2=0x7fd0280c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02d196640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0280cccf0 0x7fd0280c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02d196640 1 -- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0280d0f00 msgr2=0x7fd0281584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02d196640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0280d0f00 0x7fd0281584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.202+0000 7fd02d196640 1 -- 172.21.15.52:0/4196926075 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0281f1210 con 0x7fd028155530 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.203+0000 7fd02d196640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd028155530 0x7fd028152ea0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd02000c780 tx=0x7fd02000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.203+0000 7fd0257fa640 1 -- 172.21.15.52:0/4196926075 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd020017070 con 0x7fd028155530 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.203+0000 7fd0257fa640 1 -- 172.21.15.52:0/4196926075 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd020003da0 con 0x7fd028155530 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.203+0000 7fd02ebf9640 1 -- 172.21.15.52:0/4196926075 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0280cdea0 con 0x7fd028155530 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.203+0000 7fd0257fa640 1 -- 172.21.15.52:0/4196926075 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0200052b0 con 0x7fd028155530 2024-04-25T13:16:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.203+0000 7fd02ebf9640 1 -- 172.21.15.52:0/4196926075 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0281f17b0 con 0x7fd028155530 2024-04-25T13:16:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.204+0000 7fd02ebf9640 1 -- 172.21.15.52:0/4196926075 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd028069ef0 con 0x7fd028155530 2024-04-25T13:16:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.204+0000 7fd0257fa640 1 -- 172.21.15.52:0/4196926075 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd02001a070 con 0x7fd028155530 2024-04-25T13:16:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.205+0000 7fd0257fa640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd00c06c920 0x7fd00c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.205+0000 7fd0257fa640 1 -- 172.21.15.52:0/4196926075 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd02008b3e0 con 0x7fd028155530 2024-04-25T13:16:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.205+0000 7fd02c995640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd00c06c920 0x7fd00c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.206+0000 7fd02c995640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd00c06c920 0x7fd00c06ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd01c034000 tx=0x7fd01c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:33.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.209+0000 7fd0257fa640 1 -- 172.21.15.52:0/4196926075 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd020058e80 con 0x7fd028155530 2024-04-25T13:16:33.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:33.438+0000 7fd02ebf9640 1 -- 172.21.15.52:0/4196926075 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fd0280cb860 con 0x7fd028155530 2024-04-25T13:16:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.075+0000 7fd0257fa640 1 -- 172.21.15.52:0/4196926075 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7fd0280cb860 con 0x7fd028155530 2024-04-25T13:16:34.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.078+0000 7fd02ebf9640 1 -- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd00c06c920 msgr2=0x7fd00c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:34.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.078+0000 7fd02ebf9640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd00c06c920 0x7fd00c06ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd01c034000 tx=0x7fd01c02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:34.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.078+0000 7fd02ebf9640 1 -- 172.21.15.52:0/4196926075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd028155530 msgr2=0x7fd028152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:34.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.078+0000 7fd02ebf9640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd028155530 0x7fd028152ea0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd02000c780 tx=0x7fd02000cc40 comp rx=0 tx=0).stop 2024-04-25T13:16:34.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.078+0000 7fd02ebf9640 1 -- 172.21.15.52:0/4196926075 shutdown_connections 2024-04-25T13:16:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.078+0000 7fd02ebf9640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd00c06c920 0x7fd00c06ede0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.078+0000 7fd02ebf9640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd028155530 0x7fd028152ea0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.078+0000 7fd02ebf9640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0280d0f00 0x7fd0281584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.078+0000 7fd02ebf9640 1 --2- 172.21.15.52:0/4196926075 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0280cccf0 0x7fd0280c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.078+0000 7fd02ebf9640 1 -- 172.21.15.52:0/4196926075 >> 172.21.15.52:0/4196926075 conn(0x7fd02806d350 msgr2=0x7fd028159ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.078+0000 7fd02ebf9640 1 -- 172.21.15.52:0/4196926075 shutdown_connections 2024-04-25T13:16:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.078+0000 7fd02ebf9640 1 -- 172.21.15.52:0/4196926075 wait complete. 2024-04-25T13:16:34.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T13:16:34.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.202+0000 7ff777bfe640 1 Processor -- start 2024-04-25T13:16:34.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.202+0000 7ff777bfe640 1 -- start start 2024-04-25T13:16:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.203+0000 7ff777bfe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7700d0820 0x7ff7700d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.203+0000 7ff777bfe640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7700c5c80 con 0x7ff77015b070 2024-04-25T13:16:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.203+0000 7ff777bfe640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7700d1170 con 0x7ff7701553c0 2024-04-25T13:16:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.203+0000 7ff777bfe640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff77015e660 con 0x7ff7700d0820 2024-04-25T13:16:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.203+0000 7ff775199640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff77015b070 0x7ff7700cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46124/0 (socket says 172.21.15.52:46124) 2024-04-25T13:16:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.203+0000 7ff775199640 1 -- 172.21.15.52:0/1012937713 learned_addr learned my addr 172.21.15.52:0/1012937713 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.203+0000 7ff77619b640 1 --2- 172.21.15.52:0/1012937713 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7700d0820 0x7ff7700d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.203+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092893364 0 0) 0x7ff7700c5c80 con 0x7ff77015b070 2024-04-25T13:16:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.203+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff758003520 con 0x7ff77015b070 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1144322551 0 0) 0x7ff7700d1170 con 0x7ff7701553c0 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7700c5c80 con 0x7ff7701553c0 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4106355686 0 0) 0x7ff758003520 con 0x7ff77015b070 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7700d0820 msgr2=0x7ff7700d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 --2- 172.21.15.52:0/1012937713 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7700d0820 0x7ff7700d0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 >> v1:172.21.15.102:6789/0 conn(0x7ff7701553c0 legacy=0x7ff77015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77015b5d0 con 0x7ff77015b070 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7ff7640017f0 con 0x7ff77015b070 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 >> v1:172.21.15.52:6789/0 conn(0x7ff77015b070 legacy=0x7ff7700cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 --2- 172.21.15.52:0/1012937713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff758003b70 0x7ff758003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 --2- 172.21.15.52:0/1012937713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff758004800 0x7ff758004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 --2- 172.21.15.52:0/1012937713 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7700d0820 0x7ff7580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff77015e660 con 0x7ff758004800 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff75800ba70 con 0x7ff758003b70 2024-04-25T13:16:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff75800bc40 con 0x7ff7700d0820 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff775199640 1 --2- 172.21.15.52:0/1012937713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff758004800 0x7ff758004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff77599a640 1 --2- 172.21.15.52:0/1012937713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff758003b70 0x7ff758003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff77619b640 1 --2- 172.21.15.52:0/1012937713 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7700d0820 0x7ff7580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff775199640 1 -- 172.21.15.52:0/1012937713 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7700d0820 msgr2=0x7ff7580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff775199640 1 --2- 172.21.15.52:0/1012937713 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7700d0820 0x7ff7580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff775199640 1 -- 172.21.15.52:0/1012937713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff758003b70 msgr2=0x7ff758003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff775199640 1 --2- 172.21.15.52:0/1012937713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff758003b70 0x7ff758003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.204+0000 7ff775199640 1 -- 172.21.15.52:0/1012937713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff758003520 con 0x7ff758004800 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.205+0000 7ff775199640 1 --2- 172.21.15.52:0/1012937713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff758004800 0x7ff758004c80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff76400c190 tx=0x7ff758005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57ca34f1d9c5f5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.205+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764007c80 con 0x7ff758004800 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.205+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff764007270 con 0x7ff758004800 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.205+0000 7ff774998640 1 -- 172.21.15.52:0/1012937713 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7640057a0 con 0x7ff758004800 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.206+0000 7ff777bfe640 1 -- 172.21.15.52:0/1012937713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff758004800 msgr2=0x7ff758004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.206+0000 7ff777bfe640 1 --2- 172.21.15.52:0/1012937713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff758004800 0x7ff758004c80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff76400c190 tx=0x7ff758005830 comp rx=0 tx=0).stop 2024-04-25T13:16:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.206+0000 7ff77619b640 1 -- 172.21.15.52:0/1012937713 reap_dead start 2024-04-25T13:16:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.206+0000 7ff777bfe640 1 -- 172.21.15.52:0/1012937713 shutdown_connections 2024-04-25T13:16:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.206+0000 7ff777bfe640 1 -- 172.21.15.52:0/1012937713 >> 172.21.15.52:0/1012937713 conn(0x7ff770072360 msgr2=0x7ff770074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.206+0000 7ff777bfe640 1 -- 172.21.15.52:0/1012937713 shutdown_connections 2024-04-25T13:16:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.206+0000 7ff777bfe640 1 -- 172.21.15.52:0/1012937713 wait complete. 2024-04-25T13:16:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.207+0000 7ff777bfe640 1 Processor -- start 2024-04-25T13:16:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.207+0000 7ff777bfe640 1 -- start start 2024-04-25T13:16:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff777bfe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff758004800 0x7ff77015def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff777bfe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff770150a30 0x7ff7700ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff777bfe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff770150e70 0x7ff7700ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff777bfe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff77015bb90 con 0x7ff770150a30 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff777bfe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff7701557a0 con 0x7ff770150e70 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff777bfe640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff77015be70 con 0x7ff758004800 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff775199640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff770150a30 0x7ff7700ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff775199640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff770150a30 0x7ff7700ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49680/0 (socket says 172.21.15.52:49680) 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff775199640 1 -- 172.21.15.52:0/3614658551 learned_addr learned my addr 172.21.15.52:0/3614658551 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff77599a640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff758004800 0x7ff77015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff77619b640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff770150e70 0x7ff7700ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff775199640 1 -- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff758004800 msgr2=0x7ff77015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff775199640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff758004800 0x7ff77015def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff775199640 1 -- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff770150e70 msgr2=0x7ff7700ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff775199640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff770150e70 0x7ff7700ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff775199640 1 -- 172.21.15.52:0/3614658551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77015e430 con 0x7ff770150a30 2024-04-25T13:16:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff775199640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff770150a30 0x7ff7700ca180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff76400c2b0 tx=0x7ff7700b34d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff76e7fc640 1 -- 172.21.15.52:0/3614658551 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764007070 con 0x7ff770150a30 2024-04-25T13:16:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff76e7fc640 1 -- 172.21.15.52:0/3614658551 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff764042070 con 0x7ff770150a30 2024-04-25T13:16:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff777bfe640 1 -- 172.21.15.52:0/3614658551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7701f1840 con 0x7ff770150a30 2024-04-25T13:16:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff76e7fc640 1 -- 172.21.15.52:0/3614658551 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7640057a0 con 0x7ff770150a30 2024-04-25T13:16:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.208+0000 7ff777bfe640 1 -- 172.21.15.52:0/3614658551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7701f0fa0 con 0x7ff770150a30 2024-04-25T13:16:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.209+0000 7ff777bfe640 1 -- 172.21.15.52:0/3614658551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff770068f50 con 0x7ff770150a30 2024-04-25T13:16:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.210+0000 7ff76e7fc640 1 -- 172.21.15.52:0/3614658551 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff764032430 con 0x7ff770150a30 2024-04-25T13:16:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.210+0000 7ff76e7fc640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff75c06c8f0 0x7ff75c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.210+0000 7ff76e7fc640 1 -- 172.21.15.52:0/3614658551 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff7640ab7d0 con 0x7ff770150a30 2024-04-25T13:16:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.211+0000 7ff77599a640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff75c06c8f0 0x7ff75c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.211+0000 7ff77599a640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff75c06c8f0 0x7ff75c06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff768007fd0 tx=0x7ff768009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:34.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.215+0000 7ff76e7fc640 1 -- 172.21.15.52:0/3614658551 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff76404b020 con 0x7ff770150a30 2024-04-25T13:16:34.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:34.440+0000 7ff777bfe640 1 -- 172.21.15.52:0/3614658551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff7700cc0e0 con 0x7ff770150a30 2024-04-25T13:16:35.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.081+0000 7ff76e7fc640 1 -- 172.21.15.52:0/3614658551 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7ff764079950 con 0x7ff770150a30 2024-04-25T13:16:35.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.084+0000 7ff777bfe640 1 -- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff75c06c8f0 msgr2=0x7ff75c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:35.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.084+0000 7ff777bfe640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff75c06c8f0 0x7ff75c06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff768007fd0 tx=0x7ff768009040 comp rx=0 tx=0).stop 2024-04-25T13:16:35.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.084+0000 7ff777bfe640 1 -- 172.21.15.52:0/3614658551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff770150a30 msgr2=0x7ff7700ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:35.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.084+0000 7ff777bfe640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff770150a30 0x7ff7700ca180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff76400c2b0 tx=0x7ff7700b34d0 comp rx=0 tx=0).stop 2024-04-25T13:16:35.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.084+0000 7ff777bfe640 1 -- 172.21.15.52:0/3614658551 shutdown_connections 2024-04-25T13:16:35.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.084+0000 7ff777bfe640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff75c06c8f0 0x7ff75c06edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:35.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.084+0000 7ff777bfe640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff770150e70 0x7ff7700ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:35.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.084+0000 7ff777bfe640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff770150a30 0x7ff7700ca180 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:35.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.084+0000 7ff777bfe640 1 --2- 172.21.15.52:0/3614658551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff758004800 0x7ff77015def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:35.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.084+0000 7ff777bfe640 1 -- 172.21.15.52:0/3614658551 >> 172.21.15.52:0/3614658551 conn(0x7ff770072360 msgr2=0x7ff7700d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:35.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.084+0000 7ff777bfe640 1 -- 172.21.15.52:0/3614658551 shutdown_connections 2024-04-25T13:16:35.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.084+0000 7ff777bfe640 1 -- 172.21.15.52:0/3614658551 wait complete. 2024-04-25T13:16:35.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T13:16:35.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.207+0000 7ff998ee1640 1 Processor -- start 2024-04-25T13:16:35.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.208+0000 7ff998ee1640 1 -- start start 2024-04-25T13:16:35.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.208+0000 7ff998ee1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff99406c880 0x7ff99406ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:35.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.208+0000 7ff998ee1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff9940c7c20 0x7ff9940c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:35.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.208+0000 7ff998ee1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99406d230 con 0x7ff994155710 2024-04-25T13:16:35.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.208+0000 7ff998ee1640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff9940c8940 con 0x7ff99406c880 2024-04-25T13:16:35.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.208+0000 7ff998ee1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff994155af0 con 0x7ff9940c7c20 2024-04-25T13:16:35.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.209+0000 7ff991d9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff99406c880 0x7ff99406ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:35.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.209+0000 7ff991d9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff99406c880 0x7ff99406ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49690/0 (socket says 172.21.15.52:49690) 2024-04-25T13:16:35.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.209+0000 7ff991d9b640 1 -- 172.21.15.52:0/668404160 learned_addr learned my addr 172.21.15.52:0/668404160 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:35.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.209+0000 7ff992d9d640 1 --2- 172.21.15.52:0/668404160 >> v2:172.21.15.102:3300/0 conn(0x7ff9940c7c20 0x7ff9940c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:35.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.209+0000 7ff991d9b640 1 -- 172.21.15.52:0/668404160 >> v2:172.21.15.102:3300/0 conn(0x7ff9940c7c20 msgr2=0x7ff9940c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:35.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.209+0000 7ff991d9b640 1 --2- 172.21.15.52:0/668404160 >> v2:172.21.15.102:3300/0 conn(0x7ff9940c7c20 0x7ff9940c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:35.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.209+0000 7ff991d9b640 1 -- 172.21.15.52:0/668404160 >> v1:172.21.15.102:6789/0 conn(0x7ff994155710 legacy=0x7ff9940cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:35.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.209+0000 7ff991d9b640 1 -- 172.21.15.52:0/668404160 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99415eaa0 con 0x7ff99406c880 2024-04-25T13:16:35.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.209+0000 7ff992d9d640 1 --2- 172.21.15.52:0/668404160 >> v2:172.21.15.102:3300/0 conn(0x7ff9940c7c20 0x7ff9940c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:35.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.210+0000 7ff991d9b640 1 --2- 172.21.15.52:0/668404160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99406c880 0x7ff99406ccf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff994072f80 tx=0x7ff98802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0070f6e7f3f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:35.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.210+0000 7ff99159a640 1 -- 172.21.15.52:0/668404160 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988037070 con 0x7ff99406c880 2024-04-25T13:16:35.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.210+0000 7ff99159a640 1 -- 172.21.15.52:0/668404160 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff988032440 con 0x7ff99406c880 2024-04-25T13:16:35.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.210+0000 7ff99159a640 1 -- 172.21.15.52:0/668404160 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988032810 con 0x7ff99406c880 2024-04-25T13:16:35.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.210+0000 7ff998ee1640 1 -- 172.21.15.52:0/668404160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99406c880 msgr2=0x7ff99406ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:35.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.210+0000 7ff998ee1640 1 --2- 172.21.15.52:0/668404160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99406c880 0x7ff99406ccf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff994072f80 tx=0x7ff98802a270 comp rx=0 tx=0).stop 2024-04-25T13:16:35.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.210+0000 7ff998ee1640 1 -- 172.21.15.52:0/668404160 shutdown_connections 2024-04-25T13:16:35.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.210+0000 7ff998ee1640 1 --2- 172.21.15.52:0/668404160 >> v2:172.21.15.102:3300/0 conn(0x7ff9940c7c20 0x7ff9940c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:35.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.210+0000 7ff998ee1640 1 --2- 172.21.15.52:0/668404160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99406c880 0x7ff99406ccf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:35.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.210+0000 7ff998ee1640 1 -- 172.21.15.52:0/668404160 >> 172.21.15.52:0/668404160 conn(0x7ff9940731d0 msgr2=0x7ff9940735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:35.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.211+0000 7ff998ee1640 1 -- 172.21.15.52:0/668404160 shutdown_connections 2024-04-25T13:16:35.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.211+0000 7ff998ee1640 1 -- 172.21.15.52:0/668404160 wait complete. 2024-04-25T13:16:35.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.212+0000 7ff998ee1640 1 Processor -- start 2024-04-25T13:16:35.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.212+0000 7ff998ee1640 1 -- start start 2024-04-25T13:16:35.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.212+0000 7ff998ee1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99406c880 0x7ff9940cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:35.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.212+0000 7ff998ee1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9940c7c20 0x7ff9940cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:35.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff998ee1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff994155710 0x7ff9940ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:35.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff998ee1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff99415f060 con 0x7ff99406c880 2024-04-25T13:16:35.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff998ee1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff99415f6b0 con 0x7ff994155710 2024-04-25T13:16:35.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff998ee1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff99415f340 con 0x7ff9940c7c20 2024-04-25T13:16:35.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff99259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99406c880 0x7ff9940cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:35.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff99259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99406c880 0x7ff9940cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49696/0 (socket says 172.21.15.52:49696) 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff99259c640 1 -- 172.21.15.52:0/2399270349 learned_addr learned my addr 172.21.15.52:0/2399270349 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff992d9d640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff994155710 0x7ff9940ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff991d9b640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9940c7c20 0x7ff9940cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff99259c640 1 -- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9940c7c20 msgr2=0x7ff9940cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff99259c640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9940c7c20 0x7ff9940cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff99259c640 1 -- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff994155710 msgr2=0x7ff9940ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff99259c640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff994155710 0x7ff9940ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff99259c640 1 -- 172.21.15.52:0/2399270349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9940c75d0 con 0x7ff99406c880 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff99259c640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99406c880 0x7ff9940cf4e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00c3c0 tx=0x7ff98c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff982ffd640 1 -- 172.21.15.52:0/2399270349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0052d0 con 0x7ff99406c880 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff982ffd640 1 -- 172.21.15.52:0/2399270349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff98c005490 con 0x7ff99406c880 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff998ee1640 1 -- 172.21.15.52:0/2399270349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9941e51d0 con 0x7ff99406c880 2024-04-25T13:16:35.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.213+0000 7ff982ffd640 1 -- 172.21.15.52:0/2399270349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c007260 con 0x7ff99406c880 2024-04-25T13:16:35.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.214+0000 7ff998ee1640 1 -- 172.21.15.52:0/2399270349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff99414eac0 con 0x7ff99406c880 2024-04-25T13:16:35.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.215+0000 7ff998ee1640 1 -- 172.21.15.52:0/2399270349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9940b6050 con 0x7ff99406c880 2024-04-25T13:16:35.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.215+0000 7ff982ffd640 1 -- 172.21.15.52:0/2399270349 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff98c007400 con 0x7ff99406c880 2024-04-25T13:16:35.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.216+0000 7ff982ffd640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff97406c8f0 0x7ff97406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:35.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.216+0000 7ff982ffd640 1 -- 172.21.15.52:0/2399270349 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff98c08b2f0 con 0x7ff99406c880 2024-04-25T13:16:35.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.216+0000 7ff991d9b640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff97406c8f0 0x7ff97406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:35.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.216+0000 7ff991d9b640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff97406c8f0 0x7ff97406edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff988034000 tx=0x7ff98802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:35.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.220+0000 7ff982ffd640 1 -- 172.21.15.52:0/2399270349 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff98c058d80 con 0x7ff99406c880 2024-04-25T13:16:35.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:35.448+0000 7ff998ee1640 1 -- 172.21.15.52:0/2399270349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7ff99414f420 con 0x7ff99406c880 2024-04-25T13:16:36.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.086+0000 7ff982ffd640 1 -- 172.21.15.52:0/2399270349 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7ff98c05d080 con 0x7ff99406c880 2024-04-25T13:16:36.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.089+0000 7ff998ee1640 1 -- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff97406c8f0 msgr2=0x7ff97406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.089+0000 7ff998ee1640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff97406c8f0 0x7ff97406edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff988034000 tx=0x7ff98802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:36.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.089+0000 7ff998ee1640 1 -- 172.21.15.52:0/2399270349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99406c880 msgr2=0x7ff9940cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.089+0000 7ff998ee1640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99406c880 0x7ff9940cf4e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00c3c0 tx=0x7ff98c00c880 comp rx=0 tx=0).stop 2024-04-25T13:16:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.089+0000 7ff998ee1640 1 -- 172.21.15.52:0/2399270349 shutdown_connections 2024-04-25T13:16:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.089+0000 7ff998ee1640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff97406c8f0 0x7ff97406edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.089+0000 7ff998ee1640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9940c7c20 0x7ff9940cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.089+0000 7ff998ee1640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff994155710 0x7ff9940ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.089+0000 7ff998ee1640 1 --2- 172.21.15.52:0/2399270349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99406c880 0x7ff9940cf4e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.089+0000 7ff998ee1640 1 -- 172.21.15.52:0/2399270349 >> 172.21.15.52:0/2399270349 conn(0x7ff9940731d0 msgr2=0x7ff9940cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.089+0000 7ff998ee1640 1 -- 172.21.15.52:0/2399270349 shutdown_connections 2024-04-25T13:16:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.089+0000 7ff998ee1640 1 -- 172.21.15.52:0/2399270349 wait complete. 2024-04-25T13:16:36.102 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T13:16:36.102 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:36.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.209+0000 7f9e73ff7640 1 Processor -- start 2024-04-25T13:16:36.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.209+0000 7f9e73ff7640 1 -- start start 2024-04-25T13:16:36.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e73ff7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e6c074410 0x7f9e6c071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e73ff7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9e6c0c6e00 0x7f9e6c15ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e73ff7640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e6c0c7bd0 con 0x7f9e6c152fd0 2024-04-25T13:16:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e73ff7640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9e6c0c86a0 con 0x7f9e6c0c6e00 2024-04-25T13:16:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e73ff7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c0c8980 con 0x7f9e6c074410 2024-04-25T13:16:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e71d93640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9e6c152fd0 0x7f9e6c073730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46140/0 (socket says 172.21.15.52:46140) 2024-04-25T13:16:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e71d93640 1 -- 172.21.15.52:0/2847102251 learned_addr learned my addr 172.21.15.52:0/2847102251 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e72594640 1 --2- 172.21.15.52:0/2847102251 >> v2:172.21.15.52:3300/0 conn(0x7f9e6c0c6e00 0x7f9e6c15ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e72594640 1 -- 172.21.15.52:0/2847102251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e6c074410 msgr2=0x7f9e6c071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e72594640 1 --2- 172.21.15.52:0/2847102251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e6c074410 0x7f9e6c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e72594640 1 -- 172.21.15.52:0/2847102251 >> v1:172.21.15.52:6789/0 conn(0x7f9e6c152fd0 legacy=0x7f9e6c073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e72594640 1 -- 172.21.15.52:0/2847102251 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c15c3d0 con 0x7f9e6c0c6e00 2024-04-25T13:16:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.210+0000 7f9e70d91640 1 -- 172.21.15.52:0/2847102251 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848079836 0 0) 0x7f9e6c0c7bd0 con 0x7f9e6c152fd0 2024-04-25T13:16:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.211+0000 7f9e72594640 1 --2- 172.21.15.52:0/2847102251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e6c0c6e00 0x7f9e6c15ceb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009d90 tx=0x7f9e6402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0c4d66a72ce2db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.211+0000 7f9e70d91640 1 -- 172.21.15.52:0/2847102251 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64031600 con 0x7f9e6c0c6e00 2024-04-25T13:16:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.211+0000 7f9e70d91640 1 -- 172.21.15.52:0/2847102251 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e640317a0 con 0x7f9e6c0c6e00 2024-04-25T13:16:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.211+0000 7f9e70d91640 1 -- 172.21.15.52:0/2847102251 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64031b70 con 0x7f9e6c0c6e00 2024-04-25T13:16:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.212+0000 7f9e73ff7640 1 -- 172.21.15.52:0/2847102251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e6c0c6e00 msgr2=0x7f9e6c15ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.212+0000 7f9e73ff7640 1 --2- 172.21.15.52:0/2847102251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e6c0c6e00 0x7f9e6c15ceb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009d90 tx=0x7f9e6402a5d0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.212+0000 7f9e73ff7640 1 -- 172.21.15.52:0/2847102251 shutdown_connections 2024-04-25T13:16:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.212+0000 7f9e73ff7640 1 --2- 172.21.15.52:0/2847102251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e6c0c6e00 0x7f9e6c15ceb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.212+0000 7f9e73ff7640 1 --2- 172.21.15.52:0/2847102251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e6c074410 0x7f9e6c071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.212+0000 7f9e73ff7640 1 -- 172.21.15.52:0/2847102251 >> 172.21.15.52:0/2847102251 conn(0x7f9e6c0c8f00 msgr2=0x7f9e6c0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.212+0000 7f9e73ff7640 1 -- 172.21.15.52:0/2847102251 shutdown_connections 2024-04-25T13:16:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.212+0000 7f9e73ff7640 1 -- 172.21.15.52:0/2847102251 wait complete. 2024-04-25T13:16:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.213+0000 7f9e73ff7640 1 Processor -- start 2024-04-25T13:16:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.213+0000 7f9e73ff7640 1 -- start start 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e73ff7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e6c074410 0x7f9e6c14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e73ff7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e6c0c6e00 0x7f9e6c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e73ff7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e6c152fd0 0x7f9e6c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e73ff7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c0c8c60 con 0x7f9e6c152fd0 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e73ff7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c15c990 con 0x7f9e6c0c6e00 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e73ff7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c1533b0 con 0x7f9e6c074410 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e72594640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e6c152fd0 0x7f9e6c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e72594640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e6c152fd0 0x7f9e6c0cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49714/0 (socket says 172.21.15.52:49714) 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e72594640 1 -- 172.21.15.52:0/858611442 learned_addr learned my addr 172.21.15.52:0/858611442 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e71d93640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e6c074410 0x7f9e6c14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e71592640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e6c0c6e00 0x7f9e6c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e72594640 1 -- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e6c074410 msgr2=0x7f9e6c14d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e72594640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e6c074410 0x7f9e6c14d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e72594640 1 -- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e6c0c6e00 msgr2=0x7f9e6c0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e72594640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e6c0c6e00 0x7f9e6c0caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e72594640 1 -- 172.21.15.52:0/858611442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c156600 con 0x7f9e6c152fd0 2024-04-25T13:16:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e72594640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e6c152fd0 0x7f9e6c0cbe70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009eb0 tx=0x7f9e64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e627fc640 1 -- 172.21.15.52:0/858611442 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64040070 con 0x7f9e6c152fd0 2024-04-25T13:16:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e627fc640 1 -- 172.21.15.52:0/858611442 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e64030b60 con 0x7f9e6c152fd0 2024-04-25T13:16:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e73ff7640 1 -- 172.21.15.52:0/858611442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e6c149190 con 0x7f9e6c152fd0 2024-04-25T13:16:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.214+0000 7f9e627fc640 1 -- 172.21.15.52:0/858611442 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64045460 con 0x7f9e6c152fd0 2024-04-25T13:16:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.215+0000 7f9e73ff7640 1 -- 172.21.15.52:0/858611442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e6c156320 con 0x7f9e6c152fd0 2024-04-25T13:16:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.216+0000 7f9e73ff7640 1 -- 172.21.15.52:0/858611442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6c068e40 con 0x7f9e6c152fd0 2024-04-25T13:16:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.216+0000 7f9e627fc640 1 -- 172.21.15.52:0/858611442 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e64039040 con 0x7f9e6c152fd0 2024-04-25T13:16:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.217+0000 7f9e627fc640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9e5006c8f0 0x7f9e5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.217+0000 7f9e627fc640 1 -- 172.21.15.52:0/858611442 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9e640ad6b0 con 0x7f9e6c152fd0 2024-04-25T13:16:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.217+0000 7f9e71d93640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9e5006c8f0 0x7f9e5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.217+0000 7f9e71d93640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9e5006c8f0 0x7f9e5006edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9e68000f60 tx=0x7f9e68007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.221+0000 7f9e627fc640 1 -- 172.21.15.52:0/858611442 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9e6407b990 con 0x7f9e6c152fd0 2024-04-25T13:16:36.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.444+0000 7f9e73ff7640 1 -- 172.21.15.52:0/858611442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e6c06bd50 con 0x7f9e6c152fd0 2024-04-25T13:16:36.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.444+0000 7f9e627fc640 1 -- 172.21.15.52:0/858611442 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6847 (secure 0 0 0) 0x7f9e6407b290 con 0x7f9e6c152fd0 2024-04-25T13:16:36.445 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:36.445 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2650846419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2650846419},{"type":"v1","addr":"172.21.15.102:6837","nonce":2650846419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6838/1508646651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":1508646651},{"type":"v1","addr":"172.21.15.102:6838","nonce":1508646651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/1980846137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1980846137},{"type":"v1","addr":"172.21.15.102:6839","nonce":1980846137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/714334205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":714334205},{"type":"v1","addr":"172.21.15.52:6835","nonce":714334205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:07.352382+0000","modified":"2024-04-25T13:16:35.449840+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4290,"mds_1":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.52:6834/3228537118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3228537118},{"type":"v1","addr":"172.21.15.52:6834","nonce":3228537118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4290":{"gid":4290,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6837/413759311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":413759311},{"type":"v1","addr":"172.21.15.52:6837","nonce":413759311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-25T13:16:36.445 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 11 2024-04-25T13:16:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.446+0000 7f9e73ff7640 1 -- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9e5006c8f0 msgr2=0x7f9e5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.446+0000 7f9e73ff7640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9e5006c8f0 0x7f9e5006edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9e68000f60 tx=0x7f9e68007c00 comp rx=0 tx=0).stop 2024-04-25T13:16:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.446+0000 7f9e73ff7640 1 -- 172.21.15.52:0/858611442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e6c152fd0 msgr2=0x7f9e6c0cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.446+0000 7f9e73ff7640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e6c152fd0 0x7f9e6c0cbe70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009eb0 tx=0x7f9e64004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.446+0000 7f9e73ff7640 1 -- 172.21.15.52:0/858611442 shutdown_connections 2024-04-25T13:16:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.446+0000 7f9e73ff7640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9e5006c8f0 0x7f9e5006edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.446+0000 7f9e73ff7640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e6c152fd0 0x7f9e6c0cbe70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.446+0000 7f9e73ff7640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e6c0c6e00 0x7f9e6c0caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.446+0000 7f9e73ff7640 1 --2- 172.21.15.52:0/858611442 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e6c074410 0x7f9e6c14d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.446+0000 7f9e73ff7640 1 -- 172.21.15.52:0/858611442 >> 172.21.15.52:0/858611442 conn(0x7f9e6c0c8f00 msgr2=0x7f9e6c150db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.446+0000 7f9e73ff7640 1 -- 172.21.15.52:0/858611442 shutdown_connections 2024-04-25T13:16:36.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.446+0000 7f9e73ff7640 1 -- 172.21.15.52:0/858611442 wait complete. 2024-04-25T13:16:36.457 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:36.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.558+0000 7f149b28a640 1 Processor -- start 2024-04-25T13:16:36.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.558+0000 7f149b28a640 1 -- start start 2024-04-25T13:16:36.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f149b28a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1494152280 0x7f14941591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f149b28a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f14940c3cb0 0x7f1494159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f149b28a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149415b610 con 0x7f1494151ea0 2024-04-25T13:16:36.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f149b28a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f149406f300 con 0x7f14940c3cb0 2024-04-25T13:16:36.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f149b28a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f149406e6f0 con 0x7f1494152280 2024-04-25T13:16:36.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f1499827640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f14940c3cb0 0x7f1494159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f1499026640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1494151ea0 0x7f14940c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46152/0 (socket says 172.21.15.52:46152) 2024-04-25T13:16:36.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f1499026640 1 -- 172.21.15.52:0/1244148886 learned_addr learned my addr 172.21.15.52:0/1244148886 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:36.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f1498825640 1 --2- 172.21.15.52:0/1244148886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1494152280 0x7f14941591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f1499827640 1 -- 172.21.15.52:0/1244148886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1494152280 msgr2=0x7f14941591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:36.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f1499827640 1 --2- 172.21.15.52:0/1244148886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1494152280 0x7f14941591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f1499827640 1 -- 172.21.15.52:0/1244148886 >> v1:172.21.15.52:6789/0 conn(0x7f1494151ea0 legacy=0x7f14940c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f148bfff640 1 -- 172.21.15.52:0/1244148886 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 135905305 0 0) 0x7f149415b610 con 0x7f1494151ea0 2024-04-25T13:16:36.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.559+0000 7f1499827640 1 -- 172.21.15.52:0/1244148886 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149406e9d0 con 0x7f14940c3cb0 2024-04-25T13:16:36.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.560+0000 7f1499827640 1 --2- 172.21.15.52:0/1244148886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14940c3cb0 0x7f1494159710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f149406f480 tx=0x7f148c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5635a44e611af5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.560+0000 7f148bfff640 1 -- 172.21.15.52:0/1244148886 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c007740 con 0x7f14940c3cb0 2024-04-25T13:16:36.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.560+0000 7f148bfff640 1 -- 172.21.15.52:0/1244148886 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f148c0078e0 con 0x7f14940c3cb0 2024-04-25T13:16:36.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.560+0000 7f148bfff640 1 -- 172.21.15.52:0/1244148886 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c007cb0 con 0x7f14940c3cb0 2024-04-25T13:16:36.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.561+0000 7f149b28a640 1 -- 172.21.15.52:0/1244148886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14940c3cb0 msgr2=0x7f1494159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.561+0000 7f149b28a640 1 --2- 172.21.15.52:0/1244148886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14940c3cb0 0x7f1494159710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f149406f480 tx=0x7f148c02a6d0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.561+0000 7f149b28a640 1 -- 172.21.15.52:0/1244148886 shutdown_connections 2024-04-25T13:16:36.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.561+0000 7f149b28a640 1 --2- 172.21.15.52:0/1244148886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14940c3cb0 0x7f1494159710 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.561+0000 7f149b28a640 1 --2- 172.21.15.52:0/1244148886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1494152280 0x7f14941591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.561+0000 7f149b28a640 1 -- 172.21.15.52:0/1244148886 >> 172.21.15.52:0/1244148886 conn(0x7f14940c8f00 msgr2=0x7f14940c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:36.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.561+0000 7f149b28a640 1 -- 172.21.15.52:0/1244148886 shutdown_connections 2024-04-25T13:16:36.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.561+0000 7f149b28a640 1 -- 172.21.15.52:0/1244148886 wait complete. 2024-04-25T13:16:36.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.562+0000 7f149b28a640 1 Processor -- start 2024-04-25T13:16:36.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.562+0000 7f149b28a640 1 -- start start 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.562+0000 7f149b28a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14940c3cb0 0x7f14941ee9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.562+0000 7f149b28a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1494151ea0 0x7f1494147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.562+0000 7f149b28a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1494157770 0x7f1494148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.562+0000 7f149b28a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f14940c8cb0 con 0x7f1494157770 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.562+0000 7f149b28a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f149406ef90 con 0x7f1494151ea0 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.562+0000 7f149b28a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f149415b2d0 con 0x7f14940c3cb0 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1499827640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1494157770 0x7f1494148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1499827640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1494157770 0x7f1494148280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49740/0 (socket says 172.21.15.52:49740) 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1499827640 1 -- 172.21.15.52:0/2761979994 learned_addr learned my addr 172.21.15.52:0/2761979994 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1499026640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14940c3cb0 0x7f14941ee9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1498825640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1494151ea0 0x7f1494147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1499827640 1 -- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14940c3cb0 msgr2=0x7f14941ee9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1499827640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14940c3cb0 0x7f14941ee9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1499827640 1 -- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1494151ea0 msgr2=0x7f1494147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1499827640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1494151ea0 0x7f1494147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1499827640 1 -- 172.21.15.52:0/2761979994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14941ee210 con 0x7f1494157770 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1499827640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1494157770 0x7f1494148280 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f148c009e50 tx=0x7f148c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1489ffb640 1 -- 172.21.15.52:0/2761979994 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c040070 con 0x7f1494157770 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1489ffb640 1 -- 172.21.15.52:0/2761979994 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f148c031bf0 con 0x7f1494157770 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f149b28a640 1 -- 172.21.15.52:0/2761979994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1494157c40 con 0x7f1494157770 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.563+0000 7f1489ffb640 1 -- 172.21.15.52:0/2761979994 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c009450 con 0x7f1494157770 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.564+0000 7f149b28a640 1 -- 172.21.15.52:0/2761979994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f149414b6f0 con 0x7f1494157770 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.565+0000 7f149b28a640 1 -- 172.21.15.52:0/2761979994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1494068e40 con 0x7f1494157770 2024-04-25T13:16:36.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.565+0000 7f1489ffb640 1 -- 172.21.15.52:0/2761979994 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f148c039040 con 0x7f1494157770 2024-04-25T13:16:36.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.565+0000 7f1489ffb640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f147806c8f0 0x7f147806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.566+0000 7f1489ffb640 1 -- 172.21.15.52:0/2761979994 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f148c0ad5f0 con 0x7f1494157770 2024-04-25T13:16:36.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.566+0000 7f1499026640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f147806c8f0 0x7f147806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.566+0000 7f1499026640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f147806c8f0 0x7f147806edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1490000f60 tx=0x7f1490007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.570+0000 7f1489ffb640 1 -- 172.21.15.52:0/2761979994 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f14941ee210 con 0x7f1494157770 2024-04-25T13:16:36.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.759+0000 7f149b28a640 1 -- 172.21.15.52:0/2761979994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1494072100 con 0x7f1494157770 2024-04-25T13:16:36.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.760+0000 7f1489ffb640 1 -- 172.21.15.52:0/2761979994 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f148c07b080 con 0x7f1494157770 2024-04-25T13:16:36.760 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:36.760 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":25,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:14.018518+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:36.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.762+0000 7f149b28a640 1 -- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f147806c8f0 msgr2=0x7f147806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.762+0000 7f149b28a640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f147806c8f0 0x7f147806edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1490000f60 tx=0x7f1490007d50 comp rx=0 tx=0).stop 2024-04-25T13:16:36.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.762+0000 7f149b28a640 1 -- 172.21.15.52:0/2761979994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1494157770 msgr2=0x7f1494148280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.762+0000 7f149b28a640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1494157770 0x7f1494148280 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f148c009e50 tx=0x7f148c004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:36.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.762+0000 7f149b28a640 1 -- 172.21.15.52:0/2761979994 shutdown_connections 2024-04-25T13:16:36.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.762+0000 7f149b28a640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f147806c8f0 0x7f147806edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.762+0000 7f149b28a640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1494157770 0x7f1494148280 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.762+0000 7f149b28a640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1494151ea0 0x7f1494147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.762+0000 7f149b28a640 1 --2- 172.21.15.52:0/2761979994 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14940c3cb0 0x7f14941ee9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.762+0000 7f149b28a640 1 -- 172.21.15.52:0/2761979994 >> 172.21.15.52:0/2761979994 conn(0x7f14940c8f00 msgr2=0x7f1494151120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:36.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.762+0000 7f149b28a640 1 -- 172.21.15.52:0/2761979994 shutdown_connections 2024-04-25T13:16:36.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.762+0000 7f149b28a640 1 -- 172.21.15.52:0/2761979994 wait complete. 2024-04-25T13:16:36.773 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T13:16:36.773 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:16:36.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.873+0000 7f84f47e2640 1 Processor -- start 2024-04-25T13:16:36.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.874+0000 7f84f47e2640 1 -- start start 2024-04-25T13:16:36.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.874+0000 7f84f47e2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f84ec151e70 0x7f84ec0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.874+0000 7f84f47e2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84ec0ca610 0x7f84ec0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.874+0000 7f84f47e2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84ec157e60 con 0x7f84ec0c88f0 2024-04-25T13:16:36.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.874+0000 7f84f47e2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f84ec157c30 con 0x7f84ec0ca610 2024-04-25T13:16:36.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.874+0000 7f84f47e2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f84ec158100 con 0x7f84ec151e70 2024-04-25T13:16:36.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.875+0000 7f84f2d7f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84ec0ca610 0x7f84ec0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.875+0000 7f84f1d7d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f84ec0c88f0 0x7f84ec072250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46162/0 (socket says 172.21.15.52:46162) 2024-04-25T13:16:36.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.875+0000 7f84f1d7d640 1 -- 172.21.15.52:0/3386641227 learned_addr learned my addr 172.21.15.52:0/3386641227 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:36.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.875+0000 7f84f257e640 1 --2- 172.21.15.52:0/3386641227 >> v2:172.21.15.102:3300/0 conn(0x7f84ec151e70 0x7f84ec0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.875+0000 7f84f2d7f640 1 -- 172.21.15.52:0/3386641227 >> v2:172.21.15.102:3300/0 conn(0x7f84ec151e70 msgr2=0x7f84ec0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:36.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.875+0000 7f84f2d7f640 1 --2- 172.21.15.52:0/3386641227 >> v2:172.21.15.102:3300/0 conn(0x7f84ec151e70 0x7f84ec0cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.875+0000 7f84f2d7f640 1 -- 172.21.15.52:0/3386641227 >> v1:172.21.15.52:6789/0 conn(0x7f84ec0c88f0 legacy=0x7f84ec072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.875+0000 7f84f2d7f640 1 -- 172.21.15.52:0/3386641227 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ec1583a0 con 0x7f84ec0ca610 2024-04-25T13:16:36.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.875+0000 7f84f157c640 1 -- 172.21.15.52:0/3386641227 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3514816480 0 0) 0x7f84ec157e60 con 0x7f84ec0c88f0 2024-04-25T13:16:36.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.875+0000 7f84f257e640 1 --2- 172.21.15.52:0/3386641227 >> v2:172.21.15.102:3300/0 conn(0x7f84ec151e70 0x7f84ec0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:36.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.876+0000 7f84f2d7f640 1 --2- 172.21.15.52:0/3386641227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec0ca610 0x7f84ec0cddd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009d90 tx=0x7f84e402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40778530cbb59a3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.876+0000 7f84f157c640 1 -- 172.21.15.52:0/3386641227 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4007740 con 0x7f84ec0ca610 2024-04-25T13:16:36.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.876+0000 7f84f157c640 1 -- 172.21.15.52:0/3386641227 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e40078e0 con 0x7f84ec0ca610 2024-04-25T13:16:36.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.876+0000 7f84f157c640 1 -- 172.21.15.52:0/3386641227 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4007cb0 con 0x7f84ec0ca610 2024-04-25T13:16:36.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.876+0000 7f84f47e2640 1 -- 172.21.15.52:0/3386641227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec0ca610 msgr2=0x7f84ec0cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.876+0000 7f84f47e2640 1 --2- 172.21.15.52:0/3386641227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec0ca610 0x7f84ec0cddd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009d90 tx=0x7f84e402a6a0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.876+0000 7f84f47e2640 1 -- 172.21.15.52:0/3386641227 shutdown_connections 2024-04-25T13:16:36.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.876+0000 7f84f47e2640 1 --2- 172.21.15.52:0/3386641227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec0ca610 0x7f84ec0cddd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.876+0000 7f84f47e2640 1 --2- 172.21.15.52:0/3386641227 >> v2:172.21.15.102:3300/0 conn(0x7f84ec151e70 0x7f84ec0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.876+0000 7f84f47e2640 1 -- 172.21.15.52:0/3386641227 >> 172.21.15.52:0/3386641227 conn(0x7f84ec06b920 msgr2=0x7f84ec06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:36.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.877+0000 7f84f47e2640 1 -- 172.21.15.52:0/3386641227 shutdown_connections 2024-04-25T13:16:36.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.877+0000 7f84f47e2640 1 -- 172.21.15.52:0/3386641227 wait complete. 2024-04-25T13:16:36.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.878+0000 7f84f47e2640 1 Processor -- start 2024-04-25T13:16:36.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.878+0000 7f84f47e2640 1 -- start start 2024-04-25T13:16:36.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.878+0000 7f84f47e2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84ec0c88f0 0x7f84ec147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.878+0000 7f84f47e2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84ec0ca610 0x7f84ec15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.878+0000 7f84f47e2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec151e70 0x7f84ec074d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.878+0000 7f84f47e2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec152250 con 0x7f84ec151e70 2024-04-25T13:16:36.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.878+0000 7f84f47e2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec158920 con 0x7f84ec0c88f0 2024-04-25T13:16:36.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.878+0000 7f84f47e2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f84ec1523d0 con 0x7f84ec0ca610 2024-04-25T13:16:36.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.878+0000 7f84f2d7f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec151e70 0x7f84ec074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.878+0000 7f84f2d7f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec151e70 0x7f84ec074d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49752/0 (socket says 172.21.15.52:49752) 2024-04-25T13:16:36.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84f2d7f640 1 -- 172.21.15.52:0/948060530 learned_addr learned my addr 172.21.15.52:0/948060530 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:36.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84f1d7d640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84ec0ca610 0x7f84ec15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84f257e640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84ec0c88f0 0x7f84ec147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84f2d7f640 1 -- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84ec0ca610 msgr2=0x7f84ec15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84f2d7f640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84ec0ca610 0x7f84ec15a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84f2d7f640 1 -- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84ec0c88f0 msgr2=0x7f84ec147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84f2d7f640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84ec0c88f0 0x7f84ec147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84f2d7f640 1 -- 172.21.15.52:0/948060530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ec159040 con 0x7f84ec151e70 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84f257e640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84ec0c88f0 0x7f84ec147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84f2d7f640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec151e70 0x7f84ec074d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009eb0 tx=0x7f84e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84e2ffd640 1 -- 172.21.15.52:0/948060530 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4040070 con 0x7f84ec151e70 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84e2ffd640 1 -- 172.21.15.52:0/948060530 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e4031bc0 con 0x7f84ec151e70 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84e2ffd640 1 -- 172.21.15.52:0/948060530 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4045460 con 0x7f84ec151e70 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84f47e2640 1 -- 172.21.15.52:0/948060530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ec159690 con 0x7f84ec151e70 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.879+0000 7f84f47e2640 1 -- 172.21.15.52:0/948060530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ec072f70 con 0x7f84ec151e70 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.880+0000 7f84f47e2640 1 -- 172.21.15.52:0/948060530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84ec1560c0 con 0x7f84ec151e70 2024-04-25T13:16:36.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.881+0000 7f84e2ffd640 1 -- 172.21.15.52:0/948060530 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84e4039040 con 0x7f84ec151e70 2024-04-25T13:16:36.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.881+0000 7f84e2ffd640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f84d006c8f0 0x7f84d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.881+0000 7f84e2ffd640 1 -- 172.21.15.52:0/948060530 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f84e40ad870 con 0x7f84ec151e70 2024-04-25T13:16:36.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.881+0000 7f84f257e640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f84d006c8f0 0x7f84d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.882+0000 7f84f257e640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f84d006c8f0 0x7f84d006edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f84e8006fd0 tx=0x7f84e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:36.886+0000 7f84e2ffd640 1 -- 172.21.15.52:0/948060530 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f84ec1560c0 con 0x7f84ec151e70 2024-04-25T13:16:37.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.065+0000 7f84f47e2640 1 -- 172.21.15.52:0/948060530 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84ec158df0 con 0x7f84d006c8f0 2024-04-25T13:16:37.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.074+0000 7f84e2ffd640 1 -- 172.21.15.52:0/948060530 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f84ec158df0 con 0x7f84d006c8f0 2024-04-25T13:16:37.078 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:37.080 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T13:16:37.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.078+0000 7f84f47e2640 1 -- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f84d006c8f0 msgr2=0x7f84d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.078+0000 7f84f47e2640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f84d006c8f0 0x7f84d006edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f84e8006fd0 tx=0x7f84e8008040 comp rx=0 tx=0).stop 2024-04-25T13:16:37.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.078+0000 7f84f47e2640 1 -- 172.21.15.52:0/948060530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec151e70 msgr2=0x7f84ec074d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.078+0000 7f84f47e2640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec151e70 0x7f84ec074d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009eb0 tx=0x7f84e4004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:37.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.078+0000 7f84f47e2640 1 -- 172.21.15.52:0/948060530 shutdown_connections 2024-04-25T13:16:37.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.078+0000 7f84f47e2640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f84d006c8f0 0x7f84d006edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.078+0000 7f84f47e2640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84ec0ca610 0x7f84ec15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.078+0000 7f84f47e2640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec151e70 0x7f84ec074d50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.078+0000 7f84f47e2640 1 --2- 172.21.15.52:0/948060530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84ec0c88f0 0x7f84ec147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.078+0000 7f84f47e2640 1 -- 172.21.15.52:0/948060530 >> 172.21.15.52:0/948060530 conn(0x7f84ec06b920 msgr2=0x7f84ec1559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.078+0000 7f84f47e2640 1 -- 172.21.15.52:0/948060530 shutdown_connections 2024-04-25T13:16:37.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.078+0000 7f84f47e2640 1 -- 172.21.15.52:0/948060530 wait complete. 2024-04-25T13:16:37.089 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-25T13:16:35.825095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236124,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738596,"statfs":{"total":773094113280,"available":772852322304,"internally_reserved":0,"allocated":3383296,"data_stored":2049160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002688"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090521+0000","last_change":"2024-04-25T13:16:07.001071+0000","last_active":"2024-04-25T13:16:14.090521+0000","last_peered":"2024-04-25T13:16:14.090521+0000","last_clean":"2024-04-25T13:16:14.090521+0000","last_became_active":"2024-04-25T13:16:07.000746+0000","last_became_peered":"2024-04-25T13:16:07.000746+0000","last_unstale":"2024-04-25T13:16:14.090521+0000","last_undegraded":"2024-04-25T13:16:14.090521+0000","last_fullsized":"2024-04-25T13:16:14.090521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:36.289103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025658+0000","last_change":"2024-04-25T13:16:08.012928+0000","last_active":"2024-04-25T13:16:14.025658+0000","last_peered":"2024-04-25T13:16:14.025658+0000","last_clean":"2024-04-25T13:16:14.025658+0000","last_became_active":"2024-04-25T13:16:08.012114+0000","last_became_peered":"2024-04-25T13:16:08.012114+0000","last_unstale":"2024-04-25T13:16:14.025658+0000","last_undegraded":"2024-04-25T13:16:14.025658+0000","last_fullsized":"2024-04-25T13:16:14.025658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:01.077922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025013+0000","last_change":"2024-04-25T13:16:12.734829+0000","last_active":"2024-04-25T13:16:14.025013+0000","last_peered":"2024-04-25T13:16:14.025013+0000","last_clean":"2024-04-25T13:16:14.025013+0000","last_became_active":"2024-04-25T13:16:12.734390+0000","last_became_peered":"2024-04-25T13:16:12.734390+0000","last_unstale":"2024-04-25T13:16:14.025013+0000","last_undegraded":"2024-04-25T13:16:14.025013+0000","last_fullsized":"2024-04-25T13:16:14.025013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:33.941883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025802+0000","last_change":"2024-04-25T13:16:06.999440+0000","last_active":"2024-04-25T13:16:14.025802+0000","last_peered":"2024-04-25T13:16:14.025802+0000","last_clean":"2024-04-25T13:16:14.025802+0000","last_became_active":"2024-04-25T13:16:06.999078+0000","last_became_peered":"2024-04-25T13:16:06.999078+0000","last_unstale":"2024-04-25T13:16:14.025802+0000","last_undegraded":"2024-04-25T13:16:14.025802+0000","last_fullsized":"2024-04-25T13:16:14.025802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.819349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090243+0000","last_change":"2024-04-25T13:16:08.012743+0000","last_active":"2024-04-25T13:16:14.090243+0000","last_peered":"2024-04-25T13:16:14.090243+0000","last_clean":"2024-04-25T13:16:14.090243+0000","last_became_active":"2024-04-25T13:16:08.012036+0000","last_became_peered":"2024-04-25T13:16:08.012036+0000","last_unstale":"2024-04-25T13:16:14.090243+0000","last_undegraded":"2024-04-25T13:16:14.090243+0000","last_fullsized":"2024-04-25T13:16:14.090243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.959146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091482+0000","last_change":"2024-04-25T13:16:12.038266+0000","last_active":"2024-04-25T13:16:14.091482+0000","last_peered":"2024-04-25T13:16:14.091482+0000","last_clean":"2024-04-25T13:16:14.091482+0000","last_became_active":"2024-04-25T13:16:12.037796+0000","last_became_peered":"2024-04-25T13:16:12.037796+0000","last_unstale":"2024-04-25T13:16:14.091482+0000","last_undegraded":"2024-04-25T13:16:14.091482+0000","last_fullsized":"2024-04-25T13:16:14.091482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:44.953964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092596+0000","last_change":"2024-04-25T13:16:07.001022+0000","last_active":"2024-04-25T13:16:14.092596+0000","last_peered":"2024-04-25T13:16:14.092596+0000","last_clean":"2024-04-25T13:16:14.092596+0000","last_became_active":"2024-04-25T13:16:07.000751+0000","last_became_peered":"2024-04-25T13:16:07.000751+0000","last_unstale":"2024-04-25T13:16:14.092596+0000","last_undegraded":"2024-04-25T13:16:14.092596+0000","last_fullsized":"2024-04-25T13:16:14.092596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:11.597397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025512+0000","last_change":"2024-04-25T13:16:08.011361+0000","last_active":"2024-04-25T13:16:14.025512+0000","last_peered":"2024-04-25T13:16:14.025512+0000","last_clean":"2024-04-25T13:16:14.025512+0000","last_became_active":"2024-04-25T13:16:08.011073+0000","last_became_peered":"2024-04-25T13:16:08.011073+0000","last_unstale":"2024-04-25T13:16:14.025512+0000","last_undegraded":"2024-04-25T13:16:14.025512+0000","last_fullsized":"2024-04-25T13:16:14.025512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:00.471410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091957+0000","last_change":"2024-04-25T13:16:12.043732+0000","last_active":"2024-04-25T13:16:14.091957+0000","last_peered":"2024-04-25T13:16:14.091957+0000","last_clean":"2024-04-25T13:16:14.091957+0000","last_became_active":"2024-04-25T13:16:12.043264+0000","last_became_peered":"2024-04-25T13:16:12.043264+0000","last_unstale":"2024-04-25T13:16:14.091957+0000","last_undegraded":"2024-04-25T13:16:14.091957+0000","last_fullsized":"2024-04-25T13:16:14.091957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:39.974518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092358+0000","last_change":"2024-04-25T13:16:07.003774+0000","last_active":"2024-04-25T13:16:14.092358+0000","last_peered":"2024-04-25T13:16:14.092358+0000","last_clean":"2024-04-25T13:16:14.092358+0000","last_became_active":"2024-04-25T13:16:07.003493+0000","last_became_peered":"2024-04-25T13:16:07.003493+0000","last_unstale":"2024-04-25T13:16:14.092358+0000","last_undegraded":"2024-04-25T13:16:14.092358+0000","last_fullsized":"2024-04-25T13:16:14.092358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:12.940812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025735+0000","last_change":"2024-04-25T13:16:08.012084+0000","last_active":"2024-04-25T13:16:14.025735+0000","last_peered":"2024-04-25T13:16:14.025735+0000","last_clean":"2024-04-25T13:16:14.025735+0000","last_became_active":"2024-04-25T13:16:08.011634+0000","last_became_peered":"2024-04-25T13:16:08.011634+0000","last_unstale":"2024-04-25T13:16:14.025735+0000","last_undegraded":"2024-04-25T13:16:14.025735+0000","last_fullsized":"2024-04-25T13:16:14.025735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:26.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091223+0000","last_change":"2024-04-25T13:16:12.039238+0000","last_active":"2024-04-25T13:16:14.091223+0000","last_peered":"2024-04-25T13:16:14.091223+0000","last_clean":"2024-04-25T13:16:14.091223+0000","last_became_active":"2024-04-25T13:16:12.038508+0000","last_became_peered":"2024-04-25T13:16:12.038508+0000","last_unstale":"2024-04-25T13:16:14.091223+0000","last_undegraded":"2024-04-25T13:16:14.091223+0000","last_fullsized":"2024-04-25T13:16:14.091223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:22.183373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090787+0000","last_change":"2024-04-25T13:16:08.007741+0000","last_active":"2024-04-25T13:16:14.090787+0000","last_peered":"2024-04-25T13:16:14.090787+0000","last_clean":"2024-04-25T13:16:14.090787+0000","last_became_active":"2024-04-25T13:16:08.007478+0000","last_became_peered":"2024-04-25T13:16:08.007478+0000","last_unstale":"2024-04-25T13:16:14.090787+0000","last_undegraded":"2024-04-25T13:16:14.090787+0000","last_fullsized":"2024-04-25T13:16:14.090787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:49.162203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091567+0000","last_change":"2024-04-25T13:16:07.001183+0000","last_active":"2024-04-25T13:16:14.091567+0000","last_peered":"2024-04-25T13:16:14.091567+0000","last_clean":"2024-04-25T13:16:14.091567+0000","last_became_active":"2024-04-25T13:16:07.000880+0000","last_became_peered":"2024-04-25T13:16:07.000880+0000","last_unstale":"2024-04-25T13:16:14.091567+0000","last_undegraded":"2024-04-25T13:16:14.091567+0000","last_fullsized":"2024-04-25T13:16:14.091567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.250349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091408+0000","last_change":"2024-04-25T13:16:12.037074+0000","last_active":"2024-04-25T13:16:14.091408+0000","last_peered":"2024-04-25T13:16:14.091408+0000","last_clean":"2024-04-25T13:16:14.091408+0000","last_became_active":"2024-04-25T13:16:12.036508+0000","last_became_peered":"2024-04-25T13:16:12.036508+0000","last_unstale":"2024-04-25T13:16:14.091408+0000","last_undegraded":"2024-04-25T13:16:14.091408+0000","last_fullsized":"2024-04-25T13:16:14.091408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:01.380469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025437+0000","last_change":"2024-04-25T13:16:08.013538+0000","last_active":"2024-04-25T13:16:14.025437+0000","last_peered":"2024-04-25T13:16:14.025437+0000","last_clean":"2024-04-25T13:16:14.025437+0000","last_became_active":"2024-04-25T13:16:08.013269+0000","last_became_peered":"2024-04-25T13:16:08.013269+0000","last_unstale":"2024-04-25T13:16:14.025437+0000","last_undegraded":"2024-04-25T13:16:14.025437+0000","last_fullsized":"2024-04-25T13:16:14.025437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:05.313768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022116+0000","last_change":"2024-04-25T13:16:06.994106+0000","last_active":"2024-04-25T13:16:14.022116+0000","last_peered":"2024-04-25T13:16:14.022116+0000","last_clean":"2024-04-25T13:16:14.022116+0000","last_became_active":"2024-04-25T13:16:06.993807+0000","last_became_peered":"2024-04-25T13:16:06.993807+0000","last_unstale":"2024-04-25T13:16:14.022116+0000","last_undegraded":"2024-04-25T13:16:14.022116+0000","last_fullsized":"2024-04-25T13:16:14.022116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:53.706175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091111+0000","last_change":"2024-04-25T13:16:12.039421+0000","last_active":"2024-04-25T13:16:14.091111+0000","last_peered":"2024-04-25T13:16:14.091111+0000","last_clean":"2024-04-25T13:16:14.091111+0000","last_became_active":"2024-04-25T13:16:12.038953+0000","last_became_peered":"2024-04-25T13:16:12.038953+0000","last_unstale":"2024-04-25T13:16:14.091111+0000","last_undegraded":"2024-04-25T13:16:14.091111+0000","last_fullsized":"2024-04-25T13:16:14.091111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:26.714224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025194+0000","last_change":"2024-04-25T13:16:08.008978+0000","last_active":"2024-04-25T13:16:14.025194+0000","last_peered":"2024-04-25T13:16:14.025194+0000","last_clean":"2024-04-25T13:16:14.025194+0000","last_became_active":"2024-04-25T13:16:08.008446+0000","last_became_peered":"2024-04-25T13:16:08.008446+0000","last_unstale":"2024-04-25T13:16:14.025194+0000","last_undegraded":"2024-04-25T13:16:14.025194+0000","last_fullsized":"2024-04-25T13:16:14.025194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:34.604344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021762+0000","last_change":"2024-04-25T13:16:06.992902+0000","last_active":"2024-04-25T13:16:14.021762+0000","last_peered":"2024-04-25T13:16:14.021762+0000","last_clean":"2024-04-25T13:16:14.021762+0000","last_became_active":"2024-04-25T13:16:06.992593+0000","last_became_peered":"2024-04-25T13:16:06.992593+0000","last_unstale":"2024-04-25T13:16:14.021762+0000","last_undegraded":"2024-04-25T13:16:14.021762+0000","last_fullsized":"2024-04-25T13:16:14.021762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:57.665455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022580+0000","last_change":"2024-04-25T13:16:12.735412+0000","last_active":"2024-04-25T13:16:14.022580+0000","last_peered":"2024-04-25T13:16:14.022580+0000","last_clean":"2024-04-25T13:16:14.022580+0000","last_became_active":"2024-04-25T13:16:12.733485+0000","last_became_peered":"2024-04-25T13:16:12.733485+0000","last_unstale":"2024-04-25T13:16:14.022580+0000","last_undegraded":"2024-04-25T13:16:14.022580+0000","last_fullsized":"2024-04-25T13:16:14.022580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:25.265696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092136+0000","last_change":"2024-04-25T13:16:07.998941+0000","last_active":"2024-04-25T13:16:14.092136+0000","last_peered":"2024-04-25T13:16:14.092136+0000","last_clean":"2024-04-25T13:16:14.092136+0000","last_became_active":"2024-04-25T13:16:07.998658+0000","last_became_peered":"2024-04-25T13:16:07.998658+0000","last_unstale":"2024-04-25T13:16:14.092136+0000","last_undegraded":"2024-04-25T13:16:14.092136+0000","last_fullsized":"2024-04-25T13:16:14.092136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:45.473269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090361+0000","last_change":"2024-04-25T13:16:07.001542+0000","last_active":"2024-04-25T13:16:14.090361+0000","last_peered":"2024-04-25T13:16:14.090361+0000","last_clean":"2024-04-25T13:16:14.090361+0000","last_became_active":"2024-04-25T13:16:07.000846+0000","last_became_peered":"2024-04-25T13:16:07.000846+0000","last_unstale":"2024-04-25T13:16:14.090361+0000","last_undegraded":"2024-04-25T13:16:14.090361+0000","last_fullsized":"2024-04-25T13:16:14.090361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:41.121978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091648+0000","last_change":"2024-04-25T13:16:12.038493+0000","last_active":"2024-04-25T13:16:14.091648+0000","last_peered":"2024-04-25T13:16:14.091648+0000","last_clean":"2024-04-25T13:16:14.091648+0000","last_became_active":"2024-04-25T13:16:12.038032+0000","last_became_peered":"2024-04-25T13:16:12.038032+0000","last_unstale":"2024-04-25T13:16:14.091648+0000","last_undegraded":"2024-04-25T13:16:14.091648+0000","last_fullsized":"2024-04-25T13:16:14.091648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:40.222480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090898+0000","last_change":"2024-04-25T13:16:07.998444+0000","last_active":"2024-04-25T13:16:14.090898+0000","last_peered":"2024-04-25T13:16:14.090898+0000","last_clean":"2024-04-25T13:16:14.090898+0000","last_became_active":"2024-04-25T13:16:07.998037+0000","last_became_peered":"2024-04-25T13:16:07.998037+0000","last_unstale":"2024-04-25T13:16:14.090898+0000","last_undegraded":"2024-04-25T13:16:14.090898+0000","last_fullsized":"2024-04-25T13:16:14.090898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:35.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091994+0000","last_change":"2024-04-25T13:16:06.995706+0000","last_active":"2024-04-25T13:16:14.091994+0000","last_peered":"2024-04-25T13:16:14.091994+0000","last_clean":"2024-04-25T13:16:14.091994+0000","last_became_active":"2024-04-25T13:16:06.995420+0000","last_became_peered":"2024-04-25T13:16:06.995420+0000","last_unstale":"2024-04-25T13:16:14.091994+0000","last_undegraded":"2024-04-25T13:16:14.091994+0000","last_fullsized":"2024-04-25T13:16:14.091994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:08.672949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091752+0000","last_change":"2024-04-25T13:16:12.734165+0000","last_active":"2024-04-25T13:16:14.091752+0000","last_peered":"2024-04-25T13:16:14.091752+0000","last_clean":"2024-04-25T13:16:14.091752+0000","last_became_active":"2024-04-25T13:16:12.733772+0000","last_became_peered":"2024-04-25T13:16:12.733772+0000","last_unstale":"2024-04-25T13:16:14.091752+0000","last_undegraded":"2024-04-25T13:16:14.091752+0000","last_fullsized":"2024-04-25T13:16:14.091752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:35.716517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025960+0000","last_change":"2024-04-25T13:16:08.017429+0000","last_active":"2024-04-25T13:16:14.025960+0000","last_peered":"2024-04-25T13:16:14.025960+0000","last_clean":"2024-04-25T13:16:14.025960+0000","last_became_active":"2024-04-25T13:16:08.017205+0000","last_became_peered":"2024-04-25T13:16:08.017205+0000","last_unstale":"2024-04-25T13:16:14.025960+0000","last_undegraded":"2024-04-25T13:16:14.025960+0000","last_fullsized":"2024-04-25T13:16:14.025960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.383669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022539+0000","last_change":"2024-04-25T13:16:06.992063+0000","last_active":"2024-04-25T13:16:14.022539+0000","last_peered":"2024-04-25T13:16:14.022539+0000","last_clean":"2024-04-25T13:16:14.022539+0000","last_became_active":"2024-04-25T13:16:06.991766+0000","last_became_peered":"2024-04-25T13:16:06.991766+0000","last_unstale":"2024-04-25T13:16:14.022539+0000","last_undegraded":"2024-04-25T13:16:14.022539+0000","last_fullsized":"2024-04-25T13:16:14.022539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:25.728063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.024950+0000","last_change":"2024-04-25T13:16:12.734837+0000","last_active":"2024-04-25T13:16:14.024950+0000","last_peered":"2024-04-25T13:16:14.024950+0000","last_clean":"2024-04-25T13:16:14.024950+0000","last_became_active":"2024-04-25T13:16:12.734394+0000","last_became_peered":"2024-04-25T13:16:12.734394+0000","last_unstale":"2024-04-25T13:16:14.024950+0000","last_undegraded":"2024-04-25T13:16:14.024950+0000","last_fullsized":"2024-04-25T13:16:14.024950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:24.740929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022045+0000","last_change":"2024-04-25T13:16:08.000277+0000","last_active":"2024-04-25T13:16:14.022045+0000","last_peered":"2024-04-25T13:16:14.022045+0000","last_clean":"2024-04-25T13:16:14.022045+0000","last_became_active":"2024-04-25T13:16:07.999797+0000","last_became_peered":"2024-04-25T13:16:07.999797+0000","last_unstale":"2024-04-25T13:16:14.022045+0000","last_undegraded":"2024-04-25T13:16:14.022045+0000","last_fullsized":"2024-04-25T13:16:14.022045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:08.860755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092740+0000","last_change":"2024-04-25T13:16:07.002146+0000","last_active":"2024-04-25T13:16:14.092740+0000","last_peered":"2024-04-25T13:16:14.092740+0000","last_clean":"2024-04-25T13:16:14.092740+0000","last_became_active":"2024-04-25T13:16:07.001918+0000","last_became_peered":"2024-04-25T13:16:07.001918+0000","last_unstale":"2024-04-25T13:16:14.092740+0000","last_undegraded":"2024-04-25T13:16:14.092740+0000","last_fullsized":"2024-04-25T13:16:14.092740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:38.326719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090806+0000","last_change":"2024-04-25T13:16:12.733744+0000","last_active":"2024-04-25T13:16:14.090806+0000","last_peered":"2024-04-25T13:16:14.090806+0000","last_clean":"2024-04-25T13:16:14.090806+0000","last_became_active":"2024-04-25T13:16:12.733361+0000","last_became_peered":"2024-04-25T13:16:12.733361+0000","last_unstale":"2024-04-25T13:16:14.090806+0000","last_undegraded":"2024-04-25T13:16:14.090806+0000","last_fullsized":"2024-04-25T13:16:14.090806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:39.178837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025844+0000","last_change":"2024-04-25T13:16:08.016667+0000","last_active":"2024-04-25T13:16:14.025844+0000","last_peered":"2024-04-25T13:16:14.025844+0000","last_clean":"2024-04-25T13:16:14.025844+0000","last_became_active":"2024-04-25T13:16:08.015172+0000","last_became_peered":"2024-04-25T13:16:08.015172+0000","last_unstale":"2024-04-25T13:16:14.025844+0000","last_undegraded":"2024-04-25T13:16:14.025844+0000","last_fullsized":"2024-04-25T13:16:14.025844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:40.786954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022161+0000","last_change":"2024-04-25T13:16:06.996301+0000","last_active":"2024-04-25T13:16:14.022161+0000","last_peered":"2024-04-25T13:16:14.022161+0000","last_clean":"2024-04-25T13:16:14.022161+0000","last_became_active":"2024-04-25T13:16:06.995957+0000","last_became_peered":"2024-04-25T13:16:06.995957+0000","last_unstale":"2024-04-25T13:16:14.022161+0000","last_undegraded":"2024-04-25T13:16:14.022161+0000","last_fullsized":"2024-04-25T13:16:14.022161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:16.802775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021893+0000","last_change":"2024-04-25T13:16:12.040987+0000","last_active":"2024-04-25T13:16:14.021893+0000","last_peered":"2024-04-25T13:16:14.021893+0000","last_clean":"2024-04-25T13:16:14.021893+0000","last_became_active":"2024-04-25T13:16:12.039987+0000","last_became_peered":"2024-04-25T13:16:12.039987+0000","last_unstale":"2024-04-25T13:16:14.021893+0000","last_undegraded":"2024-04-25T13:16:14.021893+0000","last_fullsized":"2024-04-25T13:16:14.021893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:40.366718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092137+0000","last_change":"2024-04-25T13:16:08.002876+0000","last_active":"2024-04-25T13:16:14.092137+0000","last_peered":"2024-04-25T13:16:14.092137+0000","last_clean":"2024-04-25T13:16:14.092137+0000","last_became_active":"2024-04-25T13:16:08.002131+0000","last_became_peered":"2024-04-25T13:16:08.002131+0000","last_unstale":"2024-04-25T13:16:14.092137+0000","last_undegraded":"2024-04-25T13:16:14.092137+0000","last_fullsized":"2024-04-25T13:16:14.092137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:09.646849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.026081+0000","last_change":"2024-04-25T13:16:06.990075+0000","last_active":"2024-04-25T13:16:14.026081+0000","last_peered":"2024-04-25T13:16:14.026081+0000","last_clean":"2024-04-25T13:16:14.026081+0000","last_became_active":"2024-04-25T13:16:06.989652+0000","last_became_peered":"2024-04-25T13:16:06.989652+0000","last_unstale":"2024-04-25T13:16:14.026081+0000","last_undegraded":"2024-04-25T13:16:14.026081+0000","last_fullsized":"2024-04-25T13:16:14.026081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:29.378995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022100+0000","last_change":"2024-04-25T13:16:12.032906+0000","last_active":"2024-04-25T13:16:14.022100+0000","last_peered":"2024-04-25T13:16:14.022100+0000","last_clean":"2024-04-25T13:16:14.022100+0000","last_became_active":"2024-04-25T13:16:12.032184+0000","last_became_peered":"2024-04-25T13:16:12.032184+0000","last_unstale":"2024-04-25T13:16:14.022100+0000","last_undegraded":"2024-04-25T13:16:14.022100+0000","last_fullsized":"2024-04-25T13:16:14.022100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.724927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021878+0000","last_change":"2024-04-25T13:16:07.997173+0000","last_active":"2024-04-25T13:16:14.021878+0000","last_peered":"2024-04-25T13:16:14.021878+0000","last_clean":"2024-04-25T13:16:14.021878+0000","last_became_active":"2024-04-25T13:16:07.996545+0000","last_became_peered":"2024-04-25T13:16:07.996545+0000","last_unstale":"2024-04-25T13:16:14.021878+0000","last_undegraded":"2024-04-25T13:16:14.021878+0000","last_fullsized":"2024-04-25T13:16:14.021878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:28.902563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089861+0000","last_change":"2024-04-25T13:16:06.993674+0000","last_active":"2024-04-25T13:16:14.089861+0000","last_peered":"2024-04-25T13:16:14.089861+0000","last_clean":"2024-04-25T13:16:14.089861+0000","last_became_active":"2024-04-25T13:16:06.993387+0000","last_became_peered":"2024-04-25T13:16:06.993387+0000","last_unstale":"2024-04-25T13:16:14.089861+0000","last_undegraded":"2024-04-25T13:16:14.089861+0000","last_fullsized":"2024-04-25T13:16:14.089861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:13.104822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022616+0000","last_change":"2024-04-25T13:16:12.037015+0000","last_active":"2024-04-25T13:16:14.022616+0000","last_peered":"2024-04-25T13:16:14.022616+0000","last_clean":"2024-04-25T13:16:14.022616+0000","last_became_active":"2024-04-25T13:16:12.036634+0000","last_became_peered":"2024-04-25T13:16:12.036634+0000","last_unstale":"2024-04-25T13:16:14.022616+0000","last_undegraded":"2024-04-25T13:16:14.022616+0000","last_fullsized":"2024-04-25T13:16:14.022616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:12.986396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090465+0000","last_change":"2024-04-25T13:16:08.004209+0000","last_active":"2024-04-25T13:16:14.090465+0000","last_peered":"2024-04-25T13:16:14.090465+0000","last_clean":"2024-04-25T13:16:14.090465+0000","last_became_active":"2024-04-25T13:16:08.003908+0000","last_became_peered":"2024-04-25T13:16:08.003908+0000","last_unstale":"2024-04-25T13:16:14.090465+0000","last_undegraded":"2024-04-25T13:16:14.090465+0000","last_fullsized":"2024-04-25T13:16:14.090465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:17.027888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090460+0000","last_change":"2024-04-25T13:16:06.999384+0000","last_active":"2024-04-25T13:16:14.090460+0000","last_peered":"2024-04-25T13:16:14.090460+0000","last_clean":"2024-04-25T13:16:14.090460+0000","last_became_active":"2024-04-25T13:16:06.999126+0000","last_became_peered":"2024-04-25T13:16:06.999126+0000","last_unstale":"2024-04-25T13:16:14.090460+0000","last_undegraded":"2024-04-25T13:16:14.090460+0000","last_fullsized":"2024-04-25T13:16:14.090460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:50.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090826+0000","last_change":"2024-04-25T13:16:12.733992+0000","last_active":"2024-04-25T13:16:14.090826+0000","last_peered":"2024-04-25T13:16:14.090826+0000","last_clean":"2024-04-25T13:16:14.090826+0000","last_became_active":"2024-04-25T13:16:12.733316+0000","last_became_peered":"2024-04-25T13:16:12.733316+0000","last_unstale":"2024-04-25T13:16:14.090826+0000","last_undegraded":"2024-04-25T13:16:14.090826+0000","last_fullsized":"2024-04-25T13:16:14.090826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:54.246728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025262+0000","last_change":"2024-04-25T13:16:08.021617+0000","last_active":"2024-04-25T13:16:14.025262+0000","last_peered":"2024-04-25T13:16:14.025262+0000","last_clean":"2024-04-25T13:16:14.025262+0000","last_became_active":"2024-04-25T13:16:08.021346+0000","last_became_peered":"2024-04-25T13:16:08.021346+0000","last_unstale":"2024-04-25T13:16:14.025262+0000","last_undegraded":"2024-04-25T13:16:14.025262+0000","last_fullsized":"2024-04-25T13:16:14.025262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:10.013805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025437+0000","last_change":"2024-04-25T13:16:06.990638+0000","last_active":"2024-04-25T13:16:14.025437+0000","last_peered":"2024-04-25T13:16:14.025437+0000","last_clean":"2024-04-25T13:16:14.025437+0000","last_became_active":"2024-04-25T13:16:06.990379+0000","last_became_peered":"2024-04-25T13:16:06.990379+0000","last_unstale":"2024-04-25T13:16:14.025437+0000","last_undegraded":"2024-04-25T13:16:14.025437+0000","last_fullsized":"2024-04-25T13:16:14.025437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:39.385990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090466+0000","last_change":"2024-04-25T13:15:57.168598+0000","last_active":"2024-04-25T13:16:14.090466+0000","last_peered":"2024-04-25T13:16:14.090466+0000","last_clean":"2024-04-25T13:16:14.090466+0000","last_became_active":"2024-04-25T13:15:57.167692+0000","last_became_peered":"2024-04-25T13:15:57.167692+0000","last_unstale":"2024-04-25T13:16:14.090466+0000","last_undegraded":"2024-04-25T13:16:14.090466+0000","last_fullsized":"2024-04-25T13:16:14.090466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_clean_scrub_stamp":"2024-04-25T13:15:55.844647+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:29.123100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091126+0000","last_change":"2024-04-25T13:16:12.734712+0000","last_active":"2024-04-25T13:16:14.091126+0000","last_peered":"2024-04-25T13:16:14.091126+0000","last_clean":"2024-04-25T13:16:14.091126+0000","last_became_active":"2024-04-25T13:16:12.734288+0000","last_became_peered":"2024-04-25T13:16:12.734288+0000","last_unstale":"2024-04-25T13:16:14.091126+0000","last_undegraded":"2024-04-25T13:16:14.091126+0000","last_fullsized":"2024-04-25T13:16:14.091126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:45.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092489+0000","last_change":"2024-04-25T13:16:08.014279+0000","last_active":"2024-04-25T13:16:14.092489+0000","last_peered":"2024-04-25T13:16:14.092489+0000","last_clean":"2024-04-25T13:16:14.092489+0000","last_became_active":"2024-04-25T13:16:08.013989+0000","last_became_peered":"2024-04-25T13:16:08.013989+0000","last_unstale":"2024-04-25T13:16:14.092489+0000","last_undegraded":"2024-04-25T13:16:14.092489+0000","last_fullsized":"2024-04-25T13:16:14.092489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:54.411981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090165+0000","last_change":"2024-04-25T13:16:06.996774+0000","last_active":"2024-04-25T13:16:14.090165+0000","last_peered":"2024-04-25T13:16:14.090165+0000","last_clean":"2024-04-25T13:16:14.090165+0000","last_became_active":"2024-04-25T13:16:06.996251+0000","last_became_peered":"2024-04-25T13:16:06.996251+0000","last_unstale":"2024-04-25T13:16:14.090165+0000","last_undegraded":"2024-04-25T13:16:14.090165+0000","last_fullsized":"2024-04-25T13:16:14.090165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:01.815602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090885+0000","last_change":"2024-04-25T13:16:12.733562+0000","last_active":"2024-04-25T13:16:14.090885+0000","last_peered":"2024-04-25T13:16:14.090885+0000","last_clean":"2024-04-25T13:16:14.090885+0000","last_became_active":"2024-04-25T13:16:12.733114+0000","last_became_peered":"2024-04-25T13:16:12.733114+0000","last_unstale":"2024-04-25T13:16:14.090885+0000","last_undegraded":"2024-04-25T13:16:14.090885+0000","last_fullsized":"2024-04-25T13:16:14.090885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:20.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025577+0000","last_change":"2024-04-25T13:16:08.011389+0000","last_active":"2024-04-25T13:16:14.025577+0000","last_peered":"2024-04-25T13:16:14.025577+0000","last_clean":"2024-04-25T13:16:14.025577+0000","last_became_active":"2024-04-25T13:16:08.011113+0000","last_became_peered":"2024-04-25T13:16:08.011113+0000","last_unstale":"2024-04-25T13:16:14.025577+0000","last_undegraded":"2024-04-25T13:16:14.025577+0000","last_fullsized":"2024-04-25T13:16:14.025577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:12.339487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022376+0000","last_change":"2024-04-25T13:16:06.988988+0000","last_active":"2024-04-25T13:16:14.022376+0000","last_peered":"2024-04-25T13:16:14.022376+0000","last_clean":"2024-04-25T13:16:14.022376+0000","last_became_active":"2024-04-25T13:16:06.988631+0000","last_became_peered":"2024-04-25T13:16:06.988631+0000","last_unstale":"2024-04-25T13:16:14.022376+0000","last_undegraded":"2024-04-25T13:16:14.022376+0000","last_fullsized":"2024-04-25T13:16:14.022376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:47.056977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090922+0000","last_change":"2024-04-25T13:16:12.047194+0000","last_active":"2024-04-25T13:16:14.090922+0000","last_peered":"2024-04-25T13:16:14.090922+0000","last_clean":"2024-04-25T13:16:14.090922+0000","last_became_active":"2024-04-25T13:16:12.046780+0000","last_became_peered":"2024-04-25T13:16:12.046780+0000","last_unstale":"2024-04-25T13:16:14.090922+0000","last_undegraded":"2024-04-25T13:16:14.090922+0000","last_fullsized":"2024-04-25T13:16:14.090922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:41.664409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092850+0000","last_change":"2024-04-25T13:16:08.007925+0000","last_active":"2024-04-25T13:16:14.092850+0000","last_peered":"2024-04-25T13:16:14.092850+0000","last_clean":"2024-04-25T13:16:14.092850+0000","last_became_active":"2024-04-25T13:16:08.007681+0000","last_became_peered":"2024-04-25T13:16:08.007681+0000","last_unstale":"2024-04-25T13:16:14.092850+0000","last_undegraded":"2024-04-25T13:16:14.092850+0000","last_fullsized":"2024-04-25T13:16:14.092850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:29.601564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090519+0000","last_change":"2024-04-25T13:16:06.991912+0000","last_active":"2024-04-25T13:16:14.090519+0000","last_peered":"2024-04-25T13:16:14.090519+0000","last_clean":"2024-04-25T13:16:14.090519+0000","last_became_active":"2024-04-25T13:16:06.991578+0000","last_became_peered":"2024-04-25T13:16:06.991578+0000","last_unstale":"2024-04-25T13:16:14.090519+0000","last_undegraded":"2024-04-25T13:16:14.090519+0000","last_fullsized":"2024-04-25T13:16:14.090519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:59.364396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025152+0000","last_change":"2024-04-25T13:16:12.733567+0000","last_active":"2024-04-25T13:16:14.025152+0000","last_peered":"2024-04-25T13:16:14.025152+0000","last_clean":"2024-04-25T13:16:14.025152+0000","last_became_active":"2024-04-25T13:16:12.733136+0000","last_became_peered":"2024-04-25T13:16:12.733136+0000","last_unstale":"2024-04-25T13:16:14.025152+0000","last_undegraded":"2024-04-25T13:16:14.025152+0000","last_fullsized":"2024-04-25T13:16:14.025152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:29.125928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092741+0000","last_change":"2024-04-25T13:16:08.004897+0000","last_active":"2024-04-25T13:16:14.092741+0000","last_peered":"2024-04-25T13:16:14.092741+0000","last_clean":"2024-04-25T13:16:14.092741+0000","last_became_active":"2024-04-25T13:16:08.004180+0000","last_became_peered":"2024-04-25T13:16:08.004180+0000","last_unstale":"2024-04-25T13:16:14.092741+0000","last_undegraded":"2024-04-25T13:16:14.092741+0000","last_fullsized":"2024-04-25T13:16:14.092741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:12.011447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090973+0000","last_change":"2024-04-25T13:16:06.994487+0000","last_active":"2024-04-25T13:16:14.090973+0000","last_peered":"2024-04-25T13:16:14.090973+0000","last_clean":"2024-04-25T13:16:14.090973+0000","last_became_active":"2024-04-25T13:16:06.994235+0000","last_became_peered":"2024-04-25T13:16:06.994235+0000","last_unstale":"2024-04-25T13:16:14.090973+0000","last_undegraded":"2024-04-25T13:16:14.090973+0000","last_fullsized":"2024-04-25T13:16:14.090973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091573+0000","last_change":"2024-04-25T13:16:12.039277+0000","last_active":"2024-04-25T13:16:14.091573+0000","last_peered":"2024-04-25T13:16:14.091573+0000","last_clean":"2024-04-25T13:16:14.091573+0000","last_became_active":"2024-04-25T13:16:12.038534+0000","last_became_peered":"2024-04-25T13:16:12.038534+0000","last_unstale":"2024-04-25T13:16:14.091573+0000","last_undegraded":"2024-04-25T13:16:14.091573+0000","last_fullsized":"2024-04-25T13:16:14.091573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:59.495976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090745+0000","last_change":"2024-04-25T13:16:08.007302+0000","last_active":"2024-04-25T13:16:14.090745+0000","last_peered":"2024-04-25T13:16:14.090745+0000","last_clean":"2024-04-25T13:16:14.090745+0000","last_became_active":"2024-04-25T13:16:08.007050+0000","last_became_peered":"2024-04-25T13:16:08.007050+0000","last_unstale":"2024-04-25T13:16:14.090745+0000","last_undegraded":"2024-04-25T13:16:14.090745+0000","last_fullsized":"2024-04-25T13:16:14.090745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:35.369188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089708+0000","last_change":"2024-04-25T13:16:06.982609+0000","last_active":"2024-04-25T13:16:14.089708+0000","last_peered":"2024-04-25T13:16:14.089708+0000","last_clean":"2024-04-25T13:16:14.089708+0000","last_became_active":"2024-04-25T13:16:06.982320+0000","last_became_peered":"2024-04-25T13:16:06.982320+0000","last_unstale":"2024-04-25T13:16:14.089708+0000","last_undegraded":"2024-04-25T13:16:14.089708+0000","last_fullsized":"2024-04-25T13:16:14.089708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:55.372968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090845+0000","last_change":"2024-04-25T13:16:12.043657+0000","last_active":"2024-04-25T13:16:14.090845+0000","last_peered":"2024-04-25T13:16:14.090845+0000","last_clean":"2024-04-25T13:16:14.090845+0000","last_became_active":"2024-04-25T13:16:12.042902+0000","last_became_peered":"2024-04-25T13:16:12.042902+0000","last_unstale":"2024-04-25T13:16:14.090845+0000","last_undegraded":"2024-04-25T13:16:14.090845+0000","last_fullsized":"2024-04-25T13:16:14.090845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:46.721199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090854+0000","last_change":"2024-04-25T13:16:08.008534+0000","last_active":"2024-04-25T13:16:14.090854+0000","last_peered":"2024-04-25T13:16:14.090854+0000","last_clean":"2024-04-25T13:16:14.090854+0000","last_became_active":"2024-04-25T13:16:08.008102+0000","last_became_peered":"2024-04-25T13:16:08.008102+0000","last_unstale":"2024-04-25T13:16:14.090854+0000","last_undegraded":"2024-04-25T13:16:14.090854+0000","last_fullsized":"2024-04-25T13:16:14.090854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:48.331724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091187+0000","last_change":"2024-04-25T13:16:06.993292+0000","last_active":"2024-04-25T13:16:14.091187+0000","last_peered":"2024-04-25T13:16:14.091187+0000","last_clean":"2024-04-25T13:16:14.091187+0000","last_became_active":"2024-04-25T13:16:06.993008+0000","last_became_peered":"2024-04-25T13:16:06.993008+0000","last_unstale":"2024-04-25T13:16:14.091187+0000","last_undegraded":"2024-04-25T13:16:14.091187+0000","last_fullsized":"2024-04-25T13:16:14.091187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025971+0000","last_change":"2024-04-25T13:16:12.733945+0000","last_active":"2024-04-25T13:16:14.025971+0000","last_peered":"2024-04-25T13:16:14.025971+0000","last_clean":"2024-04-25T13:16:14.025971+0000","last_became_active":"2024-04-25T13:16:12.733359+0000","last_became_peered":"2024-04-25T13:16:12.733359+0000","last_unstale":"2024-04-25T13:16:14.025971+0000","last_undegraded":"2024-04-25T13:16:14.025971+0000","last_fullsized":"2024-04-25T13:16:14.025971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:27.352613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091472+0000","last_change":"2024-04-25T13:16:08.008034+0000","last_active":"2024-04-25T13:16:14.091472+0000","last_peered":"2024-04-25T13:16:14.091472+0000","last_clean":"2024-04-25T13:16:14.091472+0000","last_became_active":"2024-04-25T13:16:08.007790+0000","last_became_peered":"2024-04-25T13:16:08.007790+0000","last_unstale":"2024-04-25T13:16:14.091472+0000","last_undegraded":"2024-04-25T13:16:14.091472+0000","last_fullsized":"2024-04-25T13:16:14.091472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:35.903237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.026057+0000","last_change":"2024-04-25T13:16:06.996737+0000","last_active":"2024-04-25T13:16:14.026057+0000","last_peered":"2024-04-25T13:16:14.026057+0000","last_clean":"2024-04-25T13:16:14.026057+0000","last_became_active":"2024-04-25T13:16:06.996439+0000","last_became_peered":"2024-04-25T13:16:06.996439+0000","last_unstale":"2024-04-25T13:16:14.026057+0000","last_undegraded":"2024-04-25T13:16:14.026057+0000","last_fullsized":"2024-04-25T13:16:14.026057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:36.400030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025695+0000","last_change":"2024-04-25T13:16:12.734393+0000","last_active":"2024-04-25T13:16:14.025695+0000","last_peered":"2024-04-25T13:16:14.025695+0000","last_clean":"2024-04-25T13:16:14.025695+0000","last_became_active":"2024-04-25T13:16:12.733328+0000","last_became_peered":"2024-04-25T13:16:12.733328+0000","last_unstale":"2024-04-25T13:16:14.025695+0000","last_undegraded":"2024-04-25T13:16:14.025695+0000","last_fullsized":"2024-04-25T13:16:14.025695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.254012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090600+0000","last_change":"2024-04-25T13:16:08.000836+0000","last_active":"2024-04-25T13:16:14.090600+0000","last_peered":"2024-04-25T13:16:14.090600+0000","last_clean":"2024-04-25T13:16:14.090600+0000","last_became_active":"2024-04-25T13:16:08.000538+0000","last_became_peered":"2024-04-25T13:16:08.000538+0000","last_unstale":"2024-04-25T13:16:14.090600+0000","last_undegraded":"2024-04-25T13:16:14.090600+0000","last_fullsized":"2024-04-25T13:16:14.090600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:08.742353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090969+0000","last_change":"2024-04-25T13:16:07.000559+0000","last_active":"2024-04-25T13:16:14.090969+0000","last_peered":"2024-04-25T13:16:14.090969+0000","last_clean":"2024-04-25T13:16:14.090969+0000","last_became_active":"2024-04-25T13:16:07.000243+0000","last_became_peered":"2024-04-25T13:16:07.000243+0000","last_unstale":"2024-04-25T13:16:14.090969+0000","last_undegraded":"2024-04-25T13:16:14.090969+0000","last_fullsized":"2024-04-25T13:16:14.090969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:01.672221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025845+0000","last_change":"2024-04-25T13:16:12.733681+0000","last_active":"2024-04-25T13:16:14.025845+0000","last_peered":"2024-04-25T13:16:14.025845+0000","last_clean":"2024-04-25T13:16:14.025845+0000","last_became_active":"2024-04-25T13:16:12.733245+0000","last_became_peered":"2024-04-25T13:16:12.733245+0000","last_unstale":"2024-04-25T13:16:14.025845+0000","last_undegraded":"2024-04-25T13:16:14.025845+0000","last_fullsized":"2024-04-25T13:16:14.025845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.028858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092399+0000","last_change":"2024-04-25T13:16:08.008790+0000","last_active":"2024-04-25T13:16:14.092399+0000","last_peered":"2024-04-25T13:16:14.092399+0000","last_clean":"2024-04-25T13:16:14.092399+0000","last_became_active":"2024-04-25T13:16:08.008530+0000","last_became_peered":"2024-04-25T13:16:08.008530+0000","last_unstale":"2024-04-25T13:16:14.092399+0000","last_undegraded":"2024-04-25T13:16:14.092399+0000","last_fullsized":"2024-04-25T13:16:14.092399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:44.215930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:21.051524+0000","last_change":"2024-04-25T13:16:06.997575+0000","last_active":"2024-04-25T13:16:21.051524+0000","last_peered":"2024-04-25T13:16:21.051524+0000","last_clean":"2024-04-25T13:16:21.051524+0000","last_became_active":"2024-04-25T13:16:06.997289+0000","last_became_peered":"2024-04-25T13:16:06.997289+0000","last_unstale":"2024-04-25T13:16:21.051524+0000","last_undegraded":"2024-04-25T13:16:21.051524+0000","last_fullsized":"2024-04-25T13:16:21.051524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:54.096662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021968+0000","last_change":"2024-04-25T13:16:12.040456+0000","last_active":"2024-04-25T13:16:14.021968+0000","last_peered":"2024-04-25T13:16:14.021968+0000","last_clean":"2024-04-25T13:16:14.021968+0000","last_became_active":"2024-04-25T13:16:12.039443+0000","last_became_peered":"2024-04-25T13:16:12.039443+0000","last_unstale":"2024-04-25T13:16:14.021968+0000","last_undegraded":"2024-04-25T13:16:14.021968+0000","last_fullsized":"2024-04-25T13:16:14.021968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:23.192500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091569+0000","last_change":"2024-04-25T13:16:08.004618+0000","last_active":"2024-04-25T13:16:14.091569+0000","last_peered":"2024-04-25T13:16:14.091569+0000","last_clean":"2024-04-25T13:16:14.091569+0000","last_became_active":"2024-04-25T13:16:08.002583+0000","last_became_peered":"2024-04-25T13:16:08.002583+0000","last_unstale":"2024-04-25T13:16:14.091569+0000","last_undegraded":"2024-04-25T13:16:14.091569+0000","last_fullsized":"2024-04-25T13:16:14.091569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:25.609409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022349+0000","last_change":"2024-04-25T13:16:06.996610+0000","last_active":"2024-04-25T13:16:14.022349+0000","last_peered":"2024-04-25T13:16:14.022349+0000","last_clean":"2024-04-25T13:16:14.022349+0000","last_became_active":"2024-04-25T13:16:06.995616+0000","last_became_peered":"2024-04-25T13:16:06.995616+0000","last_unstale":"2024-04-25T13:16:14.022349+0000","last_undegraded":"2024-04-25T13:16:14.022349+0000","last_fullsized":"2024-04-25T13:16:14.022349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:21.135053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092179+0000","last_change":"2024-04-25T13:16:12.043744+0000","last_active":"2024-04-25T13:16:14.092179+0000","last_peered":"2024-04-25T13:16:14.092179+0000","last_clean":"2024-04-25T13:16:14.092179+0000","last_became_active":"2024-04-25T13:16:12.043267+0000","last_became_peered":"2024-04-25T13:16:12.043267+0000","last_unstale":"2024-04-25T13:16:14.092179+0000","last_undegraded":"2024-04-25T13:16:14.092179+0000","last_fullsized":"2024-04-25T13:16:14.092179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:52.316751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090426+0000","last_change":"2024-04-25T13:16:08.012359+0000","last_active":"2024-04-25T13:16:14.090426+0000","last_peered":"2024-04-25T13:16:14.090426+0000","last_clean":"2024-04-25T13:16:14.090426+0000","last_became_active":"2024-04-25T13:16:08.011295+0000","last_became_peered":"2024-04-25T13:16:08.011295+0000","last_unstale":"2024-04-25T13:16:14.090426+0000","last_undegraded":"2024-04-25T13:16:14.090426+0000","last_fullsized":"2024-04-25T13:16:14.090426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:19.939444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025352+0000","last_change":"2024-04-25T13:16:06.997061+0000","last_active":"2024-04-25T13:16:14.025352+0000","last_peered":"2024-04-25T13:16:14.025352+0000","last_clean":"2024-04-25T13:16:14.025352+0000","last_became_active":"2024-04-25T13:16:06.996418+0000","last_became_peered":"2024-04-25T13:16:06.996418+0000","last_unstale":"2024-04-25T13:16:14.025352+0000","last_undegraded":"2024-04-25T13:16:14.025352+0000","last_fullsized":"2024-04-25T13:16:14.025352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:34.878260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025141+0000","last_change":"2024-04-25T13:16:12.042796+0000","last_active":"2024-04-25T13:16:14.025141+0000","last_peered":"2024-04-25T13:16:14.025141+0000","last_clean":"2024-04-25T13:16:14.025141+0000","last_became_active":"2024-04-25T13:16:12.042252+0000","last_became_peered":"2024-04-25T13:16:12.042252+0000","last_unstale":"2024-04-25T13:16:14.025141+0000","last_undegraded":"2024-04-25T13:16:14.025141+0000","last_fullsized":"2024-04-25T13:16:14.025141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:51.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025295+0000","last_change":"2024-04-25T13:16:08.016203+0000","last_active":"2024-04-25T13:16:14.025295+0000","last_peered":"2024-04-25T13:16:14.025295+0000","last_clean":"2024-04-25T13:16:14.025295+0000","last_became_active":"2024-04-25T13:16:08.015820+0000","last_became_peered":"2024-04-25T13:16:08.015820+0000","last_unstale":"2024-04-25T13:16:14.025295+0000","last_undegraded":"2024-04-25T13:16:14.025295+0000","last_fullsized":"2024-04-25T13:16:14.025295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091794+0000","last_change":"2024-04-25T13:16:06.996624+0000","last_active":"2024-04-25T13:16:14.091794+0000","last_peered":"2024-04-25T13:16:14.091794+0000","last_clean":"2024-04-25T13:16:14.091794+0000","last_became_active":"2024-04-25T13:16:06.996373+0000","last_became_peered":"2024-04-25T13:16:06.996373+0000","last_unstale":"2024-04-25T13:16:14.091794+0000","last_undegraded":"2024-04-25T13:16:14.091794+0000","last_fullsized":"2024-04-25T13:16:14.091794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:29.929030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025097+0000","last_change":"2024-04-25T13:16:12.733792+0000","last_active":"2024-04-25T13:16:14.025097+0000","last_peered":"2024-04-25T13:16:14.025097+0000","last_clean":"2024-04-25T13:16:14.025097+0000","last_became_active":"2024-04-25T13:16:12.733314+0000","last_became_peered":"2024-04-25T13:16:12.733314+0000","last_unstale":"2024-04-25T13:16:14.025097+0000","last_undegraded":"2024-04-25T13:16:14.025097+0000","last_fullsized":"2024-04-25T13:16:14.025097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.836368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090737+0000","last_change":"2024-04-25T13:16:12.734573+0000","last_active":"2024-04-25T13:16:14.090737+0000","last_peered":"2024-04-25T13:16:14.090737+0000","last_clean":"2024-04-25T13:16:14.090737+0000","last_became_active":"2024-04-25T13:16:12.733908+0000","last_became_peered":"2024-04-25T13:16:12.733908+0000","last_unstale":"2024-04-25T13:16:14.090737+0000","last_undegraded":"2024-04-25T13:16:14.090737+0000","last_fullsized":"2024-04-25T13:16:14.090737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:59.673528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021648+0000","last_change":"2024-04-25T13:16:08.008915+0000","last_active":"2024-04-25T13:16:14.021648+0000","last_peered":"2024-04-25T13:16:14.021648+0000","last_clean":"2024-04-25T13:16:14.021648+0000","last_became_active":"2024-04-25T13:16:08.008586+0000","last_became_peered":"2024-04-25T13:16:08.008586+0000","last_unstale":"2024-04-25T13:16:14.021648+0000","last_undegraded":"2024-04-25T13:16:14.021648+0000","last_fullsized":"2024-04-25T13:16:14.021648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:46.905065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025297+0000","last_change":"2024-04-25T13:16:06.994489+0000","last_active":"2024-04-25T13:16:14.025297+0000","last_peered":"2024-04-25T13:16:14.025297+0000","last_clean":"2024-04-25T13:16:14.025297+0000","last_became_active":"2024-04-25T13:16:06.994005+0000","last_became_peered":"2024-04-25T13:16:06.994005+0000","last_unstale":"2024-04-25T13:16:14.025297+0000","last_undegraded":"2024-04-25T13:16:14.025297+0000","last_fullsized":"2024-04-25T13:16:14.025297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:43.921452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091678+0000","last_change":"2024-04-25T13:16:12.037008+0000","last_active":"2024-04-25T13:16:14.091678+0000","last_peered":"2024-04-25T13:16:14.091678+0000","last_clean":"2024-04-25T13:16:14.091678+0000","last_became_active":"2024-04-25T13:16:12.036569+0000","last_became_peered":"2024-04-25T13:16:12.036569+0000","last_unstale":"2024-04-25T13:16:14.091678+0000","last_undegraded":"2024-04-25T13:16:14.091678+0000","last_fullsized":"2024-04-25T13:16:14.091678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:48.224913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025108+0000","last_change":"2024-04-25T13:16:08.008747+0000","last_active":"2024-04-25T13:16:14.025108+0000","last_peered":"2024-04-25T13:16:14.025108+0000","last_clean":"2024-04-25T13:16:14.025108+0000","last_became_active":"2024-04-25T13:16:08.008078+0000","last_became_peered":"2024-04-25T13:16:08.008078+0000","last_unstale":"2024-04-25T13:16:14.025108+0000","last_undegraded":"2024-04-25T13:16:14.025108+0000","last_fullsized":"2024-04-25T13:16:14.025108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:19.590099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025230+0000","last_change":"2024-04-25T13:16:06.997642+0000","last_active":"2024-04-25T13:16:14.025230+0000","last_peered":"2024-04-25T13:16:14.025230+0000","last_clean":"2024-04-25T13:16:14.025230+0000","last_became_active":"2024-04-25T13:16:06.996985+0000","last_became_peered":"2024-04-25T13:16:06.996985+0000","last_unstale":"2024-04-25T13:16:14.025230+0000","last_undegraded":"2024-04-25T13:16:14.025230+0000","last_fullsized":"2024-04-25T13:16:14.025230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:49.853125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091049+0000","last_change":"2024-04-25T13:16:06.992687+0000","last_active":"2024-04-25T13:16:14.091049+0000","last_peered":"2024-04-25T13:16:14.091049+0000","last_clean":"2024-04-25T13:16:14.091049+0000","last_became_active":"2024-04-25T13:16:06.992407+0000","last_became_peered":"2024-04-25T13:16:06.992407+0000","last_unstale":"2024-04-25T13:16:14.091049+0000","last_undegraded":"2024-04-25T13:16:14.091049+0000","last_fullsized":"2024-04-25T13:16:14.091049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:37.658458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090948+0000","last_change":"2024-04-25T13:16:08.004510+0000","last_active":"2024-04-25T13:16:14.090948+0000","last_peered":"2024-04-25T13:16:14.090948+0000","last_clean":"2024-04-25T13:16:14.090948+0000","last_became_active":"2024-04-25T13:16:08.003959+0000","last_became_peered":"2024-04-25T13:16:08.003959+0000","last_unstale":"2024-04-25T13:16:14.090948+0000","last_undegraded":"2024-04-25T13:16:14.090948+0000","last_fullsized":"2024-04-25T13:16:14.090948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:45.142873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089967+0000","last_change":"2024-04-25T13:16:12.037097+0000","last_active":"2024-04-25T13:16:14.089967+0000","last_peered":"2024-04-25T13:16:14.089967+0000","last_clean":"2024-04-25T13:16:14.089967+0000","last_became_active":"2024-04-25T13:16:12.036651+0000","last_became_peered":"2024-04-25T13:16:12.036651+0000","last_unstale":"2024-04-25T13:16:14.089967+0000","last_undegraded":"2024-04-25T13:16:14.089967+0000","last_fullsized":"2024-04-25T13:16:14.089967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:34.443514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025481+0000","last_change":"2024-04-25T13:16:06.996311+0000","last_active":"2024-04-25T13:16:14.025481+0000","last_peered":"2024-04-25T13:16:14.025481+0000","last_clean":"2024-04-25T13:16:14.025481+0000","last_became_active":"2024-04-25T13:16:06.996010+0000","last_became_peered":"2024-04-25T13:16:06.996010+0000","last_unstale":"2024-04-25T13:16:14.025481+0000","last_undegraded":"2024-04-25T13:16:14.025481+0000","last_fullsized":"2024-04-25T13:16:14.025481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:08.835482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091724+0000","last_change":"2024-04-25T13:16:08.002159+0000","last_active":"2024-04-25T13:16:14.091724+0000","last_peered":"2024-04-25T13:16:14.091724+0000","last_clean":"2024-04-25T13:16:14.091724+0000","last_became_active":"2024-04-25T13:16:08.001833+0000","last_became_peered":"2024-04-25T13:16:08.001833+0000","last_unstale":"2024-04-25T13:16:14.091724+0000","last_undegraded":"2024-04-25T13:16:14.091724+0000","last_fullsized":"2024-04-25T13:16:14.091724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:25.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025768+0000","last_change":"2024-04-25T13:16:12.042721+0000","last_active":"2024-04-25T13:16:14.025768+0000","last_peered":"2024-04-25T13:16:14.025768+0000","last_clean":"2024-04-25T13:16:14.025768+0000","last_became_active":"2024-04-25T13:16:12.042000+0000","last_became_peered":"2024-04-25T13:16:12.042000+0000","last_unstale":"2024-04-25T13:16:14.025768+0000","last_undegraded":"2024-04-25T13:16:14.025768+0000","last_fullsized":"2024-04-25T13:16:14.025768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:18.702032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090639+0000","last_change":"2024-04-25T13:16:08.008364+0000","last_active":"2024-04-25T13:16:14.090639+0000","last_peered":"2024-04-25T13:16:14.090639+0000","last_clean":"2024-04-25T13:16:14.090639+0000","last_became_active":"2024-04-25T13:16:08.007728+0000","last_became_peered":"2024-04-25T13:16:08.007728+0000","last_unstale":"2024-04-25T13:16:14.090639+0000","last_undegraded":"2024-04-25T13:16:14.090639+0000","last_fullsized":"2024-04-25T13:16:14.090639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:08.731178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089766+0000","last_change":"2024-04-25T13:16:08.011273+0000","last_active":"2024-04-25T13:16:14.089766+0000","last_peered":"2024-04-25T13:16:14.089766+0000","last_clean":"2024-04-25T13:16:14.089766+0000","last_became_active":"2024-04-25T13:16:08.010981+0000","last_became_peered":"2024-04-25T13:16:08.010981+0000","last_unstale":"2024-04-25T13:16:14.089766+0000","last_undegraded":"2024-04-25T13:16:14.089766+0000","last_fullsized":"2024-04-25T13:16:14.089766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:03.835422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025994+0000","last_change":"2024-04-25T13:16:08.016413+0000","last_active":"2024-04-25T13:16:14.025994+0000","last_peered":"2024-04-25T13:16:14.025994+0000","last_clean":"2024-04-25T13:16:14.025994+0000","last_became_active":"2024-04-25T13:16:08.016084+0000","last_became_peered":"2024-04-25T13:16:08.016084+0000","last_unstale":"2024-04-25T13:16:14.025994+0000","last_undegraded":"2024-04-25T13:16:14.025994+0000","last_fullsized":"2024-04-25T13:16:14.025994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:41.014999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090856+0000","last_change":"2024-04-25T13:16:08.008543+0000","last_active":"2024-04-25T13:16:14.090856+0000","last_peered":"2024-04-25T13:16:14.090856+0000","last_clean":"2024-04-25T13:16:14.090856+0000","last_became_active":"2024-04-25T13:16:08.008255+0000","last_became_peered":"2024-04-25T13:16:08.008255+0000","last_unstale":"2024-04-25T13:16:14.090856+0000","last_undegraded":"2024-04-25T13:16:14.090856+0000","last_fullsized":"2024-04-25T13:16:14.090856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:47.981446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025776+0000","last_change":"2024-04-25T13:16:08.012814+0000","last_active":"2024-04-25T13:16:14.025776+0000","last_peered":"2024-04-25T13:16:14.025776+0000","last_clean":"2024-04-25T13:16:14.025776+0000","last_became_active":"2024-04-25T13:16:08.012481+0000","last_became_peered":"2024-04-25T13:16:08.012481+0000","last_unstale":"2024-04-25T13:16:14.025776+0000","last_undegraded":"2024-04-25T13:16:14.025776+0000","last_fullsized":"2024-04-25T13:16:14.025776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:05.409701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021983+0000","last_change":"2024-04-25T13:16:08.008843+0000","last_active":"2024-04-25T13:16:14.021983+0000","last_peered":"2024-04-25T13:16:14.021983+0000","last_clean":"2024-04-25T13:16:14.021983+0000","last_became_active":"2024-04-25T13:16:08.008489+0000","last_became_peered":"2024-04-25T13:16:08.008489+0000","last_unstale":"2024-04-25T13:16:14.021983+0000","last_undegraded":"2024-04-25T13:16:14.021983+0000","last_fullsized":"2024-04-25T13:16:14.021983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:35.740816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092076+0000","last_change":"2024-04-25T13:16:08.008121+0000","last_active":"2024-04-25T13:16:14.092076+0000","last_peered":"2024-04-25T13:16:14.092076+0000","last_clean":"2024-04-25T13:16:14.092076+0000","last_became_active":"2024-04-25T13:16:08.007727+0000","last_became_peered":"2024-04-25T13:16:08.007727+0000","last_unstale":"2024-04-25T13:16:14.092076+0000","last_undegraded":"2024-04-25T13:16:14.092076+0000","last_fullsized":"2024-04-25T13:16:14.092076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:11.193610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025864+0000","last_change":"2024-04-25T13:16:08.014997+0000","last_active":"2024-04-25T13:16:14.025864+0000","last_peered":"2024-04-25T13:16:14.025864+0000","last_clean":"2024-04-25T13:16:14.025864+0000","last_became_active":"2024-04-25T13:16:08.014579+0000","last_became_peered":"2024-04-25T13:16:08.014579+0000","last_unstale":"2024-04-25T13:16:14.025864+0000","last_undegraded":"2024-04-25T13:16:14.025864+0000","last_fullsized":"2024-04-25T13:16:14.025864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:07.884249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025224+0000","last_change":"2024-04-25T13:16:08.015379+0000","last_active":"2024-04-25T13:16:14.025224+0000","last_peered":"2024-04-25T13:16:14.025224+0000","last_clean":"2024-04-25T13:16:14.025224+0000","last_became_active":"2024-04-25T13:16:08.014693+0000","last_became_peered":"2024-04-25T13:16:08.014693+0000","last_unstale":"2024-04-25T13:16:14.025224+0000","last_undegraded":"2024-04-25T13:16:14.025224+0000","last_fullsized":"2024-04-25T13:16:14.025224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:41.305358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025156+0000","last_change":"2024-04-25T13:16:08.014873+0000","last_active":"2024-04-25T13:16:14.025156+0000","last_peered":"2024-04-25T13:16:14.025156+0000","last_clean":"2024-04-25T13:16:14.025156+0000","last_became_active":"2024-04-25T13:16:08.014575+0000","last_became_peered":"2024-04-25T13:16:08.014575+0000","last_unstale":"2024-04-25T13:16:14.025156+0000","last_undegraded":"2024-04-25T13:16:14.025156+0000","last_fullsized":"2024-04-25T13:16:14.025156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:41.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025900+0000","last_change":"2024-04-25T13:16:08.016992+0000","last_active":"2024-04-25T13:16:14.025900+0000","last_peered":"2024-04-25T13:16:14.025900+0000","last_clean":"2024-04-25T13:16:14.025900+0000","last_became_active":"2024-04-25T13:16:08.016499+0000","last_became_peered":"2024-04-25T13:16:08.016499+0000","last_unstale":"2024-04-25T13:16:14.025900+0000","last_undegraded":"2024-04-25T13:16:14.025900+0000","last_fullsized":"2024-04-25T13:16:14.025900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:47.275363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090726+0000","last_change":"2024-04-25T13:16:08.000447+0000","last_active":"2024-04-25T13:16:14.090726+0000","last_peered":"2024-04-25T13:16:14.090726+0000","last_clean":"2024-04-25T13:16:14.090726+0000","last_became_active":"2024-04-25T13:16:08.000102+0000","last_became_peered":"2024-04-25T13:16:08.000102+0000","last_unstale":"2024-04-25T13:16:14.090726+0000","last_undegraded":"2024-04-25T13:16:14.090726+0000","last_fullsized":"2024-04-25T13:16:14.090726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:30.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092034+0000","last_change":"2024-04-25T13:16:08.008437+0000","last_active":"2024-04-25T13:16:14.092034+0000","last_peered":"2024-04-25T13:16:14.092034+0000","last_clean":"2024-04-25T13:16:14.092034+0000","last_became_active":"2024-04-25T13:16:08.008173+0000","last_became_peered":"2024-04-25T13:16:08.008173+0000","last_unstale":"2024-04-25T13:16:14.092034+0000","last_undegraded":"2024-04-25T13:16:14.092034+0000","last_fullsized":"2024-04-25T13:16:14.092034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:54.362757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092640+0000","last_change":"2024-04-25T13:16:08.004689+0000","last_active":"2024-04-25T13:16:14.092640+0000","last_peered":"2024-04-25T13:16:14.092640+0000","last_clean":"2024-04-25T13:16:14.092640+0000","last_became_active":"2024-04-25T13:16:08.004340+0000","last_became_peered":"2024-04-25T13:16:08.004340+0000","last_unstale":"2024-04-25T13:16:14.092640+0000","last_undegraded":"2024-04-25T13:16:14.092640+0000","last_fullsized":"2024-04-25T13:16:14.092640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:18.870731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090426+0000","last_change":"2024-04-25T13:16:08.005344+0000","last_active":"2024-04-25T13:16:14.090426+0000","last_peered":"2024-04-25T13:16:14.090426+0000","last_clean":"2024-04-25T13:16:14.090426+0000","last_became_active":"2024-04-25T13:16:08.005041+0000","last_became_peered":"2024-04-25T13:16:08.005041+0000","last_unstale":"2024-04-25T13:16:14.090426+0000","last_undegraded":"2024-04-25T13:16:14.090426+0000","last_fullsized":"2024-04-25T13:16:14.090426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.389800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025849+0000","last_change":"2024-04-25T13:16:08.010203+0000","last_active":"2024-04-25T13:16:14.025849+0000","last_peered":"2024-04-25T13:16:14.025849+0000","last_clean":"2024-04-25T13:16:14.025849+0000","last_became_active":"2024-04-25T13:16:08.009922+0000","last_became_peered":"2024-04-25T13:16:08.009922+0000","last_unstale":"2024-04-25T13:16:14.025849+0000","last_undegraded":"2024-04-25T13:16:14.025849+0000","last_fullsized":"2024-04-25T13:16:14.025849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:06.831797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025079+0000","last_change":"2024-04-25T13:16:08.012737+0000","last_active":"2024-04-25T13:16:14.025079+0000","last_peered":"2024-04-25T13:16:14.025079+0000","last_clean":"2024-04-25T13:16:14.025079+0000","last_became_active":"2024-04-25T13:16:08.012472+0000","last_became_peered":"2024-04-25T13:16:08.012472+0000","last_unstale":"2024-04-25T13:16:14.025079+0000","last_undegraded":"2024-04-25T13:16:14.025079+0000","last_fullsized":"2024-04-25T13:16:14.025079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:36.880757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021729+0000","last_change":"2024-04-25T13:16:08.007177+0000","last_active":"2024-04-25T13:16:14.021729+0000","last_peered":"2024-04-25T13:16:14.021729+0000","last_clean":"2024-04-25T13:16:14.021729+0000","last_became_active":"2024-04-25T13:16:08.006866+0000","last_became_peered":"2024-04-25T13:16:08.006866+0000","last_unstale":"2024-04-25T13:16:14.021729+0000","last_undegraded":"2024-04-25T13:16:14.021729+0000","last_fullsized":"2024-04-25T13:16:14.021729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:16.707771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090599+0000","last_change":"2024-04-25T13:16:07.999761+0000","last_active":"2024-04-25T13:16:14.090599+0000","last_peered":"2024-04-25T13:16:14.090599+0000","last_clean":"2024-04-25T13:16:14.090599+0000","last_became_active":"2024-04-25T13:16:07.999033+0000","last_became_peered":"2024-04-25T13:16:07.999033+0000","last_unstale":"2024-04-25T13:16:14.090599+0000","last_undegraded":"2024-04-25T13:16:14.090599+0000","last_fullsized":"2024-04-25T13:16:14.090599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:40.420290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025389+0000","last_change":"2024-04-25T13:16:08.016370+0000","last_active":"2024-04-25T13:16:14.025389+0000","last_peered":"2024-04-25T13:16:14.025389+0000","last_clean":"2024-04-25T13:16:14.025389+0000","last_became_active":"2024-04-25T13:16:08.016068+0000","last_became_peered":"2024-04-25T13:16:08.016068+0000","last_unstale":"2024-04-25T13:16:14.025389+0000","last_undegraded":"2024-04-25T13:16:14.025389+0000","last_fullsized":"2024-04-25T13:16:14.025389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:11.475920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091465+0000","last_change":"2024-04-25T13:16:08.005195+0000","last_active":"2024-04-25T13:16:14.091465+0000","last_peered":"2024-04-25T13:16:14.091465+0000","last_clean":"2024-04-25T13:16:14.091465+0000","last_became_active":"2024-04-25T13:16:08.004655+0000","last_became_peered":"2024-04-25T13:16:08.004655+0000","last_unstale":"2024-04-25T13:16:14.091465+0000","last_undegraded":"2024-04-25T13:16:14.091465+0000","last_fullsized":"2024-04-25T13:16:14.091465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:28.249616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091464+0000","last_change":"2024-04-25T13:16:08.011310+0000","last_active":"2024-04-25T13:16:14.091464+0000","last_peered":"2024-04-25T13:16:14.091464+0000","last_clean":"2024-04-25T13:16:14.091464+0000","last_became_active":"2024-04-25T13:16:08.011047+0000","last_became_peered":"2024-04-25T13:16:08.011047+0000","last_unstale":"2024-04-25T13:16:14.091464+0000","last_undegraded":"2024-04-25T13:16:14.091464+0000","last_fullsized":"2024-04-25T13:16:14.091464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:55.447995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091964+0000","last_change":"2024-04-25T13:16:08.012191+0000","last_active":"2024-04-25T13:16:14.091964+0000","last_peered":"2024-04-25T13:16:14.091964+0000","last_clean":"2024-04-25T13:16:14.091964+0000","last_became_active":"2024-04-25T13:16:08.011916+0000","last_became_peered":"2024-04-25T13:16:08.011916+0000","last_unstale":"2024-04-25T13:16:14.091964+0000","last_undegraded":"2024-04-25T13:16:14.091964+0000","last_fullsized":"2024-04-25T13:16:14.091964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:33.520554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092843+0000","last_change":"2024-04-25T13:16:08.012349+0000","last_active":"2024-04-25T13:16:14.092843+0000","last_peered":"2024-04-25T13:16:14.092843+0000","last_clean":"2024-04-25T13:16:14.092843+0000","last_became_active":"2024-04-25T13:16:08.011893+0000","last_became_peered":"2024-04-25T13:16:08.011893+0000","last_unstale":"2024-04-25T13:16:14.092843+0000","last_undegraded":"2024-04-25T13:16:14.092843+0000","last_fullsized":"2024-04-25T13:16:14.092843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:11.901170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.024985+0000","last_change":"2024-04-25T13:16:08.015681+0000","last_active":"2024-04-25T13:16:14.024985+0000","last_peered":"2024-04-25T13:16:14.024985+0000","last_clean":"2024-04-25T13:16:14.024985+0000","last_became_active":"2024-04-25T13:16:08.015405+0000","last_became_peered":"2024-04-25T13:16:08.015405+0000","last_unstale":"2024-04-25T13:16:14.024985+0000","last_undegraded":"2024-04-25T13:16:14.024985+0000","last_fullsized":"2024-04-25T13:16:14.024985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:00.932243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090639+0000","last_change":"2024-04-25T13:16:08.000456+0000","last_active":"2024-04-25T13:16:14.090639+0000","last_peered":"2024-04-25T13:16:14.090639+0000","last_clean":"2024-04-25T13:16:14.090639+0000","last_became_active":"2024-04-25T13:16:08.000193+0000","last_became_peered":"2024-04-25T13:16:08.000193+0000","last_unstale":"2024-04-25T13:16:14.090639+0000","last_undegraded":"2024-04-25T13:16:14.090639+0000","last_fullsized":"2024-04-25T13:16:14.090639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:15.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025845+0000","last_change":"2024-04-25T13:16:08.016060+0000","last_active":"2024-04-25T13:16:14.025845+0000","last_peered":"2024-04-25T13:16:14.025845+0000","last_clean":"2024-04-25T13:16:14.025845+0000","last_became_active":"2024-04-25T13:16:08.014300+0000","last_became_peered":"2024-04-25T13:16:08.014300+0000","last_unstale":"2024-04-25T13:16:14.025845+0000","last_undegraded":"2024-04-25T13:16:14.025845+0000","last_fullsized":"2024-04-25T13:16:14.025845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:37.644887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091282+0000","last_change":"2024-04-25T13:16:08.004946+0000","last_active":"2024-04-25T13:16:14.091282+0000","last_peered":"2024-04-25T13:16:14.091282+0000","last_clean":"2024-04-25T13:16:14.091282+0000","last_became_active":"2024-04-25T13:16:08.004673+0000","last_became_peered":"2024-04-25T13:16:08.004673+0000","last_unstale":"2024-04-25T13:16:14.091282+0000","last_undegraded":"2024-04-25T13:16:14.091282+0000","last_fullsized":"2024-04-25T13:16:14.091282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:18.616424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025492+0000","last_change":"2024-04-25T13:16:08.015676+0000","last_active":"2024-04-25T13:16:14.025492+0000","last_peered":"2024-04-25T13:16:14.025492+0000","last_clean":"2024-04-25T13:16:14.025492+0000","last_became_active":"2024-04-25T13:16:08.014719+0000","last_became_peered":"2024-04-25T13:16:08.014719+0000","last_unstale":"2024-04-25T13:16:14.025492+0000","last_undegraded":"2024-04-25T13:16:14.025492+0000","last_fullsized":"2024-04-25T13:16:14.025492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:04.274611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090172+0000","last_change":"2024-04-25T13:16:07.997665+0000","last_active":"2024-04-25T13:16:14.090172+0000","last_peered":"2024-04-25T13:16:14.090172+0000","last_clean":"2024-04-25T13:16:14.090172+0000","last_became_active":"2024-04-25T13:16:07.996792+0000","last_became_peered":"2024-04-25T13:16:07.996792+0000","last_unstale":"2024-04-25T13:16:14.090172+0000","last_undegraded":"2024-04-25T13:16:14.090172+0000","last_fullsized":"2024-04-25T13:16:14.090172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:39.367026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022259+0000","last_change":"2024-04-25T13:16:08.001495+0000","last_active":"2024-04-25T13:16:14.022259+0000","last_peered":"2024-04-25T13:16:14.022259+0000","last_clean":"2024-04-25T13:16:14.022259+0000","last_became_active":"2024-04-25T13:16:08.001182+0000","last_became_peered":"2024-04-25T13:16:08.001182+0000","last_unstale":"2024-04-25T13:16:14.022259+0000","last_undegraded":"2024-04-25T13:16:14.022259+0000","last_fullsized":"2024-04-25T13:16:14.022259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:48.417192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092786+0000","last_change":"2024-04-25T13:16:08.006262+0000","last_active":"2024-04-25T13:16:14.092786+0000","last_peered":"2024-04-25T13:16:14.092786+0000","last_clean":"2024-04-25T13:16:14.092786+0000","last_became_active":"2024-04-25T13:16:08.005976+0000","last_became_peered":"2024-04-25T13:16:08.005976+0000","last_unstale":"2024-04-25T13:16:14.092786+0000","last_undegraded":"2024-04-25T13:16:14.092786+0000","last_fullsized":"2024-04-25T13:16:14.092786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:22.965387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:16:37.094 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:16:37.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.230+0000 7f86cffad640 1 Processor -- start 2024-04-25T13:16:37.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.230+0000 7f86cffad640 1 -- start start 2024-04-25T13:16:37.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86cffad640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f86c80b3c00 0x7f86c80b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86cffad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80b5450 0x7f86c80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86cffad640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c81558c0 con 0x7f86c81554e0 2024-04-25T13:16:37.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86cffad640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f86c80b4a80 con 0x7f86c80b3c00 2024-04-25T13:16:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86cffad640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f86c80cb8c0 con 0x7f86c80b5450 2024-04-25T13:16:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86cd548640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f86c80b3c00 0x7f86c80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86ce54a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80b5450 0x7f86c80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86cdd49640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f86c81554e0 0x7f86c815f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:54860/0 (socket says 172.21.15.52:54860) 2024-04-25T13:16:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86cdd49640 1 -- 172.21.15.52:0/1287661898 learned_addr learned my addr 172.21.15.52:0/1287661898 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86ce54a640 1 -- 172.21.15.52:0/1287661898 >> v2:172.21.15.102:3300/0 conn(0x7f86c80b3c00 msgr2=0x7f86c80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86ce54a640 1 --2- 172.21.15.52:0/1287661898 >> v2:172.21.15.102:3300/0 conn(0x7f86c80b3c00 0x7f86c80b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86ce54a640 1 -- 172.21.15.52:0/1287661898 >> v1:172.21.15.102:6789/0 conn(0x7f86c81554e0 legacy=0x7f86c815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86ccd47640 1 -- 172.21.15.52:0/1287661898 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559061880 0 0) 0x7f86c4001110 con 0x7f86c81554e0 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86ce54a640 1 -- 172.21.15.52:0/1287661898 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c80cbba0 con 0x7f86c80b5450 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.231+0000 7f86cd548640 1 --2- 172.21.15.52:0/1287661898 >> v2:172.21.15.102:3300/0 conn(0x7f86c80b3c00 0x7f86c80b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.232+0000 7f86ce54a640 1 --2- 172.21.15.52:0/1287661898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80b5450 0x7f86c80d08a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009d90 tx=0x7f86c002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfda9f0a1497cea5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.232+0000 7f86ccd47640 1 -- 172.21.15.52:0/1287661898 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0007740 con 0x7f86c80b5450 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.232+0000 7f86ccd47640 1 -- 172.21.15.52:0/1287661898 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c00078e0 con 0x7f86c80b5450 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.232+0000 7f86ccd47640 1 -- 172.21.15.52:0/1287661898 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0007cb0 con 0x7f86c80b5450 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.233+0000 7f86cffad640 1 -- 172.21.15.52:0/1287661898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80b5450 msgr2=0x7f86c80d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.233+0000 7f86cffad640 1 --2- 172.21.15.52:0/1287661898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80b5450 0x7f86c80d08a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009d90 tx=0x7f86c002a6f0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.233+0000 7f86cffad640 1 -- 172.21.15.52:0/1287661898 shutdown_connections 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.233+0000 7f86cffad640 1 --2- 172.21.15.52:0/1287661898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80b5450 0x7f86c80d08a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.233+0000 7f86cffad640 1 --2- 172.21.15.52:0/1287661898 >> v2:172.21.15.102:3300/0 conn(0x7f86c80b3c00 0x7f86c80b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.233+0000 7f86cffad640 1 -- 172.21.15.52:0/1287661898 >> 172.21.15.52:0/1287661898 conn(0x7f86c8074d50 msgr2=0x7f86c8075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.233+0000 7f86cffad640 1 -- 172.21.15.52:0/1287661898 shutdown_connections 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.233+0000 7f86cffad640 1 -- 172.21.15.52:0/1287661898 wait complete. 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.234+0000 7f86cffad640 1 Processor -- start 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.234+0000 7f86cffad640 1 -- start start 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cffad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c80b3c00 0x7f86c81f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cffad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80b5450 0x7f86c815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cffad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86c81554e0 0x7f86c8153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cffad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86c80b4710 con 0x7f86c80b3c00 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cffad640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f86c80b4430 con 0x7f86c81554e0 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cffad640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f86c80b3580 con 0x7f86c80b5450 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cdd49640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c80b3c00 0x7f86c81f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cdd49640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c80b3c00 0x7f86c81f1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49768/0 (socket says 172.21.15.52:49768) 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cdd49640 1 -- 172.21.15.52:0/1729470304 learned_addr learned my addr 172.21.15.52:0/1729470304 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86ce54a640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86c81554e0 0x7f86c8153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cd548640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80b5450 0x7f86c815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cdd49640 1 -- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80b5450 msgr2=0x7f86c815b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cdd49640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80b5450 0x7f86c815b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cdd49640 1 -- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86c81554e0 msgr2=0x7f86c8153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cdd49640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86c81554e0 0x7f86c8153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cdd49640 1 -- 172.21.15.52:0/1729470304 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c815bca0 con 0x7f86c80b3c00 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86ce54a640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86c81554e0 0x7f86c8153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cd548640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80b5450 0x7f86c815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.235+0000 7f86cdd49640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c80b3c00 0x7f86c81f1860 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c7b0 tx=0x7f86c400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.236+0000 7f86be7fc640 1 -- 172.21.15.52:0/1729470304 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4018070 con 0x7f86c80b3c00 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.236+0000 7f86be7fc640 1 -- 172.21.15.52:0/1729470304 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c40072d0 con 0x7f86c80b3c00 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.236+0000 7f86cffad640 1 -- 172.21.15.52:0/1729470304 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c815a180 con 0x7f86c80b3c00 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.236+0000 7f86be7fc640 1 -- 172.21.15.52:0/1729470304 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c40047e0 con 0x7f86c80b3c00 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.236+0000 7f86cffad640 1 -- 172.21.15.52:0/1729470304 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c815a740 con 0x7f86c80b3c00 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.237+0000 7f86cffad640 1 -- 172.21.15.52:0/1729470304 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c8068e40 con 0x7f86c80b3c00 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.237+0000 7f86be7fc640 1 -- 172.21.15.52:0/1729470304 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86c401b070 con 0x7f86c80b3c00 2024-04-25T13:16:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.238+0000 7f86be7fc640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f86ac06c8f0 0x7f86ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.238+0000 7f86be7fc640 1 -- 172.21.15.52:0/1729470304 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f86c408b280 con 0x7f86c80b3c00 2024-04-25T13:16:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.238+0000 7f86cd548640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f86ac06c8f0 0x7f86ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.238+0000 7f86cd548640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f86ac06c8f0 0x7f86ac06edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f86c81e72e0 tx=0x7f86b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.242+0000 7f86be7fc640 1 -- 172.21.15.52:0/1729470304 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f86c81558c0 con 0x7f86c80b3c00 2024-04-25T13:16:37.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.427+0000 7f86cffad640 1 -- 172.21.15.52:0/1729470304 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86c80c7510 con 0x7f86ac06c8f0 2024-04-25T13:16:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.435+0000 7f86be7fc640 1 -- 172.21.15.52:0/1729470304 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f86c80c7510 con 0x7f86ac06c8f0 2024-04-25T13:16:37.443 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:37.445 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T13:16:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.439+0000 7f86cffad640 1 -- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f86ac06c8f0 msgr2=0x7f86ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.439+0000 7f86cffad640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f86ac06c8f0 0x7f86ac06edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f86c81e72e0 tx=0x7f86b8008040 comp rx=0 tx=0).stop 2024-04-25T13:16:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.439+0000 7f86cffad640 1 -- 172.21.15.52:0/1729470304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c80b3c00 msgr2=0x7f86c81f1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.439+0000 7f86cffad640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c80b3c00 0x7f86c81f1860 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c7b0 tx=0x7f86c400cc70 comp rx=0 tx=0).stop 2024-04-25T13:16:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.439+0000 7f86cffad640 1 -- 172.21.15.52:0/1729470304 shutdown_connections 2024-04-25T13:16:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.439+0000 7f86cffad640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f86ac06c8f0 0x7f86ac06edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.439+0000 7f86cffad640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86c80b5450 0x7f86c815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.439+0000 7f86cffad640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86c81554e0 0x7f86c8153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.439+0000 7f86cffad640 1 --2- 172.21.15.52:0/1729470304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c80b3c00 0x7f86c81f1860 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.439+0000 7f86cffad640 1 -- 172.21.15.52:0/1729470304 >> 172.21.15.52:0/1729470304 conn(0x7f86c8074d50 msgr2=0x7f86c8072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.439+0000 7f86cffad640 1 -- 172.21.15.52:0/1729470304 shutdown_connections 2024-04-25T13:16:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.439+0000 7f86cffad640 1 -- 172.21.15.52:0/1729470304 wait complete. 2024-04-25T13:16:37.450 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-25T13:16:35.825095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236124,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738596,"statfs":{"total":773094113280,"available":772852322304,"internally_reserved":0,"allocated":3383296,"data_stored":2049160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002688"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090521+0000","last_change":"2024-04-25T13:16:07.001071+0000","last_active":"2024-04-25T13:16:14.090521+0000","last_peered":"2024-04-25T13:16:14.090521+0000","last_clean":"2024-04-25T13:16:14.090521+0000","last_became_active":"2024-04-25T13:16:07.000746+0000","last_became_peered":"2024-04-25T13:16:07.000746+0000","last_unstale":"2024-04-25T13:16:14.090521+0000","last_undegraded":"2024-04-25T13:16:14.090521+0000","last_fullsized":"2024-04-25T13:16:14.090521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:36.289103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025658+0000","last_change":"2024-04-25T13:16:08.012928+0000","last_active":"2024-04-25T13:16:14.025658+0000","last_peered":"2024-04-25T13:16:14.025658+0000","last_clean":"2024-04-25T13:16:14.025658+0000","last_became_active":"2024-04-25T13:16:08.012114+0000","last_became_peered":"2024-04-25T13:16:08.012114+0000","last_unstale":"2024-04-25T13:16:14.025658+0000","last_undegraded":"2024-04-25T13:16:14.025658+0000","last_fullsized":"2024-04-25T13:16:14.025658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:01.077922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025013+0000","last_change":"2024-04-25T13:16:12.734829+0000","last_active":"2024-04-25T13:16:14.025013+0000","last_peered":"2024-04-25T13:16:14.025013+0000","last_clean":"2024-04-25T13:16:14.025013+0000","last_became_active":"2024-04-25T13:16:12.734390+0000","last_became_peered":"2024-04-25T13:16:12.734390+0000","last_unstale":"2024-04-25T13:16:14.025013+0000","last_undegraded":"2024-04-25T13:16:14.025013+0000","last_fullsized":"2024-04-25T13:16:14.025013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:33.941883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025802+0000","last_change":"2024-04-25T13:16:06.999440+0000","last_active":"2024-04-25T13:16:14.025802+0000","last_peered":"2024-04-25T13:16:14.025802+0000","last_clean":"2024-04-25T13:16:14.025802+0000","last_became_active":"2024-04-25T13:16:06.999078+0000","last_became_peered":"2024-04-25T13:16:06.999078+0000","last_unstale":"2024-04-25T13:16:14.025802+0000","last_undegraded":"2024-04-25T13:16:14.025802+0000","last_fullsized":"2024-04-25T13:16:14.025802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.819349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090243+0000","last_change":"2024-04-25T13:16:08.012743+0000","last_active":"2024-04-25T13:16:14.090243+0000","last_peered":"2024-04-25T13:16:14.090243+0000","last_clean":"2024-04-25T13:16:14.090243+0000","last_became_active":"2024-04-25T13:16:08.012036+0000","last_became_peered":"2024-04-25T13:16:08.012036+0000","last_unstale":"2024-04-25T13:16:14.090243+0000","last_undegraded":"2024-04-25T13:16:14.090243+0000","last_fullsized":"2024-04-25T13:16:14.090243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.959146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091482+0000","last_change":"2024-04-25T13:16:12.038266+0000","last_active":"2024-04-25T13:16:14.091482+0000","last_peered":"2024-04-25T13:16:14.091482+0000","last_clean":"2024-04-25T13:16:14.091482+0000","last_became_active":"2024-04-25T13:16:12.037796+0000","last_became_peered":"2024-04-25T13:16:12.037796+0000","last_unstale":"2024-04-25T13:16:14.091482+0000","last_undegraded":"2024-04-25T13:16:14.091482+0000","last_fullsized":"2024-04-25T13:16:14.091482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:44.953964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092596+0000","last_change":"2024-04-25T13:16:07.001022+0000","last_active":"2024-04-25T13:16:14.092596+0000","last_peered":"2024-04-25T13:16:14.092596+0000","last_clean":"2024-04-25T13:16:14.092596+0000","last_became_active":"2024-04-25T13:16:07.000751+0000","last_became_peered":"2024-04-25T13:16:07.000751+0000","last_unstale":"2024-04-25T13:16:14.092596+0000","last_undegraded":"2024-04-25T13:16:14.092596+0000","last_fullsized":"2024-04-25T13:16:14.092596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:11.597397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025512+0000","last_change":"2024-04-25T13:16:08.011361+0000","last_active":"2024-04-25T13:16:14.025512+0000","last_peered":"2024-04-25T13:16:14.025512+0000","last_clean":"2024-04-25T13:16:14.025512+0000","last_became_active":"2024-04-25T13:16:08.011073+0000","last_became_peered":"2024-04-25T13:16:08.011073+0000","last_unstale":"2024-04-25T13:16:14.025512+0000","last_undegraded":"2024-04-25T13:16:14.025512+0000","last_fullsized":"2024-04-25T13:16:14.025512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:00.471410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091957+0000","last_change":"2024-04-25T13:16:12.043732+0000","last_active":"2024-04-25T13:16:14.091957+0000","last_peered":"2024-04-25T13:16:14.091957+0000","last_clean":"2024-04-25T13:16:14.091957+0000","last_became_active":"2024-04-25T13:16:12.043264+0000","last_became_peered":"2024-04-25T13:16:12.043264+0000","last_unstale":"2024-04-25T13:16:14.091957+0000","last_undegraded":"2024-04-25T13:16:14.091957+0000","last_fullsized":"2024-04-25T13:16:14.091957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:39.974518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092358+0000","last_change":"2024-04-25T13:16:07.003774+0000","last_active":"2024-04-25T13:16:14.092358+0000","last_peered":"2024-04-25T13:16:14.092358+0000","last_clean":"2024-04-25T13:16:14.092358+0000","last_became_active":"2024-04-25T13:16:07.003493+0000","last_became_peered":"2024-04-25T13:16:07.003493+0000","last_unstale":"2024-04-25T13:16:14.092358+0000","last_undegraded":"2024-04-25T13:16:14.092358+0000","last_fullsized":"2024-04-25T13:16:14.092358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:12.940812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025735+0000","last_change":"2024-04-25T13:16:08.012084+0000","last_active":"2024-04-25T13:16:14.025735+0000","last_peered":"2024-04-25T13:16:14.025735+0000","last_clean":"2024-04-25T13:16:14.025735+0000","last_became_active":"2024-04-25T13:16:08.011634+0000","last_became_peered":"2024-04-25T13:16:08.011634+0000","last_unstale":"2024-04-25T13:16:14.025735+0000","last_undegraded":"2024-04-25T13:16:14.025735+0000","last_fullsized":"2024-04-25T13:16:14.025735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:26.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091223+0000","last_change":"2024-04-25T13:16:12.039238+0000","last_active":"2024-04-25T13:16:14.091223+0000","last_peered":"2024-04-25T13:16:14.091223+0000","last_clean":"2024-04-25T13:16:14.091223+0000","last_became_active":"2024-04-25T13:16:12.038508+0000","last_became_peered":"2024-04-25T13:16:12.038508+0000","last_unstale":"2024-04-25T13:16:14.091223+0000","last_undegraded":"2024-04-25T13:16:14.091223+0000","last_fullsized":"2024-04-25T13:16:14.091223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:22.183373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090787+0000","last_change":"2024-04-25T13:16:08.007741+0000","last_active":"2024-04-25T13:16:14.090787+0000","last_peered":"2024-04-25T13:16:14.090787+0000","last_clean":"2024-04-25T13:16:14.090787+0000","last_became_active":"2024-04-25T13:16:08.007478+0000","last_became_peered":"2024-04-25T13:16:08.007478+0000","last_unstale":"2024-04-25T13:16:14.090787+0000","last_undegraded":"2024-04-25T13:16:14.090787+0000","last_fullsized":"2024-04-25T13:16:14.090787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:49.162203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091567+0000","last_change":"2024-04-25T13:16:07.001183+0000","last_active":"2024-04-25T13:16:14.091567+0000","last_peered":"2024-04-25T13:16:14.091567+0000","last_clean":"2024-04-25T13:16:14.091567+0000","last_became_active":"2024-04-25T13:16:07.000880+0000","last_became_peered":"2024-04-25T13:16:07.000880+0000","last_unstale":"2024-04-25T13:16:14.091567+0000","last_undegraded":"2024-04-25T13:16:14.091567+0000","last_fullsized":"2024-04-25T13:16:14.091567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.250349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091408+0000","last_change":"2024-04-25T13:16:12.037074+0000","last_active":"2024-04-25T13:16:14.091408+0000","last_peered":"2024-04-25T13:16:14.091408+0000","last_clean":"2024-04-25T13:16:14.091408+0000","last_became_active":"2024-04-25T13:16:12.036508+0000","last_became_peered":"2024-04-25T13:16:12.036508+0000","last_unstale":"2024-04-25T13:16:14.091408+0000","last_undegraded":"2024-04-25T13:16:14.091408+0000","last_fullsized":"2024-04-25T13:16:14.091408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:01.380469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025437+0000","last_change":"2024-04-25T13:16:08.013538+0000","last_active":"2024-04-25T13:16:14.025437+0000","last_peered":"2024-04-25T13:16:14.025437+0000","last_clean":"2024-04-25T13:16:14.025437+0000","last_became_active":"2024-04-25T13:16:08.013269+0000","last_became_peered":"2024-04-25T13:16:08.013269+0000","last_unstale":"2024-04-25T13:16:14.025437+0000","last_undegraded":"2024-04-25T13:16:14.025437+0000","last_fullsized":"2024-04-25T13:16:14.025437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:05.313768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022116+0000","last_change":"2024-04-25T13:16:06.994106+0000","last_active":"2024-04-25T13:16:14.022116+0000","last_peered":"2024-04-25T13:16:14.022116+0000","last_clean":"2024-04-25T13:16:14.022116+0000","last_became_active":"2024-04-25T13:16:06.993807+0000","last_became_peered":"2024-04-25T13:16:06.993807+0000","last_unstale":"2024-04-25T13:16:14.022116+0000","last_undegraded":"2024-04-25T13:16:14.022116+0000","last_fullsized":"2024-04-25T13:16:14.022116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:53.706175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091111+0000","last_change":"2024-04-25T13:16:12.039421+0000","last_active":"2024-04-25T13:16:14.091111+0000","last_peered":"2024-04-25T13:16:14.091111+0000","last_clean":"2024-04-25T13:16:14.091111+0000","last_became_active":"2024-04-25T13:16:12.038953+0000","last_became_peered":"2024-04-25T13:16:12.038953+0000","last_unstale":"2024-04-25T13:16:14.091111+0000","last_undegraded":"2024-04-25T13:16:14.091111+0000","last_fullsized":"2024-04-25T13:16:14.091111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:26.714224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025194+0000","last_change":"2024-04-25T13:16:08.008978+0000","last_active":"2024-04-25T13:16:14.025194+0000","last_peered":"2024-04-25T13:16:14.025194+0000","last_clean":"2024-04-25T13:16:14.025194+0000","last_became_active":"2024-04-25T13:16:08.008446+0000","last_became_peered":"2024-04-25T13:16:08.008446+0000","last_unstale":"2024-04-25T13:16:14.025194+0000","last_undegraded":"2024-04-25T13:16:14.025194+0000","last_fullsized":"2024-04-25T13:16:14.025194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:34.604344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021762+0000","last_change":"2024-04-25T13:16:06.992902+0000","last_active":"2024-04-25T13:16:14.021762+0000","last_peered":"2024-04-25T13:16:14.021762+0000","last_clean":"2024-04-25T13:16:14.021762+0000","last_became_active":"2024-04-25T13:16:06.992593+0000","last_became_peered":"2024-04-25T13:16:06.992593+0000","last_unstale":"2024-04-25T13:16:14.021762+0000","last_undegraded":"2024-04-25T13:16:14.021762+0000","last_fullsized":"2024-04-25T13:16:14.021762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:57.665455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022580+0000","last_change":"2024-04-25T13:16:12.735412+0000","last_active":"2024-04-25T13:16:14.022580+0000","last_peered":"2024-04-25T13:16:14.022580+0000","last_clean":"2024-04-25T13:16:14.022580+0000","last_became_active":"2024-04-25T13:16:12.733485+0000","last_became_peered":"2024-04-25T13:16:12.733485+0000","last_unstale":"2024-04-25T13:16:14.022580+0000","last_undegraded":"2024-04-25T13:16:14.022580+0000","last_fullsized":"2024-04-25T13:16:14.022580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:25.265696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092136+0000","last_change":"2024-04-25T13:16:07.998941+0000","last_active":"2024-04-25T13:16:14.092136+0000","last_peered":"2024-04-25T13:16:14.092136+0000","last_clean":"2024-04-25T13:16:14.092136+0000","last_became_active":"2024-04-25T13:16:07.998658+0000","last_became_peered":"2024-04-25T13:16:07.998658+0000","last_unstale":"2024-04-25T13:16:14.092136+0000","last_undegraded":"2024-04-25T13:16:14.092136+0000","last_fullsized":"2024-04-25T13:16:14.092136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:45.473269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090361+0000","last_change":"2024-04-25T13:16:07.001542+0000","last_active":"2024-04-25T13:16:14.090361+0000","last_peered":"2024-04-25T13:16:14.090361+0000","last_clean":"2024-04-25T13:16:14.090361+0000","last_became_active":"2024-04-25T13:16:07.000846+0000","last_became_peered":"2024-04-25T13:16:07.000846+0000","last_unstale":"2024-04-25T13:16:14.090361+0000","last_undegraded":"2024-04-25T13:16:14.090361+0000","last_fullsized":"2024-04-25T13:16:14.090361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:41.121978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091648+0000","last_change":"2024-04-25T13:16:12.038493+0000","last_active":"2024-04-25T13:16:14.091648+0000","last_peered":"2024-04-25T13:16:14.091648+0000","last_clean":"2024-04-25T13:16:14.091648+0000","last_became_active":"2024-04-25T13:16:12.038032+0000","last_became_peered":"2024-04-25T13:16:12.038032+0000","last_unstale":"2024-04-25T13:16:14.091648+0000","last_undegraded":"2024-04-25T13:16:14.091648+0000","last_fullsized":"2024-04-25T13:16:14.091648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:40.222480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090898+0000","last_change":"2024-04-25T13:16:07.998444+0000","last_active":"2024-04-25T13:16:14.090898+0000","last_peered":"2024-04-25T13:16:14.090898+0000","last_clean":"2024-04-25T13:16:14.090898+0000","last_became_active":"2024-04-25T13:16:07.998037+0000","last_became_peered":"2024-04-25T13:16:07.998037+0000","last_unstale":"2024-04-25T13:16:14.090898+0000","last_undegraded":"2024-04-25T13:16:14.090898+0000","last_fullsized":"2024-04-25T13:16:14.090898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:35.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091994+0000","last_change":"2024-04-25T13:16:06.995706+0000","last_active":"2024-04-25T13:16:14.091994+0000","last_peered":"2024-04-25T13:16:14.091994+0000","last_clean":"2024-04-25T13:16:14.091994+0000","last_became_active":"2024-04-25T13:16:06.995420+0000","last_became_peered":"2024-04-25T13:16:06.995420+0000","last_unstale":"2024-04-25T13:16:14.091994+0000","last_undegraded":"2024-04-25T13:16:14.091994+0000","last_fullsized":"2024-04-25T13:16:14.091994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:08.672949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091752+0000","last_change":"2024-04-25T13:16:12.734165+0000","last_active":"2024-04-25T13:16:14.091752+0000","last_peered":"2024-04-25T13:16:14.091752+0000","last_clean":"2024-04-25T13:16:14.091752+0000","last_became_active":"2024-04-25T13:16:12.733772+0000","last_became_peered":"2024-04-25T13:16:12.733772+0000","last_unstale":"2024-04-25T13:16:14.091752+0000","last_undegraded":"2024-04-25T13:16:14.091752+0000","last_fullsized":"2024-04-25T13:16:14.091752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:35.716517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025960+0000","last_change":"2024-04-25T13:16:08.017429+0000","last_active":"2024-04-25T13:16:14.025960+0000","last_peered":"2024-04-25T13:16:14.025960+0000","last_clean":"2024-04-25T13:16:14.025960+0000","last_became_active":"2024-04-25T13:16:08.017205+0000","last_became_peered":"2024-04-25T13:16:08.017205+0000","last_unstale":"2024-04-25T13:16:14.025960+0000","last_undegraded":"2024-04-25T13:16:14.025960+0000","last_fullsized":"2024-04-25T13:16:14.025960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.383669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022539+0000","last_change":"2024-04-25T13:16:06.992063+0000","last_active":"2024-04-25T13:16:14.022539+0000","last_peered":"2024-04-25T13:16:14.022539+0000","last_clean":"2024-04-25T13:16:14.022539+0000","last_became_active":"2024-04-25T13:16:06.991766+0000","last_became_peered":"2024-04-25T13:16:06.991766+0000","last_unstale":"2024-04-25T13:16:14.022539+0000","last_undegraded":"2024-04-25T13:16:14.022539+0000","last_fullsized":"2024-04-25T13:16:14.022539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:25.728063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.024950+0000","last_change":"2024-04-25T13:16:12.734837+0000","last_active":"2024-04-25T13:16:14.024950+0000","last_peered":"2024-04-25T13:16:14.024950+0000","last_clean":"2024-04-25T13:16:14.024950+0000","last_became_active":"2024-04-25T13:16:12.734394+0000","last_became_peered":"2024-04-25T13:16:12.734394+0000","last_unstale":"2024-04-25T13:16:14.024950+0000","last_undegraded":"2024-04-25T13:16:14.024950+0000","last_fullsized":"2024-04-25T13:16:14.024950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:24.740929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022045+0000","last_change":"2024-04-25T13:16:08.000277+0000","last_active":"2024-04-25T13:16:14.022045+0000","last_peered":"2024-04-25T13:16:14.022045+0000","last_clean":"2024-04-25T13:16:14.022045+0000","last_became_active":"2024-04-25T13:16:07.999797+0000","last_became_peered":"2024-04-25T13:16:07.999797+0000","last_unstale":"2024-04-25T13:16:14.022045+0000","last_undegraded":"2024-04-25T13:16:14.022045+0000","last_fullsized":"2024-04-25T13:16:14.022045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:08.860755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092740+0000","last_change":"2024-04-25T13:16:07.002146+0000","last_active":"2024-04-25T13:16:14.092740+0000","last_peered":"2024-04-25T13:16:14.092740+0000","last_clean":"2024-04-25T13:16:14.092740+0000","last_became_active":"2024-04-25T13:16:07.001918+0000","last_became_peered":"2024-04-25T13:16:07.001918+0000","last_unstale":"2024-04-25T13:16:14.092740+0000","last_undegraded":"2024-04-25T13:16:14.092740+0000","last_fullsized":"2024-04-25T13:16:14.092740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:38.326719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090806+0000","last_change":"2024-04-25T13:16:12.733744+0000","last_active":"2024-04-25T13:16:14.090806+0000","last_peered":"2024-04-25T13:16:14.090806+0000","last_clean":"2024-04-25T13:16:14.090806+0000","last_became_active":"2024-04-25T13:16:12.733361+0000","last_became_peered":"2024-04-25T13:16:12.733361+0000","last_unstale":"2024-04-25T13:16:14.090806+0000","last_undegraded":"2024-04-25T13:16:14.090806+0000","last_fullsized":"2024-04-25T13:16:14.090806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:39.178837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025844+0000","last_change":"2024-04-25T13:16:08.016667+0000","last_active":"2024-04-25T13:16:14.025844+0000","last_peered":"2024-04-25T13:16:14.025844+0000","last_clean":"2024-04-25T13:16:14.025844+0000","last_became_active":"2024-04-25T13:16:08.015172+0000","last_became_peered":"2024-04-25T13:16:08.015172+0000","last_unstale":"2024-04-25T13:16:14.025844+0000","last_undegraded":"2024-04-25T13:16:14.025844+0000","last_fullsized":"2024-04-25T13:16:14.025844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:40.786954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022161+0000","last_change":"2024-04-25T13:16:06.996301+0000","last_active":"2024-04-25T13:16:14.022161+0000","last_peered":"2024-04-25T13:16:14.022161+0000","last_clean":"2024-04-25T13:16:14.022161+0000","last_became_active":"2024-04-25T13:16:06.995957+0000","last_became_peered":"2024-04-25T13:16:06.995957+0000","last_unstale":"2024-04-25T13:16:14.022161+0000","last_undegraded":"2024-04-25T13:16:14.022161+0000","last_fullsized":"2024-04-25T13:16:14.022161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:16.802775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021893+0000","last_change":"2024-04-25T13:16:12.040987+0000","last_active":"2024-04-25T13:16:14.021893+0000","last_peered":"2024-04-25T13:16:14.021893+0000","last_clean":"2024-04-25T13:16:14.021893+0000","last_became_active":"2024-04-25T13:16:12.039987+0000","last_became_peered":"2024-04-25T13:16:12.039987+0000","last_unstale":"2024-04-25T13:16:14.021893+0000","last_undegraded":"2024-04-25T13:16:14.021893+0000","last_fullsized":"2024-04-25T13:16:14.021893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:40.366718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092137+0000","last_change":"2024-04-25T13:16:08.002876+0000","last_active":"2024-04-25T13:16:14.092137+0000","last_peered":"2024-04-25T13:16:14.092137+0000","last_clean":"2024-04-25T13:16:14.092137+0000","last_became_active":"2024-04-25T13:16:08.002131+0000","last_became_peered":"2024-04-25T13:16:08.002131+0000","last_unstale":"2024-04-25T13:16:14.092137+0000","last_undegraded":"2024-04-25T13:16:14.092137+0000","last_fullsized":"2024-04-25T13:16:14.092137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:09.646849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.026081+0000","last_change":"2024-04-25T13:16:06.990075+0000","last_active":"2024-04-25T13:16:14.026081+0000","last_peered":"2024-04-25T13:16:14.026081+0000","last_clean":"2024-04-25T13:16:14.026081+0000","last_became_active":"2024-04-25T13:16:06.989652+0000","last_became_peered":"2024-04-25T13:16:06.989652+0000","last_unstale":"2024-04-25T13:16:14.026081+0000","last_undegraded":"2024-04-25T13:16:14.026081+0000","last_fullsized":"2024-04-25T13:16:14.026081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:29.378995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022100+0000","last_change":"2024-04-25T13:16:12.032906+0000","last_active":"2024-04-25T13:16:14.022100+0000","last_peered":"2024-04-25T13:16:14.022100+0000","last_clean":"2024-04-25T13:16:14.022100+0000","last_became_active":"2024-04-25T13:16:12.032184+0000","last_became_peered":"2024-04-25T13:16:12.032184+0000","last_unstale":"2024-04-25T13:16:14.022100+0000","last_undegraded":"2024-04-25T13:16:14.022100+0000","last_fullsized":"2024-04-25T13:16:14.022100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.724927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021878+0000","last_change":"2024-04-25T13:16:07.997173+0000","last_active":"2024-04-25T13:16:14.021878+0000","last_peered":"2024-04-25T13:16:14.021878+0000","last_clean":"2024-04-25T13:16:14.021878+0000","last_became_active":"2024-04-25T13:16:07.996545+0000","last_became_peered":"2024-04-25T13:16:07.996545+0000","last_unstale":"2024-04-25T13:16:14.021878+0000","last_undegraded":"2024-04-25T13:16:14.021878+0000","last_fullsized":"2024-04-25T13:16:14.021878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:28.902563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089861+0000","last_change":"2024-04-25T13:16:06.993674+0000","last_active":"2024-04-25T13:16:14.089861+0000","last_peered":"2024-04-25T13:16:14.089861+0000","last_clean":"2024-04-25T13:16:14.089861+0000","last_became_active":"2024-04-25T13:16:06.993387+0000","last_became_peered":"2024-04-25T13:16:06.993387+0000","last_unstale":"2024-04-25T13:16:14.089861+0000","last_undegraded":"2024-04-25T13:16:14.089861+0000","last_fullsized":"2024-04-25T13:16:14.089861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:13.104822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022616+0000","last_change":"2024-04-25T13:16:12.037015+0000","last_active":"2024-04-25T13:16:14.022616+0000","last_peered":"2024-04-25T13:16:14.022616+0000","last_clean":"2024-04-25T13:16:14.022616+0000","last_became_active":"2024-04-25T13:16:12.036634+0000","last_became_peered":"2024-04-25T13:16:12.036634+0000","last_unstale":"2024-04-25T13:16:14.022616+0000","last_undegraded":"2024-04-25T13:16:14.022616+0000","last_fullsized":"2024-04-25T13:16:14.022616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:12.986396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090465+0000","last_change":"2024-04-25T13:16:08.004209+0000","last_active":"2024-04-25T13:16:14.090465+0000","last_peered":"2024-04-25T13:16:14.090465+0000","last_clean":"2024-04-25T13:16:14.090465+0000","last_became_active":"2024-04-25T13:16:08.003908+0000","last_became_peered":"2024-04-25T13:16:08.003908+0000","last_unstale":"2024-04-25T13:16:14.090465+0000","last_undegraded":"2024-04-25T13:16:14.090465+0000","last_fullsized":"2024-04-25T13:16:14.090465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:17.027888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090460+0000","last_change":"2024-04-25T13:16:06.999384+0000","last_active":"2024-04-25T13:16:14.090460+0000","last_peered":"2024-04-25T13:16:14.090460+0000","last_clean":"2024-04-25T13:16:14.090460+0000","last_became_active":"2024-04-25T13:16:06.999126+0000","last_became_peered":"2024-04-25T13:16:06.999126+0000","last_unstale":"2024-04-25T13:16:14.090460+0000","last_undegraded":"2024-04-25T13:16:14.090460+0000","last_fullsized":"2024-04-25T13:16:14.090460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:50.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090826+0000","last_change":"2024-04-25T13:16:12.733992+0000","last_active":"2024-04-25T13:16:14.090826+0000","last_peered":"2024-04-25T13:16:14.090826+0000","last_clean":"2024-04-25T13:16:14.090826+0000","last_became_active":"2024-04-25T13:16:12.733316+0000","last_became_peered":"2024-04-25T13:16:12.733316+0000","last_unstale":"2024-04-25T13:16:14.090826+0000","last_undegraded":"2024-04-25T13:16:14.090826+0000","last_fullsized":"2024-04-25T13:16:14.090826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:54.246728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025262+0000","last_change":"2024-04-25T13:16:08.021617+0000","last_active":"2024-04-25T13:16:14.025262+0000","last_peered":"2024-04-25T13:16:14.025262+0000","last_clean":"2024-04-25T13:16:14.025262+0000","last_became_active":"2024-04-25T13:16:08.021346+0000","last_became_peered":"2024-04-25T13:16:08.021346+0000","last_unstale":"2024-04-25T13:16:14.025262+0000","last_undegraded":"2024-04-25T13:16:14.025262+0000","last_fullsized":"2024-04-25T13:16:14.025262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:10.013805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025437+0000","last_change":"2024-04-25T13:16:06.990638+0000","last_active":"2024-04-25T13:16:14.025437+0000","last_peered":"2024-04-25T13:16:14.025437+0000","last_clean":"2024-04-25T13:16:14.025437+0000","last_became_active":"2024-04-25T13:16:06.990379+0000","last_became_peered":"2024-04-25T13:16:06.990379+0000","last_unstale":"2024-04-25T13:16:14.025437+0000","last_undegraded":"2024-04-25T13:16:14.025437+0000","last_fullsized":"2024-04-25T13:16:14.025437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:39.385990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090466+0000","last_change":"2024-04-25T13:15:57.168598+0000","last_active":"2024-04-25T13:16:14.090466+0000","last_peered":"2024-04-25T13:16:14.090466+0000","last_clean":"2024-04-25T13:16:14.090466+0000","last_became_active":"2024-04-25T13:15:57.167692+0000","last_became_peered":"2024-04-25T13:15:57.167692+0000","last_unstale":"2024-04-25T13:16:14.090466+0000","last_undegraded":"2024-04-25T13:16:14.090466+0000","last_fullsized":"2024-04-25T13:16:14.090466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_clean_scrub_stamp":"2024-04-25T13:15:55.844647+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:29.123100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091126+0000","last_change":"2024-04-25T13:16:12.734712+0000","last_active":"2024-04-25T13:16:14.091126+0000","last_peered":"2024-04-25T13:16:14.091126+0000","last_clean":"2024-04-25T13:16:14.091126+0000","last_became_active":"2024-04-25T13:16:12.734288+0000","last_became_peered":"2024-04-25T13:16:12.734288+0000","last_unstale":"2024-04-25T13:16:14.091126+0000","last_undegraded":"2024-04-25T13:16:14.091126+0000","last_fullsized":"2024-04-25T13:16:14.091126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:45.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092489+0000","last_change":"2024-04-25T13:16:08.014279+0000","last_active":"2024-04-25T13:16:14.092489+0000","last_peered":"2024-04-25T13:16:14.092489+0000","last_clean":"2024-04-25T13:16:14.092489+0000","last_became_active":"2024-04-25T13:16:08.013989+0000","last_became_peered":"2024-04-25T13:16:08.013989+0000","last_unstale":"2024-04-25T13:16:14.092489+0000","last_undegraded":"2024-04-25T13:16:14.092489+0000","last_fullsized":"2024-04-25T13:16:14.092489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:54.411981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090165+0000","last_change":"2024-04-25T13:16:06.996774+0000","last_active":"2024-04-25T13:16:14.090165+0000","last_peered":"2024-04-25T13:16:14.090165+0000","last_clean":"2024-04-25T13:16:14.090165+0000","last_became_active":"2024-04-25T13:16:06.996251+0000","last_became_peered":"2024-04-25T13:16:06.996251+0000","last_unstale":"2024-04-25T13:16:14.090165+0000","last_undegraded":"2024-04-25T13:16:14.090165+0000","last_fullsized":"2024-04-25T13:16:14.090165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:01.815602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090885+0000","last_change":"2024-04-25T13:16:12.733562+0000","last_active":"2024-04-25T13:16:14.090885+0000","last_peered":"2024-04-25T13:16:14.090885+0000","last_clean":"2024-04-25T13:16:14.090885+0000","last_became_active":"2024-04-25T13:16:12.733114+0000","last_became_peered":"2024-04-25T13:16:12.733114+0000","last_unstale":"2024-04-25T13:16:14.090885+0000","last_undegraded":"2024-04-25T13:16:14.090885+0000","last_fullsized":"2024-04-25T13:16:14.090885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:20.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025577+0000","last_change":"2024-04-25T13:16:08.011389+0000","last_active":"2024-04-25T13:16:14.025577+0000","last_peered":"2024-04-25T13:16:14.025577+0000","last_clean":"2024-04-25T13:16:14.025577+0000","last_became_active":"2024-04-25T13:16:08.011113+0000","last_became_peered":"2024-04-25T13:16:08.011113+0000","last_unstale":"2024-04-25T13:16:14.025577+0000","last_undegraded":"2024-04-25T13:16:14.025577+0000","last_fullsized":"2024-04-25T13:16:14.025577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:12.339487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022376+0000","last_change":"2024-04-25T13:16:06.988988+0000","last_active":"2024-04-25T13:16:14.022376+0000","last_peered":"2024-04-25T13:16:14.022376+0000","last_clean":"2024-04-25T13:16:14.022376+0000","last_became_active":"2024-04-25T13:16:06.988631+0000","last_became_peered":"2024-04-25T13:16:06.988631+0000","last_unstale":"2024-04-25T13:16:14.022376+0000","last_undegraded":"2024-04-25T13:16:14.022376+0000","last_fullsized":"2024-04-25T13:16:14.022376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:47.056977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090922+0000","last_change":"2024-04-25T13:16:12.047194+0000","last_active":"2024-04-25T13:16:14.090922+0000","last_peered":"2024-04-25T13:16:14.090922+0000","last_clean":"2024-04-25T13:16:14.090922+0000","last_became_active":"2024-04-25T13:16:12.046780+0000","last_became_peered":"2024-04-25T13:16:12.046780+0000","last_unstale":"2024-04-25T13:16:14.090922+0000","last_undegraded":"2024-04-25T13:16:14.090922+0000","last_fullsized":"2024-04-25T13:16:14.090922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:41.664409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092850+0000","last_change":"2024-04-25T13:16:08.007925+0000","last_active":"2024-04-25T13:16:14.092850+0000","last_peered":"2024-04-25T13:16:14.092850+0000","last_clean":"2024-04-25T13:16:14.092850+0000","last_became_active":"2024-04-25T13:16:08.007681+0000","last_became_peered":"2024-04-25T13:16:08.007681+0000","last_unstale":"2024-04-25T13:16:14.092850+0000","last_undegraded":"2024-04-25T13:16:14.092850+0000","last_fullsized":"2024-04-25T13:16:14.092850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:29.601564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090519+0000","last_change":"2024-04-25T13:16:06.991912+0000","last_active":"2024-04-25T13:16:14.090519+0000","last_peered":"2024-04-25T13:16:14.090519+0000","last_clean":"2024-04-25T13:16:14.090519+0000","last_became_active":"2024-04-25T13:16:06.991578+0000","last_became_peered":"2024-04-25T13:16:06.991578+0000","last_unstale":"2024-04-25T13:16:14.090519+0000","last_undegraded":"2024-04-25T13:16:14.090519+0000","last_fullsized":"2024-04-25T13:16:14.090519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:59.364396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025152+0000","last_change":"2024-04-25T13:16:12.733567+0000","last_active":"2024-04-25T13:16:14.025152+0000","last_peered":"2024-04-25T13:16:14.025152+0000","last_clean":"2024-04-25T13:16:14.025152+0000","last_became_active":"2024-04-25T13:16:12.733136+0000","last_became_peered":"2024-04-25T13:16:12.733136+0000","last_unstale":"2024-04-25T13:16:14.025152+0000","last_undegraded":"2024-04-25T13:16:14.025152+0000","last_fullsized":"2024-04-25T13:16:14.025152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:29.125928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092741+0000","last_change":"2024-04-25T13:16:08.004897+0000","last_active":"2024-04-25T13:16:14.092741+0000","last_peered":"2024-04-25T13:16:14.092741+0000","last_clean":"2024-04-25T13:16:14.092741+0000","last_became_active":"2024-04-25T13:16:08.004180+0000","last_became_peered":"2024-04-25T13:16:08.004180+0000","last_unstale":"2024-04-25T13:16:14.092741+0000","last_undegraded":"2024-04-25T13:16:14.092741+0000","last_fullsized":"2024-04-25T13:16:14.092741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:12.011447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090973+0000","last_change":"2024-04-25T13:16:06.994487+0000","last_active":"2024-04-25T13:16:14.090973+0000","last_peered":"2024-04-25T13:16:14.090973+0000","last_clean":"2024-04-25T13:16:14.090973+0000","last_became_active":"2024-04-25T13:16:06.994235+0000","last_became_peered":"2024-04-25T13:16:06.994235+0000","last_unstale":"2024-04-25T13:16:14.090973+0000","last_undegraded":"2024-04-25T13:16:14.090973+0000","last_fullsized":"2024-04-25T13:16:14.090973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091573+0000","last_change":"2024-04-25T13:16:12.039277+0000","last_active":"2024-04-25T13:16:14.091573+0000","last_peered":"2024-04-25T13:16:14.091573+0000","last_clean":"2024-04-25T13:16:14.091573+0000","last_became_active":"2024-04-25T13:16:12.038534+0000","last_became_peered":"2024-04-25T13:16:12.038534+0000","last_unstale":"2024-04-25T13:16:14.091573+0000","last_undegraded":"2024-04-25T13:16:14.091573+0000","last_fullsized":"2024-04-25T13:16:14.091573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:59.495976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090745+0000","last_change":"2024-04-25T13:16:08.007302+0000","last_active":"2024-04-25T13:16:14.090745+0000","last_peered":"2024-04-25T13:16:14.090745+0000","last_clean":"2024-04-25T13:16:14.090745+0000","last_became_active":"2024-04-25T13:16:08.007050+0000","last_became_peered":"2024-04-25T13:16:08.007050+0000","last_unstale":"2024-04-25T13:16:14.090745+0000","last_undegraded":"2024-04-25T13:16:14.090745+0000","last_fullsized":"2024-04-25T13:16:14.090745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:35.369188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089708+0000","last_change":"2024-04-25T13:16:06.982609+0000","last_active":"2024-04-25T13:16:14.089708+0000","last_peered":"2024-04-25T13:16:14.089708+0000","last_clean":"2024-04-25T13:16:14.089708+0000","last_became_active":"2024-04-25T13:16:06.982320+0000","last_became_peered":"2024-04-25T13:16:06.982320+0000","last_unstale":"2024-04-25T13:16:14.089708+0000","last_undegraded":"2024-04-25T13:16:14.089708+0000","last_fullsized":"2024-04-25T13:16:14.089708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:55.372968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090845+0000","last_change":"2024-04-25T13:16:12.043657+0000","last_active":"2024-04-25T13:16:14.090845+0000","last_peered":"2024-04-25T13:16:14.090845+0000","last_clean":"2024-04-25T13:16:14.090845+0000","last_became_active":"2024-04-25T13:16:12.042902+0000","last_became_peered":"2024-04-25T13:16:12.042902+0000","last_unstale":"2024-04-25T13:16:14.090845+0000","last_undegraded":"2024-04-25T13:16:14.090845+0000","last_fullsized":"2024-04-25T13:16:14.090845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:46.721199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090854+0000","last_change":"2024-04-25T13:16:08.008534+0000","last_active":"2024-04-25T13:16:14.090854+0000","last_peered":"2024-04-25T13:16:14.090854+0000","last_clean":"2024-04-25T13:16:14.090854+0000","last_became_active":"2024-04-25T13:16:08.008102+0000","last_became_peered":"2024-04-25T13:16:08.008102+0000","last_unstale":"2024-04-25T13:16:14.090854+0000","last_undegraded":"2024-04-25T13:16:14.090854+0000","last_fullsized":"2024-04-25T13:16:14.090854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:48.331724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091187+0000","last_change":"2024-04-25T13:16:06.993292+0000","last_active":"2024-04-25T13:16:14.091187+0000","last_peered":"2024-04-25T13:16:14.091187+0000","last_clean":"2024-04-25T13:16:14.091187+0000","last_became_active":"2024-04-25T13:16:06.993008+0000","last_became_peered":"2024-04-25T13:16:06.993008+0000","last_unstale":"2024-04-25T13:16:14.091187+0000","last_undegraded":"2024-04-25T13:16:14.091187+0000","last_fullsized":"2024-04-25T13:16:14.091187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025971+0000","last_change":"2024-04-25T13:16:12.733945+0000","last_active":"2024-04-25T13:16:14.025971+0000","last_peered":"2024-04-25T13:16:14.025971+0000","last_clean":"2024-04-25T13:16:14.025971+0000","last_became_active":"2024-04-25T13:16:12.733359+0000","last_became_peered":"2024-04-25T13:16:12.733359+0000","last_unstale":"2024-04-25T13:16:14.025971+0000","last_undegraded":"2024-04-25T13:16:14.025971+0000","last_fullsized":"2024-04-25T13:16:14.025971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:27.352613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091472+0000","last_change":"2024-04-25T13:16:08.008034+0000","last_active":"2024-04-25T13:16:14.091472+0000","last_peered":"2024-04-25T13:16:14.091472+0000","last_clean":"2024-04-25T13:16:14.091472+0000","last_became_active":"2024-04-25T13:16:08.007790+0000","last_became_peered":"2024-04-25T13:16:08.007790+0000","last_unstale":"2024-04-25T13:16:14.091472+0000","last_undegraded":"2024-04-25T13:16:14.091472+0000","last_fullsized":"2024-04-25T13:16:14.091472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:35.903237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.026057+0000","last_change":"2024-04-25T13:16:06.996737+0000","last_active":"2024-04-25T13:16:14.026057+0000","last_peered":"2024-04-25T13:16:14.026057+0000","last_clean":"2024-04-25T13:16:14.026057+0000","last_became_active":"2024-04-25T13:16:06.996439+0000","last_became_peered":"2024-04-25T13:16:06.996439+0000","last_unstale":"2024-04-25T13:16:14.026057+0000","last_undegraded":"2024-04-25T13:16:14.026057+0000","last_fullsized":"2024-04-25T13:16:14.026057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:36.400030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025695+0000","last_change":"2024-04-25T13:16:12.734393+0000","last_active":"2024-04-25T13:16:14.025695+0000","last_peered":"2024-04-25T13:16:14.025695+0000","last_clean":"2024-04-25T13:16:14.025695+0000","last_became_active":"2024-04-25T13:16:12.733328+0000","last_became_peered":"2024-04-25T13:16:12.733328+0000","last_unstale":"2024-04-25T13:16:14.025695+0000","last_undegraded":"2024-04-25T13:16:14.025695+0000","last_fullsized":"2024-04-25T13:16:14.025695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.254012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090600+0000","last_change":"2024-04-25T13:16:08.000836+0000","last_active":"2024-04-25T13:16:14.090600+0000","last_peered":"2024-04-25T13:16:14.090600+0000","last_clean":"2024-04-25T13:16:14.090600+0000","last_became_active":"2024-04-25T13:16:08.000538+0000","last_became_peered":"2024-04-25T13:16:08.000538+0000","last_unstale":"2024-04-25T13:16:14.090600+0000","last_undegraded":"2024-04-25T13:16:14.090600+0000","last_fullsized":"2024-04-25T13:16:14.090600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:08.742353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090969+0000","last_change":"2024-04-25T13:16:07.000559+0000","last_active":"2024-04-25T13:16:14.090969+0000","last_peered":"2024-04-25T13:16:14.090969+0000","last_clean":"2024-04-25T13:16:14.090969+0000","last_became_active":"2024-04-25T13:16:07.000243+0000","last_became_peered":"2024-04-25T13:16:07.000243+0000","last_unstale":"2024-04-25T13:16:14.090969+0000","last_undegraded":"2024-04-25T13:16:14.090969+0000","last_fullsized":"2024-04-25T13:16:14.090969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:01.672221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025845+0000","last_change":"2024-04-25T13:16:12.733681+0000","last_active":"2024-04-25T13:16:14.025845+0000","last_peered":"2024-04-25T13:16:14.025845+0000","last_clean":"2024-04-25T13:16:14.025845+0000","last_became_active":"2024-04-25T13:16:12.733245+0000","last_became_peered":"2024-04-25T13:16:12.733245+0000","last_unstale":"2024-04-25T13:16:14.025845+0000","last_undegraded":"2024-04-25T13:16:14.025845+0000","last_fullsized":"2024-04-25T13:16:14.025845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.028858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092399+0000","last_change":"2024-04-25T13:16:08.008790+0000","last_active":"2024-04-25T13:16:14.092399+0000","last_peered":"2024-04-25T13:16:14.092399+0000","last_clean":"2024-04-25T13:16:14.092399+0000","last_became_active":"2024-04-25T13:16:08.008530+0000","last_became_peered":"2024-04-25T13:16:08.008530+0000","last_unstale":"2024-04-25T13:16:14.092399+0000","last_undegraded":"2024-04-25T13:16:14.092399+0000","last_fullsized":"2024-04-25T13:16:14.092399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:44.215930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:21.051524+0000","last_change":"2024-04-25T13:16:06.997575+0000","last_active":"2024-04-25T13:16:21.051524+0000","last_peered":"2024-04-25T13:16:21.051524+0000","last_clean":"2024-04-25T13:16:21.051524+0000","last_became_active":"2024-04-25T13:16:06.997289+0000","last_became_peered":"2024-04-25T13:16:06.997289+0000","last_unstale":"2024-04-25T13:16:21.051524+0000","last_undegraded":"2024-04-25T13:16:21.051524+0000","last_fullsized":"2024-04-25T13:16:21.051524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:54.096662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021968+0000","last_change":"2024-04-25T13:16:12.040456+0000","last_active":"2024-04-25T13:16:14.021968+0000","last_peered":"2024-04-25T13:16:14.021968+0000","last_clean":"2024-04-25T13:16:14.021968+0000","last_became_active":"2024-04-25T13:16:12.039443+0000","last_became_peered":"2024-04-25T13:16:12.039443+0000","last_unstale":"2024-04-25T13:16:14.021968+0000","last_undegraded":"2024-04-25T13:16:14.021968+0000","last_fullsized":"2024-04-25T13:16:14.021968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:23.192500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091569+0000","last_change":"2024-04-25T13:16:08.004618+0000","last_active":"2024-04-25T13:16:14.091569+0000","last_peered":"2024-04-25T13:16:14.091569+0000","last_clean":"2024-04-25T13:16:14.091569+0000","last_became_active":"2024-04-25T13:16:08.002583+0000","last_became_peered":"2024-04-25T13:16:08.002583+0000","last_unstale":"2024-04-25T13:16:14.091569+0000","last_undegraded":"2024-04-25T13:16:14.091569+0000","last_fullsized":"2024-04-25T13:16:14.091569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:25.609409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022349+0000","last_change":"2024-04-25T13:16:06.996610+0000","last_active":"2024-04-25T13:16:14.022349+0000","last_peered":"2024-04-25T13:16:14.022349+0000","last_clean":"2024-04-25T13:16:14.022349+0000","last_became_active":"2024-04-25T13:16:06.995616+0000","last_became_peered":"2024-04-25T13:16:06.995616+0000","last_unstale":"2024-04-25T13:16:14.022349+0000","last_undegraded":"2024-04-25T13:16:14.022349+0000","last_fullsized":"2024-04-25T13:16:14.022349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:21.135053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092179+0000","last_change":"2024-04-25T13:16:12.043744+0000","last_active":"2024-04-25T13:16:14.092179+0000","last_peered":"2024-04-25T13:16:14.092179+0000","last_clean":"2024-04-25T13:16:14.092179+0000","last_became_active":"2024-04-25T13:16:12.043267+0000","last_became_peered":"2024-04-25T13:16:12.043267+0000","last_unstale":"2024-04-25T13:16:14.092179+0000","last_undegraded":"2024-04-25T13:16:14.092179+0000","last_fullsized":"2024-04-25T13:16:14.092179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:52.316751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090426+0000","last_change":"2024-04-25T13:16:08.012359+0000","last_active":"2024-04-25T13:16:14.090426+0000","last_peered":"2024-04-25T13:16:14.090426+0000","last_clean":"2024-04-25T13:16:14.090426+0000","last_became_active":"2024-04-25T13:16:08.011295+0000","last_became_peered":"2024-04-25T13:16:08.011295+0000","last_unstale":"2024-04-25T13:16:14.090426+0000","last_undegraded":"2024-04-25T13:16:14.090426+0000","last_fullsized":"2024-04-25T13:16:14.090426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:19.939444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025352+0000","last_change":"2024-04-25T13:16:06.997061+0000","last_active":"2024-04-25T13:16:14.025352+0000","last_peered":"2024-04-25T13:16:14.025352+0000","last_clean":"2024-04-25T13:16:14.025352+0000","last_became_active":"2024-04-25T13:16:06.996418+0000","last_became_peered":"2024-04-25T13:16:06.996418+0000","last_unstale":"2024-04-25T13:16:14.025352+0000","last_undegraded":"2024-04-25T13:16:14.025352+0000","last_fullsized":"2024-04-25T13:16:14.025352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:34.878260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025141+0000","last_change":"2024-04-25T13:16:12.042796+0000","last_active":"2024-04-25T13:16:14.025141+0000","last_peered":"2024-04-25T13:16:14.025141+0000","last_clean":"2024-04-25T13:16:14.025141+0000","last_became_active":"2024-04-25T13:16:12.042252+0000","last_became_peered":"2024-04-25T13:16:12.042252+0000","last_unstale":"2024-04-25T13:16:14.025141+0000","last_undegraded":"2024-04-25T13:16:14.025141+0000","last_fullsized":"2024-04-25T13:16:14.025141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:51.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025295+0000","last_change":"2024-04-25T13:16:08.016203+0000","last_active":"2024-04-25T13:16:14.025295+0000","last_peered":"2024-04-25T13:16:14.025295+0000","last_clean":"2024-04-25T13:16:14.025295+0000","last_became_active":"2024-04-25T13:16:08.015820+0000","last_became_peered":"2024-04-25T13:16:08.015820+0000","last_unstale":"2024-04-25T13:16:14.025295+0000","last_undegraded":"2024-04-25T13:16:14.025295+0000","last_fullsized":"2024-04-25T13:16:14.025295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091794+0000","last_change":"2024-04-25T13:16:06.996624+0000","last_active":"2024-04-25T13:16:14.091794+0000","last_peered":"2024-04-25T13:16:14.091794+0000","last_clean":"2024-04-25T13:16:14.091794+0000","last_became_active":"2024-04-25T13:16:06.996373+0000","last_became_peered":"2024-04-25T13:16:06.996373+0000","last_unstale":"2024-04-25T13:16:14.091794+0000","last_undegraded":"2024-04-25T13:16:14.091794+0000","last_fullsized":"2024-04-25T13:16:14.091794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:29.929030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025097+0000","last_change":"2024-04-25T13:16:12.733792+0000","last_active":"2024-04-25T13:16:14.025097+0000","last_peered":"2024-04-25T13:16:14.025097+0000","last_clean":"2024-04-25T13:16:14.025097+0000","last_became_active":"2024-04-25T13:16:12.733314+0000","last_became_peered":"2024-04-25T13:16:12.733314+0000","last_unstale":"2024-04-25T13:16:14.025097+0000","last_undegraded":"2024-04-25T13:16:14.025097+0000","last_fullsized":"2024-04-25T13:16:14.025097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.836368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090737+0000","last_change":"2024-04-25T13:16:12.734573+0000","last_active":"2024-04-25T13:16:14.090737+0000","last_peered":"2024-04-25T13:16:14.090737+0000","last_clean":"2024-04-25T13:16:14.090737+0000","last_became_active":"2024-04-25T13:16:12.733908+0000","last_became_peered":"2024-04-25T13:16:12.733908+0000","last_unstale":"2024-04-25T13:16:14.090737+0000","last_undegraded":"2024-04-25T13:16:14.090737+0000","last_fullsized":"2024-04-25T13:16:14.090737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:59.673528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021648+0000","last_change":"2024-04-25T13:16:08.008915+0000","last_active":"2024-04-25T13:16:14.021648+0000","last_peered":"2024-04-25T13:16:14.021648+0000","last_clean":"2024-04-25T13:16:14.021648+0000","last_became_active":"2024-04-25T13:16:08.008586+0000","last_became_peered":"2024-04-25T13:16:08.008586+0000","last_unstale":"2024-04-25T13:16:14.021648+0000","last_undegraded":"2024-04-25T13:16:14.021648+0000","last_fullsized":"2024-04-25T13:16:14.021648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:46.905065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025297+0000","last_change":"2024-04-25T13:16:06.994489+0000","last_active":"2024-04-25T13:16:14.025297+0000","last_peered":"2024-04-25T13:16:14.025297+0000","last_clean":"2024-04-25T13:16:14.025297+0000","last_became_active":"2024-04-25T13:16:06.994005+0000","last_became_peered":"2024-04-25T13:16:06.994005+0000","last_unstale":"2024-04-25T13:16:14.025297+0000","last_undegraded":"2024-04-25T13:16:14.025297+0000","last_fullsized":"2024-04-25T13:16:14.025297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:43.921452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091678+0000","last_change":"2024-04-25T13:16:12.037008+0000","last_active":"2024-04-25T13:16:14.091678+0000","last_peered":"2024-04-25T13:16:14.091678+0000","last_clean":"2024-04-25T13:16:14.091678+0000","last_became_active":"2024-04-25T13:16:12.036569+0000","last_became_peered":"2024-04-25T13:16:12.036569+0000","last_unstale":"2024-04-25T13:16:14.091678+0000","last_undegraded":"2024-04-25T13:16:14.091678+0000","last_fullsized":"2024-04-25T13:16:14.091678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:48.224913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025108+0000","last_change":"2024-04-25T13:16:08.008747+0000","last_active":"2024-04-25T13:16:14.025108+0000","last_peered":"2024-04-25T13:16:14.025108+0000","last_clean":"2024-04-25T13:16:14.025108+0000","last_became_active":"2024-04-25T13:16:08.008078+0000","last_became_peered":"2024-04-25T13:16:08.008078+0000","last_unstale":"2024-04-25T13:16:14.025108+0000","last_undegraded":"2024-04-25T13:16:14.025108+0000","last_fullsized":"2024-04-25T13:16:14.025108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:19.590099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025230+0000","last_change":"2024-04-25T13:16:06.997642+0000","last_active":"2024-04-25T13:16:14.025230+0000","last_peered":"2024-04-25T13:16:14.025230+0000","last_clean":"2024-04-25T13:16:14.025230+0000","last_became_active":"2024-04-25T13:16:06.996985+0000","last_became_peered":"2024-04-25T13:16:06.996985+0000","last_unstale":"2024-04-25T13:16:14.025230+0000","last_undegraded":"2024-04-25T13:16:14.025230+0000","last_fullsized":"2024-04-25T13:16:14.025230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:49.853125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091049+0000","last_change":"2024-04-25T13:16:06.992687+0000","last_active":"2024-04-25T13:16:14.091049+0000","last_peered":"2024-04-25T13:16:14.091049+0000","last_clean":"2024-04-25T13:16:14.091049+0000","last_became_active":"2024-04-25T13:16:06.992407+0000","last_became_peered":"2024-04-25T13:16:06.992407+0000","last_unstale":"2024-04-25T13:16:14.091049+0000","last_undegraded":"2024-04-25T13:16:14.091049+0000","last_fullsized":"2024-04-25T13:16:14.091049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:37.658458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090948+0000","last_change":"2024-04-25T13:16:08.004510+0000","last_active":"2024-04-25T13:16:14.090948+0000","last_peered":"2024-04-25T13:16:14.090948+0000","last_clean":"2024-04-25T13:16:14.090948+0000","last_became_active":"2024-04-25T13:16:08.003959+0000","last_became_peered":"2024-04-25T13:16:08.003959+0000","last_unstale":"2024-04-25T13:16:14.090948+0000","last_undegraded":"2024-04-25T13:16:14.090948+0000","last_fullsized":"2024-04-25T13:16:14.090948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:45.142873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089967+0000","last_change":"2024-04-25T13:16:12.037097+0000","last_active":"2024-04-25T13:16:14.089967+0000","last_peered":"2024-04-25T13:16:14.089967+0000","last_clean":"2024-04-25T13:16:14.089967+0000","last_became_active":"2024-04-25T13:16:12.036651+0000","last_became_peered":"2024-04-25T13:16:12.036651+0000","last_unstale":"2024-04-25T13:16:14.089967+0000","last_undegraded":"2024-04-25T13:16:14.089967+0000","last_fullsized":"2024-04-25T13:16:14.089967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:34.443514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025481+0000","last_change":"2024-04-25T13:16:06.996311+0000","last_active":"2024-04-25T13:16:14.025481+0000","last_peered":"2024-04-25T13:16:14.025481+0000","last_clean":"2024-04-25T13:16:14.025481+0000","last_became_active":"2024-04-25T13:16:06.996010+0000","last_became_peered":"2024-04-25T13:16:06.996010+0000","last_unstale":"2024-04-25T13:16:14.025481+0000","last_undegraded":"2024-04-25T13:16:14.025481+0000","last_fullsized":"2024-04-25T13:16:14.025481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:08.835482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091724+0000","last_change":"2024-04-25T13:16:08.002159+0000","last_active":"2024-04-25T13:16:14.091724+0000","last_peered":"2024-04-25T13:16:14.091724+0000","last_clean":"2024-04-25T13:16:14.091724+0000","last_became_active":"2024-04-25T13:16:08.001833+0000","last_became_peered":"2024-04-25T13:16:08.001833+0000","last_unstale":"2024-04-25T13:16:14.091724+0000","last_undegraded":"2024-04-25T13:16:14.091724+0000","last_fullsized":"2024-04-25T13:16:14.091724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:25.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025768+0000","last_change":"2024-04-25T13:16:12.042721+0000","last_active":"2024-04-25T13:16:14.025768+0000","last_peered":"2024-04-25T13:16:14.025768+0000","last_clean":"2024-04-25T13:16:14.025768+0000","last_became_active":"2024-04-25T13:16:12.042000+0000","last_became_peered":"2024-04-25T13:16:12.042000+0000","last_unstale":"2024-04-25T13:16:14.025768+0000","last_undegraded":"2024-04-25T13:16:14.025768+0000","last_fullsized":"2024-04-25T13:16:14.025768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:18.702032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090639+0000","last_change":"2024-04-25T13:16:08.008364+0000","last_active":"2024-04-25T13:16:14.090639+0000","last_peered":"2024-04-25T13:16:14.090639+0000","last_clean":"2024-04-25T13:16:14.090639+0000","last_became_active":"2024-04-25T13:16:08.007728+0000","last_became_peered":"2024-04-25T13:16:08.007728+0000","last_unstale":"2024-04-25T13:16:14.090639+0000","last_undegraded":"2024-04-25T13:16:14.090639+0000","last_fullsized":"2024-04-25T13:16:14.090639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:08.731178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089766+0000","last_change":"2024-04-25T13:16:08.011273+0000","last_active":"2024-04-25T13:16:14.089766+0000","last_peered":"2024-04-25T13:16:14.089766+0000","last_clean":"2024-04-25T13:16:14.089766+0000","last_became_active":"2024-04-25T13:16:08.010981+0000","last_became_peered":"2024-04-25T13:16:08.010981+0000","last_unstale":"2024-04-25T13:16:14.089766+0000","last_undegraded":"2024-04-25T13:16:14.089766+0000","last_fullsized":"2024-04-25T13:16:14.089766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:03.835422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025994+0000","last_change":"2024-04-25T13:16:08.016413+0000","last_active":"2024-04-25T13:16:14.025994+0000","last_peered":"2024-04-25T13:16:14.025994+0000","last_clean":"2024-04-25T13:16:14.025994+0000","last_became_active":"2024-04-25T13:16:08.016084+0000","last_became_peered":"2024-04-25T13:16:08.016084+0000","last_unstale":"2024-04-25T13:16:14.025994+0000","last_undegraded":"2024-04-25T13:16:14.025994+0000","last_fullsized":"2024-04-25T13:16:14.025994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:41.014999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090856+0000","last_change":"2024-04-25T13:16:08.008543+0000","last_active":"2024-04-25T13:16:14.090856+0000","last_peered":"2024-04-25T13:16:14.090856+0000","last_clean":"2024-04-25T13:16:14.090856+0000","last_became_active":"2024-04-25T13:16:08.008255+0000","last_became_peered":"2024-04-25T13:16:08.008255+0000","last_unstale":"2024-04-25T13:16:14.090856+0000","last_undegraded":"2024-04-25T13:16:14.090856+0000","last_fullsized":"2024-04-25T13:16:14.090856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:47.981446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025776+0000","last_change":"2024-04-25T13:16:08.012814+0000","last_active":"2024-04-25T13:16:14.025776+0000","last_peered":"2024-04-25T13:16:14.025776+0000","last_clean":"2024-04-25T13:16:14.025776+0000","last_became_active":"2024-04-25T13:16:08.012481+0000","last_became_peered":"2024-04-25T13:16:08.012481+0000","last_unstale":"2024-04-25T13:16:14.025776+0000","last_undegraded":"2024-04-25T13:16:14.025776+0000","last_fullsized":"2024-04-25T13:16:14.025776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:05.409701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021983+0000","last_change":"2024-04-25T13:16:08.008843+0000","last_active":"2024-04-25T13:16:14.021983+0000","last_peered":"2024-04-25T13:16:14.021983+0000","last_clean":"2024-04-25T13:16:14.021983+0000","last_became_active":"2024-04-25T13:16:08.008489+0000","last_became_peered":"2024-04-25T13:16:08.008489+0000","last_unstale":"2024-04-25T13:16:14.021983+0000","last_undegraded":"2024-04-25T13:16:14.021983+0000","last_fullsized":"2024-04-25T13:16:14.021983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:35.740816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092076+0000","last_change":"2024-04-25T13:16:08.008121+0000","last_active":"2024-04-25T13:16:14.092076+0000","last_peered":"2024-04-25T13:16:14.092076+0000","last_clean":"2024-04-25T13:16:14.092076+0000","last_became_active":"2024-04-25T13:16:08.007727+0000","last_became_peered":"2024-04-25T13:16:08.007727+0000","last_unstale":"2024-04-25T13:16:14.092076+0000","last_undegraded":"2024-04-25T13:16:14.092076+0000","last_fullsized":"2024-04-25T13:16:14.092076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:11.193610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025864+0000","last_change":"2024-04-25T13:16:08.014997+0000","last_active":"2024-04-25T13:16:14.025864+0000","last_peered":"2024-04-25T13:16:14.025864+0000","last_clean":"2024-04-25T13:16:14.025864+0000","last_became_active":"2024-04-25T13:16:08.014579+0000","last_became_peered":"2024-04-25T13:16:08.014579+0000","last_unstale":"2024-04-25T13:16:14.025864+0000","last_undegraded":"2024-04-25T13:16:14.025864+0000","last_fullsized":"2024-04-25T13:16:14.025864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:07.884249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025224+0000","last_change":"2024-04-25T13:16:08.015379+0000","last_active":"2024-04-25T13:16:14.025224+0000","last_peered":"2024-04-25T13:16:14.025224+0000","last_clean":"2024-04-25T13:16:14.025224+0000","last_became_active":"2024-04-25T13:16:08.014693+0000","last_became_peered":"2024-04-25T13:16:08.014693+0000","last_unstale":"2024-04-25T13:16:14.025224+0000","last_undegraded":"2024-04-25T13:16:14.025224+0000","last_fullsized":"2024-04-25T13:16:14.025224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:41.305358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025156+0000","last_change":"2024-04-25T13:16:08.014873+0000","last_active":"2024-04-25T13:16:14.025156+0000","last_peered":"2024-04-25T13:16:14.025156+0000","last_clean":"2024-04-25T13:16:14.025156+0000","last_became_active":"2024-04-25T13:16:08.014575+0000","last_became_peered":"2024-04-25T13:16:08.014575+0000","last_unstale":"2024-04-25T13:16:14.025156+0000","last_undegraded":"2024-04-25T13:16:14.025156+0000","last_fullsized":"2024-04-25T13:16:14.025156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:41.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025900+0000","last_change":"2024-04-25T13:16:08.016992+0000","last_active":"2024-04-25T13:16:14.025900+0000","last_peered":"2024-04-25T13:16:14.025900+0000","last_clean":"2024-04-25T13:16:14.025900+0000","last_became_active":"2024-04-25T13:16:08.016499+0000","last_became_peered":"2024-04-25T13:16:08.016499+0000","last_unstale":"2024-04-25T13:16:14.025900+0000","last_undegraded":"2024-04-25T13:16:14.025900+0000","last_fullsized":"2024-04-25T13:16:14.025900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:47.275363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090726+0000","last_change":"2024-04-25T13:16:08.000447+0000","last_active":"2024-04-25T13:16:14.090726+0000","last_peered":"2024-04-25T13:16:14.090726+0000","last_clean":"2024-04-25T13:16:14.090726+0000","last_became_active":"2024-04-25T13:16:08.000102+0000","last_became_peered":"2024-04-25T13:16:08.000102+0000","last_unstale":"2024-04-25T13:16:14.090726+0000","last_undegraded":"2024-04-25T13:16:14.090726+0000","last_fullsized":"2024-04-25T13:16:14.090726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:30.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092034+0000","last_change":"2024-04-25T13:16:08.008437+0000","last_active":"2024-04-25T13:16:14.092034+0000","last_peered":"2024-04-25T13:16:14.092034+0000","last_clean":"2024-04-25T13:16:14.092034+0000","last_became_active":"2024-04-25T13:16:08.008173+0000","last_became_peered":"2024-04-25T13:16:08.008173+0000","last_unstale":"2024-04-25T13:16:14.092034+0000","last_undegraded":"2024-04-25T13:16:14.092034+0000","last_fullsized":"2024-04-25T13:16:14.092034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:54.362757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092640+0000","last_change":"2024-04-25T13:16:08.004689+0000","last_active":"2024-04-25T13:16:14.092640+0000","last_peered":"2024-04-25T13:16:14.092640+0000","last_clean":"2024-04-25T13:16:14.092640+0000","last_became_active":"2024-04-25T13:16:08.004340+0000","last_became_peered":"2024-04-25T13:16:08.004340+0000","last_unstale":"2024-04-25T13:16:14.092640+0000","last_undegraded":"2024-04-25T13:16:14.092640+0000","last_fullsized":"2024-04-25T13:16:14.092640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:18.870731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090426+0000","last_change":"2024-04-25T13:16:08.005344+0000","last_active":"2024-04-25T13:16:14.090426+0000","last_peered":"2024-04-25T13:16:14.090426+0000","last_clean":"2024-04-25T13:16:14.090426+0000","last_became_active":"2024-04-25T13:16:08.005041+0000","last_became_peered":"2024-04-25T13:16:08.005041+0000","last_unstale":"2024-04-25T13:16:14.090426+0000","last_undegraded":"2024-04-25T13:16:14.090426+0000","last_fullsized":"2024-04-25T13:16:14.090426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.389800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025849+0000","last_change":"2024-04-25T13:16:08.010203+0000","last_active":"2024-04-25T13:16:14.025849+0000","last_peered":"2024-04-25T13:16:14.025849+0000","last_clean":"2024-04-25T13:16:14.025849+0000","last_became_active":"2024-04-25T13:16:08.009922+0000","last_became_peered":"2024-04-25T13:16:08.009922+0000","last_unstale":"2024-04-25T13:16:14.025849+0000","last_undegraded":"2024-04-25T13:16:14.025849+0000","last_fullsized":"2024-04-25T13:16:14.025849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:06.831797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025079+0000","last_change":"2024-04-25T13:16:08.012737+0000","last_active":"2024-04-25T13:16:14.025079+0000","last_peered":"2024-04-25T13:16:14.025079+0000","last_clean":"2024-04-25T13:16:14.025079+0000","last_became_active":"2024-04-25T13:16:08.012472+0000","last_became_peered":"2024-04-25T13:16:08.012472+0000","last_unstale":"2024-04-25T13:16:14.025079+0000","last_undegraded":"2024-04-25T13:16:14.025079+0000","last_fullsized":"2024-04-25T13:16:14.025079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:36.880757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021729+0000","last_change":"2024-04-25T13:16:08.007177+0000","last_active":"2024-04-25T13:16:14.021729+0000","last_peered":"2024-04-25T13:16:14.021729+0000","last_clean":"2024-04-25T13:16:14.021729+0000","last_became_active":"2024-04-25T13:16:08.006866+0000","last_became_peered":"2024-04-25T13:16:08.006866+0000","last_unstale":"2024-04-25T13:16:14.021729+0000","last_undegraded":"2024-04-25T13:16:14.021729+0000","last_fullsized":"2024-04-25T13:16:14.021729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:16.707771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090599+0000","last_change":"2024-04-25T13:16:07.999761+0000","last_active":"2024-04-25T13:16:14.090599+0000","last_peered":"2024-04-25T13:16:14.090599+0000","last_clean":"2024-04-25T13:16:14.090599+0000","last_became_active":"2024-04-25T13:16:07.999033+0000","last_became_peered":"2024-04-25T13:16:07.999033+0000","last_unstale":"2024-04-25T13:16:14.090599+0000","last_undegraded":"2024-04-25T13:16:14.090599+0000","last_fullsized":"2024-04-25T13:16:14.090599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:40.420290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025389+0000","last_change":"2024-04-25T13:16:08.016370+0000","last_active":"2024-04-25T13:16:14.025389+0000","last_peered":"2024-04-25T13:16:14.025389+0000","last_clean":"2024-04-25T13:16:14.025389+0000","last_became_active":"2024-04-25T13:16:08.016068+0000","last_became_peered":"2024-04-25T13:16:08.016068+0000","last_unstale":"2024-04-25T13:16:14.025389+0000","last_undegraded":"2024-04-25T13:16:14.025389+0000","last_fullsized":"2024-04-25T13:16:14.025389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:11.475920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091465+0000","last_change":"2024-04-25T13:16:08.005195+0000","last_active":"2024-04-25T13:16:14.091465+0000","last_peered":"2024-04-25T13:16:14.091465+0000","last_clean":"2024-04-25T13:16:14.091465+0000","last_became_active":"2024-04-25T13:16:08.004655+0000","last_became_peered":"2024-04-25T13:16:08.004655+0000","last_unstale":"2024-04-25T13:16:14.091465+0000","last_undegraded":"2024-04-25T13:16:14.091465+0000","last_fullsized":"2024-04-25T13:16:14.091465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:28.249616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091464+0000","last_change":"2024-04-25T13:16:08.011310+0000","last_active":"2024-04-25T13:16:14.091464+0000","last_peered":"2024-04-25T13:16:14.091464+0000","last_clean":"2024-04-25T13:16:14.091464+0000","last_became_active":"2024-04-25T13:16:08.011047+0000","last_became_peered":"2024-04-25T13:16:08.011047+0000","last_unstale":"2024-04-25T13:16:14.091464+0000","last_undegraded":"2024-04-25T13:16:14.091464+0000","last_fullsized":"2024-04-25T13:16:14.091464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:55.447995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091964+0000","last_change":"2024-04-25T13:16:08.012191+0000","last_active":"2024-04-25T13:16:14.091964+0000","last_peered":"2024-04-25T13:16:14.091964+0000","last_clean":"2024-04-25T13:16:14.091964+0000","last_became_active":"2024-04-25T13:16:08.011916+0000","last_became_peered":"2024-04-25T13:16:08.011916+0000","last_unstale":"2024-04-25T13:16:14.091964+0000","last_undegraded":"2024-04-25T13:16:14.091964+0000","last_fullsized":"2024-04-25T13:16:14.091964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:33.520554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092843+0000","last_change":"2024-04-25T13:16:08.012349+0000","last_active":"2024-04-25T13:16:14.092843+0000","last_peered":"2024-04-25T13:16:14.092843+0000","last_clean":"2024-04-25T13:16:14.092843+0000","last_became_active":"2024-04-25T13:16:08.011893+0000","last_became_peered":"2024-04-25T13:16:08.011893+0000","last_unstale":"2024-04-25T13:16:14.092843+0000","last_undegraded":"2024-04-25T13:16:14.092843+0000","last_fullsized":"2024-04-25T13:16:14.092843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:11.901170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.024985+0000","last_change":"2024-04-25T13:16:08.015681+0000","last_active":"2024-04-25T13:16:14.024985+0000","last_peered":"2024-04-25T13:16:14.024985+0000","last_clean":"2024-04-25T13:16:14.024985+0000","last_became_active":"2024-04-25T13:16:08.015405+0000","last_became_peered":"2024-04-25T13:16:08.015405+0000","last_unstale":"2024-04-25T13:16:14.024985+0000","last_undegraded":"2024-04-25T13:16:14.024985+0000","last_fullsized":"2024-04-25T13:16:14.024985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:00.932243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090639+0000","last_change":"2024-04-25T13:16:08.000456+0000","last_active":"2024-04-25T13:16:14.090639+0000","last_peered":"2024-04-25T13:16:14.090639+0000","last_clean":"2024-04-25T13:16:14.090639+0000","last_became_active":"2024-04-25T13:16:08.000193+0000","last_became_peered":"2024-04-25T13:16:08.000193+0000","last_unstale":"2024-04-25T13:16:14.090639+0000","last_undegraded":"2024-04-25T13:16:14.090639+0000","last_fullsized":"2024-04-25T13:16:14.090639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:15.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025845+0000","last_change":"2024-04-25T13:16:08.016060+0000","last_active":"2024-04-25T13:16:14.025845+0000","last_peered":"2024-04-25T13:16:14.025845+0000","last_clean":"2024-04-25T13:16:14.025845+0000","last_became_active":"2024-04-25T13:16:08.014300+0000","last_became_peered":"2024-04-25T13:16:08.014300+0000","last_unstale":"2024-04-25T13:16:14.025845+0000","last_undegraded":"2024-04-25T13:16:14.025845+0000","last_fullsized":"2024-04-25T13:16:14.025845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:37.644887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091282+0000","last_change":"2024-04-25T13:16:08.004946+0000","last_active":"2024-04-25T13:16:14.091282+0000","last_peered":"2024-04-25T13:16:14.091282+0000","last_clean":"2024-04-25T13:16:14.091282+0000","last_became_active":"2024-04-25T13:16:08.004673+0000","last_became_peered":"2024-04-25T13:16:08.004673+0000","last_unstale":"2024-04-25T13:16:14.091282+0000","last_undegraded":"2024-04-25T13:16:14.091282+0000","last_fullsized":"2024-04-25T13:16:14.091282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:18.616424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025492+0000","last_change":"2024-04-25T13:16:08.015676+0000","last_active":"2024-04-25T13:16:14.025492+0000","last_peered":"2024-04-25T13:16:14.025492+0000","last_clean":"2024-04-25T13:16:14.025492+0000","last_became_active":"2024-04-25T13:16:08.014719+0000","last_became_peered":"2024-04-25T13:16:08.014719+0000","last_unstale":"2024-04-25T13:16:14.025492+0000","last_undegraded":"2024-04-25T13:16:14.025492+0000","last_fullsized":"2024-04-25T13:16:14.025492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:04.274611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090172+0000","last_change":"2024-04-25T13:16:07.997665+0000","last_active":"2024-04-25T13:16:14.090172+0000","last_peered":"2024-04-25T13:16:14.090172+0000","last_clean":"2024-04-25T13:16:14.090172+0000","last_became_active":"2024-04-25T13:16:07.996792+0000","last_became_peered":"2024-04-25T13:16:07.996792+0000","last_unstale":"2024-04-25T13:16:14.090172+0000","last_undegraded":"2024-04-25T13:16:14.090172+0000","last_fullsized":"2024-04-25T13:16:14.090172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:39.367026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022259+0000","last_change":"2024-04-25T13:16:08.001495+0000","last_active":"2024-04-25T13:16:14.022259+0000","last_peered":"2024-04-25T13:16:14.022259+0000","last_clean":"2024-04-25T13:16:14.022259+0000","last_became_active":"2024-04-25T13:16:08.001182+0000","last_became_peered":"2024-04-25T13:16:08.001182+0000","last_unstale":"2024-04-25T13:16:14.022259+0000","last_undegraded":"2024-04-25T13:16:14.022259+0000","last_fullsized":"2024-04-25T13:16:14.022259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:48.417192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092786+0000","last_change":"2024-04-25T13:16:08.006262+0000","last_active":"2024-04-25T13:16:14.092786+0000","last_peered":"2024-04-25T13:16:14.092786+0000","last_clean":"2024-04-25T13:16:14.092786+0000","last_became_active":"2024-04-25T13:16:08.005976+0000","last_became_peered":"2024-04-25T13:16:08.005976+0000","last_unstale":"2024-04-25T13:16:14.092786+0000","last_undegraded":"2024-04-25T13:16:14.092786+0000","last_fullsized":"2024-04-25T13:16:14.092786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:22.965387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:16:37.455 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T13:16:37.455 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T13:16:37.455 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T13:16:37.455 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T13:16:37.456 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T13:16:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.591+0000 7fb84b0a0640 1 Processor -- start 2024-04-25T13:16:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.591+0000 7fb84b0a0640 1 -- start start 2024-04-25T13:16:37.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.592+0000 7fb84b0a0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb844144270 0x7fb84415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.592+0000 7fb84b0a0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8440c8e70 0x7fb844074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.592+0000 7fb84b0a0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb844144650 con 0x7fb8440c9290 2024-04-25T13:16:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.592+0000 7fb84b0a0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb84415f4e0 con 0x7fb844144270 2024-04-25T13:16:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.592+0000 7fb84b0a0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb8440ce080 con 0x7fb8440c8e70 2024-04-25T13:16:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.592+0000 7fb848e3c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb844144270 0x7fb84415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.592+0000 7fb848e3c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb844144270 0x7fb84415efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49770/0 (socket says 172.21.15.52:49770) 2024-04-25T13:16:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.592+0000 7fb848e3c640 1 -- 172.21.15.52:0/3200023152 learned_addr learned my addr 172.21.15.52:0/3200023152 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.593+0000 7fb843fff640 1 --2- 172.21.15.52:0/3200023152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8440c8e70 0x7fb844074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.593+0000 7fb848e3c640 1 -- 172.21.15.52:0/3200023152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8440c8e70 msgr2=0x7fb844074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.593+0000 7fb848e3c640 1 --2- 172.21.15.52:0/3200023152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8440c8e70 0x7fb844074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.593+0000 7fb848e3c640 1 -- 172.21.15.52:0/3200023152 >> v1:172.21.15.102:6789/0 conn(0x7fb8440c9290 legacy=0x7fb844075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.593+0000 7fb848e3c640 1 -- 172.21.15.52:0/3200023152 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84415b0b0 con 0x7fb844144270 2024-04-25T13:16:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.593+0000 7fb848e3c640 1 --2- 172.21.15.52:0/3200023152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb844144270 0x7fb84415efa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb834009870 tx=0x7fb83402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e0f432fdfd02b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.594+0000 7fb8437fe640 1 -- 172.21.15.52:0/3200023152 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834037070 con 0x7fb844144270 2024-04-25T13:16:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.594+0000 7fb8437fe640 1 -- 172.21.15.52:0/3200023152 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb834032440 con 0x7fb844144270 2024-04-25T13:16:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.594+0000 7fb8437fe640 1 -- 172.21.15.52:0/3200023152 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834032810 con 0x7fb844144270 2024-04-25T13:16:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.594+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3200023152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb844144270 msgr2=0x7fb84415efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.594+0000 7fb84b0a0640 1 --2- 172.21.15.52:0/3200023152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb844144270 0x7fb84415efa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb834009870 tx=0x7fb83402a2a0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.594+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3200023152 shutdown_connections 2024-04-25T13:16:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.594+0000 7fb84b0a0640 1 --2- 172.21.15.52:0/3200023152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8440c8e70 0x7fb844074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.594+0000 7fb84b0a0640 1 --2- 172.21.15.52:0/3200023152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb844144270 0x7fb84415efa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.594+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3200023152 >> 172.21.15.52:0/3200023152 conn(0x7fb84406b920 msgr2=0x7fb84406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.594+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3200023152 shutdown_connections 2024-04-25T13:16:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.594+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3200023152 wait complete. 2024-04-25T13:16:37.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.595+0000 7fb84b0a0640 1 Processor -- start 2024-04-25T13:16:37.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.596+0000 7fb84b0a0640 1 -- start start 2024-04-25T13:16:37.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.596+0000 7fb84b0a0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440c8e70 0x7fb8441f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.596+0000 7fb84b0a0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8440c9290 0x7fb84415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.596+0000 7fb84b0a0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb844144270 0x7fb84415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.596+0000 7fb84b0a0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb84415b8e0 con 0x7fb8440c9290 2024-04-25T13:16:37.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.596+0000 7fb84b0a0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb84415b600 con 0x7fb8440c8e70 2024-04-25T13:16:37.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.596+0000 7fb84b0a0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb8440ce360 con 0x7fb844144270 2024-04-25T13:16:37.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.596+0000 7fb843fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8440c9290 0x7fb84415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.596+0000 7fb843fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8440c9290 0x7fb84415ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49778/0 (socket says 172.21.15.52:49778) 2024-04-25T13:16:37.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.596+0000 7fb843fff640 1 -- 172.21.15.52:0/3193023095 learned_addr learned my addr 172.21.15.52:0/3193023095 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:37.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb848e3c640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440c8e70 0x7fb8441f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb84963d640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb844144270 0x7fb84415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb843fff640 1 -- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb844144270 msgr2=0x7fb84415cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb843fff640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb844144270 0x7fb84415cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb843fff640 1 -- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440c8e70 msgr2=0x7fb8441f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb843fff640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440c8e70 0x7fb8441f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb843fff640 1 -- 172.21.15.52:0/3193023095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8441f4e40 con 0x7fb8440c9290 2024-04-25T13:16:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb843fff640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8440c9290 0x7fb84415ea20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb83800d5f0 tx=0x7fb83800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb8417fa640 1 -- 172.21.15.52:0/3193023095 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8380125f0 con 0x7fb8440c9290 2024-04-25T13:16:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb8417fa640 1 -- 172.21.15.52:0/3193023095 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb838019070 con 0x7fb8440c9290 2024-04-25T13:16:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb8417fa640 1 -- 172.21.15.52:0/3193023095 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8380129d0 con 0x7fb8440c9290 2024-04-25T13:16:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3193023095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8441f50d0 con 0x7fb8440c9290 2024-04-25T13:16:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.597+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3193023095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8441f5690 con 0x7fb8440c9290 2024-04-25T13:16:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.598+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3193023095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb844068e40 con 0x7fb8440c9290 2024-04-25T13:16:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.598+0000 7fb8417fa640 1 -- 172.21.15.52:0/3193023095 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb838012b70 con 0x7fb8440c9290 2024-04-25T13:16:37.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.599+0000 7fb8417fa640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb83006c8f0 0x7fb83006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.599+0000 7fb8417fa640 1 -- 172.21.15.52:0/3193023095 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb83808c120 con 0x7fb8440c9290 2024-04-25T13:16:37.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.599+0000 7fb848e3c640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb83006c8f0 0x7fb83006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.600+0000 7fb848e3c640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb83006c8f0 0x7fb83006edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb834034000 tx=0x7fb83402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.603+0000 7fb8417fa640 1 -- 172.21.15.52:0/3193023095 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb838059bc0 con 0x7fb8440c9290 2024-04-25T13:16:37.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.840+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3193023095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb844073b40 con 0x7fb8440c9290 2024-04-25T13:16:37.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.843+0000 7fb8417fa640 1 -- 172.21.15.52:0/3193023095 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174138 (secure 0 0 0) 0x7fb83805dec0 con 0x7fb8440c9290 2024-04-25T13:16:37.845 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:37.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.846+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb83006c8f0 msgr2=0x7fb83006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.846+0000 7fb84b0a0640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb83006c8f0 0x7fb83006edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb834034000 tx=0x7fb83402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:37.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.846+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3193023095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8440c9290 msgr2=0x7fb84415ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.846+0000 7fb84b0a0640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8440c9290 0x7fb84415ea20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb83800d5f0 tx=0x7fb83800dab0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.846+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3193023095 shutdown_connections 2024-04-25T13:16:37.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.846+0000 7fb84b0a0640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb83006c8f0 0x7fb83006edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.846+0000 7fb84b0a0640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb844144270 0x7fb84415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.846+0000 7fb84b0a0640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8440c9290 0x7fb84415ea20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.846+0000 7fb84b0a0640 1 --2- 172.21.15.52:0/3193023095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8440c8e70 0x7fb8441f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.846+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3193023095 >> 172.21.15.52:0/3193023095 conn(0x7fb84406b920 msgr2=0x7fb844141500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.846+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3193023095 shutdown_connections 2024-04-25T13:16:37.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.846+0000 7fb84b0a0640 1 -- 172.21.15.52:0/3193023095 wait complete. 2024-04-25T13:16:37.857 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":44610470},{"type":"v1","addr":"172.21.15.102:6833","nonce":44610470}]},"active_addr":"172.21.15.102:6833/44610470","active_change":"2024-04-25T13:15:47.810116+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2225877044}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":1664289765}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":3102713541}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":3628453741}]}]} 2024-04-25T13:16:37.860 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T13:16:37.860 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T13:16:37.860 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:37.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.960+0000 7fe9ac06b640 1 Processor -- start 2024-04-25T13:16:37.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.961+0000 7fe9ac06b640 1 -- start start 2024-04-25T13:16:37.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.961+0000 7fe9ac06b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9a4152f70 0x7fe9a40c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.961+0000 7fe9ac06b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe9a40c8870 0x7fe9a40c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.961+0000 7fe9ac06b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9a4158fe0 con 0x7fe9a415c4c0 2024-04-25T13:16:37.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.961+0000 7fe9ac06b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a41592c0 con 0x7fe9a40c8870 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.961+0000 7fe9ac06b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a41595a0 con 0x7fe9a4152f70 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.962+0000 7fe9a9606640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe9a40c8870 0x7fe9a40c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.962+0000 7fe9aa608640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe9a415c4c0 0x7fe9a415c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:54878/0 (socket says 172.21.15.52:54878) 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.962+0000 7fe9a9e07640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9a4152f70 0x7fe9a40c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.962+0000 7fe9a9606640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe9a40c8870 0x7fe9a40c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:42794/0 (socket says 172.21.15.52:42794) 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.962+0000 7fe9aa608640 1 -- 172.21.15.52:0/1513156074 learned_addr learned my addr 172.21.15.52:0/1513156074 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.962+0000 7fe9a9606640 1 -- 172.21.15.52:0/1513156074 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9a4152f70 msgr2=0x7fe9a40c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.962+0000 7fe9a9606640 1 --2- 172.21.15.52:0/1513156074 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9a4152f70 0x7fe9a40c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.962+0000 7fe9a9606640 1 -- 172.21.15.52:0/1513156074 >> v1:172.21.15.102:6789/0 conn(0x7fe9a415c4c0 legacy=0x7fe9a415c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.962+0000 7fe9a9606640 1 -- 172.21.15.52:0/1513156074 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a4159880 con 0x7fe9a40c8870 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.963+0000 7fe9a9606640 1 --2- 172.21.15.52:0/1513156074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9a40c8870 0x7fe9a40c6090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00097a0 tx=0x7fe9a002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=105983e3085d9b0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.963+0000 7fe9a8e05640 1 -- 172.21.15.52:0/1513156074 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0037070 con 0x7fe9a40c8870 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.963+0000 7fe9a8e05640 1 -- 172.21.15.52:0/1513156074 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a0032440 con 0x7fe9a40c8870 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.963+0000 7fe9a8e05640 1 -- 172.21.15.52:0/1513156074 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0032810 con 0x7fe9a40c8870 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.963+0000 7fe9ac06b640 1 -- 172.21.15.52:0/1513156074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9a40c8870 msgr2=0x7fe9a40c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.963+0000 7fe9ac06b640 1 --2- 172.21.15.52:0/1513156074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9a40c8870 0x7fe9a40c6090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00097a0 tx=0x7fe9a002a180 comp rx=0 tx=0).stop 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.963+0000 7fe9ac06b640 1 -- 172.21.15.52:0/1513156074 shutdown_connections 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.963+0000 7fe9ac06b640 1 --2- 172.21.15.52:0/1513156074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9a40c8870 0x7fe9a40c6090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.963+0000 7fe9ac06b640 1 --2- 172.21.15.52:0/1513156074 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9a4152f70 0x7fe9a40c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.963+0000 7fe9ac06b640 1 -- 172.21.15.52:0/1513156074 >> 172.21.15.52:0/1513156074 conn(0x7fe9a4074d50 msgr2=0x7fe9a4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.964+0000 7fe9ac06b640 1 -- 172.21.15.52:0/1513156074 shutdown_connections 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.964+0000 7fe9ac06b640 1 -- 172.21.15.52:0/1513156074 wait complete. 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.965+0000 7fe9ac06b640 1 Processor -- start 2024-04-25T13:16:37.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.965+0000 7fe9ac06b640 1 -- start start 2024-04-25T13:16:37.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.965+0000 7fe9ac06b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9a40c8870 0x7fe9a414e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.965+0000 7fe9ac06b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9a4152f70 0x7fe9a4144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.965+0000 7fe9ac06b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9a415c4c0 0x7fe9a41454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.965+0000 7fe9ac06b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a41534d0 con 0x7fe9a40c8870 2024-04-25T13:16:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.965+0000 7fe9ac06b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a4153350 con 0x7fe9a415c4c0 2024-04-25T13:16:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.965+0000 7fe9ac06b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a4073a30 con 0x7fe9a4152f70 2024-04-25T13:16:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.965+0000 7fe9a9e07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9a40c8870 0x7fe9a414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.965+0000 7fe9a9e07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9a40c8870 0x7fe9a414e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49782/0 (socket says 172.21.15.52:49782) 2024-04-25T13:16:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.965+0000 7fe9a9e07640 1 -- 172.21.15.52:0/55176674 learned_addr learned my addr 172.21.15.52:0/55176674 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe9aa608640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9a415c4c0 0x7fe9a41454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe9a9606640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9a4152f70 0x7fe9a4144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe9a9e07640 1 -- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9a4152f70 msgr2=0x7fe9a4144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe9a9e07640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9a4152f70 0x7fe9a4144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe9a9e07640 1 -- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9a415c4c0 msgr2=0x7fe9a41454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe9a9e07640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9a415c4c0 0x7fe9a41454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe9a9e07640 1 -- 172.21.15.52:0/55176674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a40cec00 con 0x7fe9a40c8870 2024-04-25T13:16:37.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe9a9e07640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9a40c8870 0x7fe9a414e870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe99400e9e0 tx=0x7fe99400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe99a7fc640 1 -- 172.21.15.52:0/55176674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994017070 con 0x7fe9a40c8870 2024-04-25T13:16:37.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe99a7fc640 1 -- 172.21.15.52:0/55176674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99400c9d0 con 0x7fe9a40c8870 2024-04-25T13:16:37.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe9ac06b640 1 -- 172.21.15.52:0/55176674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a41f2ff0 con 0x7fe9a40c8870 2024-04-25T13:16:37.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe99a7fc640 1 -- 172.21.15.52:0/55176674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99400cdc0 con 0x7fe9a40c8870 2024-04-25T13:16:37.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.966+0000 7fe9ac06b640 1 -- 172.21.15.52:0/55176674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a41ef020 con 0x7fe9a40c8870 2024-04-25T13:16:37.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.967+0000 7fe9ac06b640 1 -- 172.21.15.52:0/55176674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a4068e40 con 0x7fe9a40c8870 2024-04-25T13:16:37.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.968+0000 7fe99a7fc640 1 -- 172.21.15.52:0/55176674 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe99401a070 con 0x7fe9a40c8870 2024-04-25T13:16:37.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.968+0000 7fe99a7fc640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe98806c8f0 0x7fe98806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.968+0000 7fe99a7fc640 1 -- 172.21.15.52:0/55176674 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe99408c370 con 0x7fe9a40c8870 2024-04-25T13:16:37.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.968+0000 7fe9a9606640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe98806c8f0 0x7fe98806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.969+0000 7fe9a9606640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe98806c8f0 0x7fe98806edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0034000 tx=0x7fe9a002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:37.973+0000 7fe99a7fc640 1 -- 172.21.15.52:0/55176674 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe99405a340 con 0x7fe9a40c8870 2024-04-25T13:16:38.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.164+0000 7fe9ac06b640 1 -- 172.21.15.52:0/55176674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9a41522b0 con 0x7fe9a40c8870 2024-04-25T13:16:38.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.165+0000 7fe99a7fc640 1 -- 172.21.15.52:0/55176674 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fe994059c40 con 0x7fe9a40c8870 2024-04-25T13:16:38.165 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:38.165 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":25,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:14.018518+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:38.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.167+0000 7fe9ac06b640 1 -- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe98806c8f0 msgr2=0x7fe98806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.167+0000 7fe9ac06b640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe98806c8f0 0x7fe98806edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0034000 tx=0x7fe9a002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:38.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.167+0000 7fe9ac06b640 1 -- 172.21.15.52:0/55176674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9a40c8870 msgr2=0x7fe9a414e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.167+0000 7fe9ac06b640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9a40c8870 0x7fe9a414e870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe99400e9e0 tx=0x7fe99400eea0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.167+0000 7fe9ac06b640 1 -- 172.21.15.52:0/55176674 shutdown_connections 2024-04-25T13:16:38.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.167+0000 7fe9ac06b640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe98806c8f0 0x7fe98806edb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.167+0000 7fe9ac06b640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9a4152f70 0x7fe9a4144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.167+0000 7fe9ac06b640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9a415c4c0 0x7fe9a41454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.167+0000 7fe9ac06b640 1 --2- 172.21.15.52:0/55176674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9a40c8870 0x7fe9a414e870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.167+0000 7fe9ac06b640 1 -- 172.21.15.52:0/55176674 >> 172.21.15.52:0/55176674 conn(0x7fe9a4074d50 msgr2=0x7fe9a4151860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.167+0000 7fe9ac06b640 1 -- 172.21.15.52:0/55176674 shutdown_connections 2024-04-25T13:16:38.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.167+0000 7fe9ac06b640 1 -- 172.21.15.52:0/55176674 wait complete. 2024-04-25T13:16:38.178 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T13:16:38.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:38.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.279+0000 7f6b9eb15640 1 Processor -- start 2024-04-25T13:16:38.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.279+0000 7f6b9eb15640 1 -- start start 2024-04-25T13:16:38.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.280+0000 7f6b9eb15640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b980b3c00 0x7f6b980b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.280+0000 7f6b9eb15640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b981558c0 con 0x7f6b980b5450 2024-04-25T13:16:38.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.280+0000 7f6b9eb15640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b980cb8c0 con 0x7f6b981554e0 2024-04-25T13:16:38.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.280+0000 7f6b9eb15640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6b980b4a80 con 0x7f6b980b3c00 2024-04-25T13:16:38.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.280+0000 7f6b8ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b980b3c00 0x7f6b980b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.280+0000 7f6b8ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b980b3c00 0x7f6b980b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49788/0 (socket says 172.21.15.52:49788) 2024-04-25T13:16:38.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.280+0000 7f6b9d0b2640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6b980b5450 0x7f6b980d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46168/0 (socket says 172.21.15.52:46168) 2024-04-25T13:16:38.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.280+0000 7f6b8ffff640 1 -- 172.21.15.52:0/3977408290 learned_addr learned my addr 172.21.15.52:0/3977408290 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:38.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.280+0000 7f6b8ffff640 1 -- 172.21.15.52:0/3977408290 >> v1:172.21.15.102:6789/0 conn(0x7f6b981554e0 legacy=0x7f6b9815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.280+0000 7f6b8ffff640 1 -- 172.21.15.52:0/3977408290 >> v1:172.21.15.52:6789/0 conn(0x7f6b980b5450 legacy=0x7f6b980d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.280+0000 7f6b8ffff640 1 -- 172.21.15.52:0/3977408290 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b980cbba0 con 0x7f6b980b3c00 2024-04-25T13:16:38.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.281+0000 7f6b8ffff640 1 --2- 172.21.15.52:0/3977408290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b980b3c00 0x7f6b980b4f10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009870 tx=0x7f6b8802a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb530c3fa552533 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.281+0000 7f6b8f7fe640 1 -- 172.21.15.52:0/3977408290 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88037070 con 0x7f6b980b3c00 2024-04-25T13:16:38.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.281+0000 7f6b8f7fe640 1 -- 172.21.15.52:0/3977408290 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88032640 con 0x7f6b980b3c00 2024-04-25T13:16:38.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.281+0000 7f6b8f7fe640 1 -- 172.21.15.52:0/3977408290 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88032a10 con 0x7f6b980b3c00 2024-04-25T13:16:38.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.282+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3977408290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b980b3c00 msgr2=0x7f6b980b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.282+0000 7f6b9eb15640 1 --2- 172.21.15.52:0/3977408290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b980b3c00 0x7f6b980b4f10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009870 tx=0x7f6b8802a3c0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.282+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3977408290 shutdown_connections 2024-04-25T13:16:38.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.282+0000 7f6b9eb15640 1 --2- 172.21.15.52:0/3977408290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b980b3c00 0x7f6b980b4f10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.282+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3977408290 >> 172.21.15.52:0/3977408290 conn(0x7f6b98074d50 msgr2=0x7f6b98075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.282+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3977408290 shutdown_connections 2024-04-25T13:16:38.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.282+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3977408290 wait complete. 2024-04-25T13:16:38.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.283+0000 7f6b9eb15640 1 Processor -- start 2024-04-25T13:16:38.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.283+0000 7f6b9eb15640 1 -- start start 2024-04-25T13:16:38.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b9eb15640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b980b3c00 0x7f6b981e67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b9eb15640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b980b5450 0x7f6b981f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b9eb15640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b981554e0 0x7f6b980c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b9eb15640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6b980b4710 con 0x7f6b980b5450 2024-04-25T13:16:38.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b9eb15640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6b980b4430 con 0x7f6b981554e0 2024-04-25T13:16:38.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b9eb15640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6b980b3580 con 0x7f6b980b3c00 2024-04-25T13:16:38.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b8ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b980b5450 0x7f6b981f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b8ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b980b5450 0x7f6b981f1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49790/0 (socket says 172.21.15.52:49790) 2024-04-25T13:16:38.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b8ffff640 1 -- 172.21.15.52:0/3053299943 learned_addr learned my addr 172.21.15.52:0/3053299943 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:38.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b9d0b2640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b981554e0 0x7f6b980c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b9c8b1640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b980b3c00 0x7f6b981e67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b8ffff640 1 -- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b980b3c00 msgr2=0x7f6b981e67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b8ffff640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b980b3c00 0x7f6b981e67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b8ffff640 1 -- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b981554e0 msgr2=0x7f6b980c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b8ffff640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b981554e0 0x7f6b980c6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b8ffff640 1 -- 172.21.15.52:0/3053299943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9814cad0 con 0x7f6b980b5450 2024-04-25T13:16:38.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b9d0b2640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b981554e0 0x7f6b980c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:38.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b8ffff640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b980b5450 0x7f6b981f1e60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6b88000c00 tx=0x7f6b880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b8d7fa640 1 -- 172.21.15.52:0/3053299943 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88037040 con 0x7f6b980b5450 2024-04-25T13:16:38.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b8d7fa640 1 -- 172.21.15.52:0/3053299943 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88042070 con 0x7f6b980b5450 2024-04-25T13:16:38.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b8d7fa640 1 -- 172.21.15.52:0/3053299943 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88030bd0 con 0x7f6b980b5450 2024-04-25T13:16:38.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3053299943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b981e4fa0 con 0x7f6b980b5450 2024-04-25T13:16:38.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.284+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3053299943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9814cd70 con 0x7f6b980b5450 2024-04-25T13:16:38.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.285+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3053299943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b98068e40 con 0x7f6b980b5450 2024-04-25T13:16:38.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.286+0000 7f6b8d7fa640 1 -- 172.21.15.52:0/3053299943 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b88032500 con 0x7f6b980b5450 2024-04-25T13:16:38.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.286+0000 7f6b8d7fa640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6b8406c8f0 0x7f6b8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.287+0000 7f6b8d7fa640 1 -- 172.21.15.52:0/3053299943 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6b880ac920 con 0x7f6b980b5450 2024-04-25T13:16:38.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.287+0000 7f6b9c8b1640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6b8406c8f0 0x7f6b8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.287+0000 7f6b9c8b1640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6b8406c8f0 0x7f6b8406edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6b94001640 tx=0x7f6b94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.291+0000 7f6b8d7fa640 1 -- 172.21.15.52:0/3053299943 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6b88045360 con 0x7f6b980b5450 2024-04-25T13:16:38.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.477+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3053299943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b980cd3e0 con 0x7f6b980b5450 2024-04-25T13:16:38.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.478+0000 7f6b8d7fa640 1 -- 172.21.15.52:0/3053299943 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f6b8807aa10 con 0x7f6b980b5450 2024-04-25T13:16:38.479 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:38.479 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":25,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:14.018518+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:38.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.480+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6b8406c8f0 msgr2=0x7f6b8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.480+0000 7f6b9eb15640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6b8406c8f0 0x7f6b8406edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6b94001640 tx=0x7f6b94009040 comp rx=0 tx=0).stop 2024-04-25T13:16:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.480+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3053299943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b980b5450 msgr2=0x7f6b981f1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.480+0000 7f6b9eb15640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b980b5450 0x7f6b981f1e60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6b88000c00 tx=0x7f6b880046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.480+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3053299943 shutdown_connections 2024-04-25T13:16:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.480+0000 7f6b9eb15640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6b8406c8f0 0x7f6b8406edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.480+0000 7f6b9eb15640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b981554e0 0x7f6b980c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.480+0000 7f6b9eb15640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b980b5450 0x7f6b981f1e60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.480+0000 7f6b9eb15640 1 --2- 172.21.15.52:0/3053299943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b980b3c00 0x7f6b981e67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.480+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3053299943 >> 172.21.15.52:0/3053299943 conn(0x7f6b98074d50 msgr2=0x7f6b98153980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.480+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3053299943 shutdown_connections 2024-04-25T13:16:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.480+0000 7f6b9eb15640 1 -- 172.21.15.52:0/3053299943 wait complete. 2024-04-25T13:16:38.492 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T13:16:38.492 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T13:16:38.493 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T13:16:38.493 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T13:16:38.493 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T13:16:38.494 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T13:16:38.494 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T13:16:38.494 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T13:16:38.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.666+0000 7f5e51098640 1 Processor -- start 2024-04-25T13:16:38.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.666+0000 7f5e51098640 1 -- start start 2024-04-25T13:16:38.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.667+0000 7f5e51098640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e4c0cc9e0 0x7f5e4c159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.667+0000 7f5e51098640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e4c1637a0 con 0x7f5e4c0cc600 2024-04-25T13:16:38.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.668+0000 7f5e51098640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e4c15ffc0 con 0x7f5e4c0c86e0 2024-04-25T13:16:38.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.668+0000 7f5e51098640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5e4c1629e0 con 0x7f5e4c0cc9e0 2024-04-25T13:16:38.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.668+0000 7f5e4bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5e4c0cc600 0x7f5e4c0c3900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46170/0 (socket says 172.21.15.52:46170) 2024-04-25T13:16:38.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.668+0000 7f5e4bfff640 1 -- 172.21.15.52:0/1255397430 learned_addr learned my addr 172.21.15.52:0/1255397430 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:38.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.668+0000 7f5e4b7fe640 1 --2- 172.21.15.52:0/1255397430 >> v2:172.21.15.52:3300/0 conn(0x7f5e4c0cc9e0 0x7f5e4c159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.669+0000 7f5e4affd640 1 -- 172.21.15.52:0/1255397430 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835705849 0 0) 0x7f5e4c1637a0 con 0x7f5e4c0cc600 2024-04-25T13:16:38.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.669+0000 7f5e4affd640 1 -- 172.21.15.52:0/1255397430 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e34003520 con 0x7f5e4c0cc600 2024-04-25T13:16:38.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.669+0000 7f5e4affd640 1 -- 172.21.15.52:0/1255397430 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135144670 0 0) 0x7f5e4c15ffc0 con 0x7f5e4c0c86e0 2024-04-25T13:16:38.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.669+0000 7f5e4affd640 1 -- 172.21.15.52:0/1255397430 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e4c1637a0 con 0x7f5e4c0c86e0 2024-04-25T13:16:38.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.669+0000 7f5e4b7fe640 1 -- 172.21.15.52:0/1255397430 >> v1:172.21.15.102:6789/0 conn(0x7f5e4c0c86e0 legacy=0x7f5e4c15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.670+0000 7fcd90951640 1 Processor -- start 2024-04-25T13:16:38.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.669+0000 7f5e4b7fe640 1 -- 172.21.15.52:0/1255397430 >> v1:172.21.15.52:6789/0 conn(0x7f5e4c0cc600 legacy=0x7f5e4c0c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.669+0000 7f5e4b7fe640 1 -- 172.21.15.52:0/1255397430 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c162cc0 con 0x7f5e4c0cc9e0 2024-04-25T13:16:38.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.670+0000 7fcd90951640 1 -- start start 2024-04-25T13:16:38.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.670+0000 7f5e4b7fe640 1 --2- 172.21.15.52:0/1255397430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e4c0cc9e0 0x7f5e4c159000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e400097a0 tx=0x7f5e4002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36c22f333277a1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.670+0000 7f84bdc10640 1 Processor -- start 2024-04-25T13:16:38.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.670+0000 7f4009620640 1 Processor -- start 2024-04-25T13:16:38.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.671+0000 7f5e4affd640 1 -- 172.21.15.52:0/1255397430 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40037070 con 0x7f5e4c0cc9e0 2024-04-25T13:16:38.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.671+0000 7f5e4affd640 1 -- 172.21.15.52:0/1255397430 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e40032440 con 0x7f5e4c0cc9e0 2024-04-25T13:16:38.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.670+0000 7f84bdc10640 1 -- start start 2024-04-25T13:16:38.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.671+0000 7fcd90951640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcd8c06e850 0x7fcd8c0c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f84bdc10640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f84b00e37a0 0x7f84b004be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f84bdc10640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b0046b70 con 0x7f84b00dd3c0 2024-04-25T13:16:38.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f84bdc10640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b00dd7a0 con 0x7f84b004ba60 2024-04-25T13:16:38.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f84bdc10640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f84b0045450 con 0x7f84b00e37a0 2024-04-25T13:16:38.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7fcd8a59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcd8c06e850 0x7fcd8c0c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7fcd89d9b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fcd8c0c8160 0x7fcd8c154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:54894/0 (socket says 172.21.15.52:54894) 2024-04-25T13:16:38.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7fcd89d9b640 1 -- 172.21.15.52:0/2241533421 learned_addr learned my addr 172.21.15.52:0/2241533421 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:38.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7fcd90951640 1 --2- 172.21.15.52:0/2241533421 >> v2:172.21.15.52:3300/0 conn(0x7fcd8c06ec30 0x7fcd8c155370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.670+0000 7f4009620640 1 -- start start 2024-04-25T13:16:38.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f4009620640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ffc0dd360 0x7f3ffc0e6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f4009620640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ffc04c570 con 0x7f3ffc04bc70 2024-04-25T13:16:38.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f4009620640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ffc04c850 con 0x7f3ffc04ab30 2024-04-25T13:16:38.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f4009620640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3ffc0065d0 con 0x7f3ffc0dd360 2024-04-25T13:16:38.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f5e51098640 1 -- 172.21.15.52:0/1255397430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e4c0cc9e0 msgr2=0x7f5e4c159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f5e51098640 1 --2- 172.21.15.52:0/1255397430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e4c0cc9e0 0x7f5e4c159000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e400097a0 tx=0x7f5e4002a230 comp rx=0 tx=0).stop 2024-04-25T13:16:38.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f5e51098640 1 -- 172.21.15.52:0/1255397430 shutdown_connections 2024-04-25T13:16:38.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f5e51098640 1 --2- 172.21.15.52:0/1255397430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e4c0cc9e0 0x7f5e4c159000 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f5e51098640 1 -- 172.21.15.52:0/1255397430 >> 172.21.15.52:0/1255397430 conn(0x7f5e4c06eb20 msgr2=0x7f5e4c06ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7fcd90951640 1 -- 172.21.15.52:0/2241533421 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c06f270 con 0x7fcd8c0c8160 2024-04-25T13:16:38.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7fcd90951640 1 -- 172.21.15.52:0/2241533421 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcd8c0c7bb0 con 0x7fcd8c06ec30 2024-04-25T13:16:38.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f393a529640 1 Processor -- start 2024-04-25T13:16:38.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f5e51098640 1 -- 172.21.15.52:0/1255397430 shutdown_connections 2024-04-25T13:16:38.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7fcd90951640 1 -- 172.21.15.52:0/2241533421 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fcd8c0c6fa0 con 0x7fcd8c06e850 2024-04-25T13:16:38.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7fcd8ad9d640 1 --2- 172.21.15.52:0/2241533421 >> v2:172.21.15.52:3300/0 conn(0x7fcd8c06ec30 0x7fcd8c155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.671+0000 7f2cb306d640 1 Processor -- start 2024-04-25T13:16:38.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.671+0000 7f2cb306d640 1 -- start start 2024-04-25T13:16:38.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f2cb306d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2cac06e390 0x7f2cac06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f2cb306d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cac159c80 con 0x7f2cac1598a0 2024-04-25T13:16:38.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f2cb306d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cac06f5f0 con 0x7f2cac0c3800 2024-04-25T13:16:38.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f2cb306d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2cac0c7d10 con 0x7f2cac06e390 2024-04-25T13:16:38.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f2cb286c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2cac06e390 0x7f2cac06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f2cb286c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2cac06e390 0x7f2cac06e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:42856/0 (socket says 172.21.15.52:42856) 2024-04-25T13:16:38.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f2cb286c640 1 -- 172.21.15.52:0/2389500636 learned_addr learned my addr 172.21.15.52:0/2389500636 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:38.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f2cb286c640 1 -- 172.21.15.52:0/2389500636 >> v1:172.21.15.102:6789/0 conn(0x7f2cac0c3800 legacy=0x7f2cac0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f2cb286c640 1 -- 172.21.15.52:0/2389500636 >> v1:172.21.15.52:6789/0 conn(0x7f2cac1598a0 legacy=0x7f2cac160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f2cb286c640 1 -- 172.21.15.52:0/2389500636 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac0c6f50 con 0x7f2cac06e390 2024-04-25T13:16:38.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f84b7fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f84b004ba60 0x7f84b00e3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:54908/0 (socket says 172.21.15.52:54908) 2024-04-25T13:16:38.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f84b7fff640 1 -- 172.21.15.52:0/1625675337 learned_addr learned my addr 172.21.15.52:0/1625675337 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:38.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f84bd40f640 1 --2- 172.21.15.52:0/1625675337 >> v2:172.21.15.102:3300/0 conn(0x7f84b00e37a0 0x7f84b004be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f84b77fe640 1 -- 172.21.15.52:0/1625675337 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326518104 0 0) 0x7f84a4001110 con 0x7f84b004ba60 2024-04-25T13:16:38.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f84b77fe640 1 -- 172.21.15.52:0/1625675337 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84a8003520 con 0x7f84b004ba60 2024-04-25T13:16:38.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f84bd40f640 1 -- 172.21.15.52:0/1625675337 >> v1:172.21.15.102:6789/0 conn(0x7f84b004ba60 legacy=0x7f84b00e3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f84bd40f640 1 -- 172.21.15.52:0/1625675337 >> v1:172.21.15.52:6789/0 conn(0x7f84b00dd3c0 legacy=0x7f84b0046460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f84bd40f640 1 -- 172.21.15.52:0/1625675337 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b00e3bd0 con 0x7f84b00e37a0 2024-04-25T13:16:38.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7fcd8959a640 1 -- 172.21.15.52:0/2241533421 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 633353564 0 0) 0x7fcd8c06f270 con 0x7fcd8c0c8160 2024-04-25T13:16:38.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7fcd8959a640 1 -- 172.21.15.52:0/2241533421 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd74003520 con 0x7fcd8c0c8160 2024-04-25T13:16:38.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7fcd8a59c640 1 -- 172.21.15.52:0/2241533421 >> v2:172.21.15.52:3300/0 conn(0x7fcd8c06ec30 msgr2=0x7fcd8c155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7fcd8a59c640 1 --2- 172.21.15.52:0/2241533421 >> v2:172.21.15.52:3300/0 conn(0x7fcd8c06ec30 0x7fcd8c155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7fcd8a59c640 1 -- 172.21.15.52:0/2241533421 >> v1:172.21.15.102:6789/0 conn(0x7fcd8c0c8160 legacy=0x7fcd8c154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7fcd8a59c640 1 -- 172.21.15.52:0/2241533421 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c0c7280 con 0x7fcd8c06e850 2024-04-25T13:16:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f393a529640 1 -- start start 2024-04-25T13:16:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f4003fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3ffc04bc70 0x7f3ffc005ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46182/0 (socket says 172.21.15.52:46182) 2024-04-25T13:16:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f4003fff640 1 -- 172.21.15.52:0/847747933 learned_addr learned my addr 172.21.15.52:0/847747933 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f4008e1f640 1 --2- 172.21.15.52:0/847747933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ffc0dd360 0x7f3ffc0e6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228073409 0 0) 0x7f3ffc04c570 con 0x7f3ffc04bc70 2024-04-25T13:16:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ff4003520 con 0x7f3ffc04bc70 2024-04-25T13:16:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3801226306 0 0) 0x7f3ff4003520 con 0x7f3ffc04bc70 2024-04-25T13:16:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ffc0dd360 msgr2=0x7f3ffc0e6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 --2- 172.21.15.52:0/847747933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ffc0dd360 0x7f3ffc0e6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f8c769cd640 1 Processor -- start 2024-04-25T13:16:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 >> v1:172.21.15.102:6789/0 conn(0x7f3ffc04ab30 legacy=0x7f3ffc0ed8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc0e32e0 con 0x7f3ffc04bc70 2024-04-25T13:16:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f3ff0001670 con 0x7f3ffc04bc70 2024-04-25T13:16:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 >> v1:172.21.15.52:6789/0 conn(0x7f3ffc04bc70 legacy=0x7f3ffc005ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 --2- 172.21.15.52:0/847747933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ff40039e0 0x7f3ff4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 --2- 172.21.15.52:0/847747933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ff4004800 0x7f3ff4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 --2- 172.21.15.52:0/847747933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ff40051c0 0x7f3ff400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc0065d0 con 0x7f3ff40051c0 2024-04-25T13:16:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.673+0000 7f8c769cd640 1 -- start start 2024-04-25T13:16:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff400c010 con 0x7f3ff40039e0 2024-04-25T13:16:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff400c210 con 0x7f3ff4004800 2024-04-25T13:16:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f8c769cd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c70074fc0 0x7f8c700c3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f8c769cd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c700cc040 con 0x7f8c700cbc10 2024-04-25T13:16:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f8c769cd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c70157b90 con 0x7f8c700753a0 2024-04-25T13:16:38.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7fcd8a59c640 1 --2- 172.21.15.52:0/2241533421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd8c06e850 0x7fcd8c0c3b80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c06c320 tx=0x7fcd8402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0df7b9d7cde16a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f8c769cd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8c700ca980 con 0x7f8c70074fc0 2024-04-25T13:16:38.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f8c6f7fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8c700753a0 0x7f8c700cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:54936/0 (socket says 172.21.15.52:54936) 2024-04-25T13:16:38.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f8c6f7fe640 1 -- 172.21.15.52:0/799064380 learned_addr learned my addr 172.21.15.52:0/799064380 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:38.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f8c6ffff640 1 --2- 172.21.15.52:0/799064380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c70074fc0 0x7f8c700c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f84bd40f640 1 --2- 172.21.15.52:0/1625675337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b00e37a0 0x7f84b004be80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0097a0 tx=0x7f84ac02a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40c7e69d04cc496e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.672+0000 7f5e51098640 1 -- 172.21.15.52:0/1255397430 wait complete. 2024-04-25T13:16:38.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f400b083640 1 --2- 172.21.15.52:0/847747933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ff40051c0 0x7f3ff400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7f4008e1f640 1 --2- 172.21.15.52:0/847747933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ff40039e0 0x7f3ff4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7fcd8959a640 1 -- 172.21.15.52:0/2241533421 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84007740 con 0x7fcd8c06e850 2024-04-25T13:16:38.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7fcd8959a640 1 -- 172.21.15.52:0/2241533421 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd840078e0 con 0x7fcd8c06e850 2024-04-25T13:16:38.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.674+0000 7fcd8959a640 1 -- 172.21.15.52:0/2241533421 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84007cb0 con 0x7fcd8c06e850 2024-04-25T13:16:38.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f84b77fe640 1 -- 172.21.15.52:0/1625675337 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac037070 con 0x7f84b00e37a0 2024-04-25T13:16:38.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f4003fff640 1 --2- 172.21.15.52:0/847747933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ff4004800 0x7f3ff4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f84b77fe640 1 -- 172.21.15.52:0/1625675337 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ac032440 con 0x7f84b00e37a0 2024-04-25T13:16:38.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f84b77fe640 1 -- 172.21.15.52:0/1625675337 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac032850 con 0x7f84b00e37a0 2024-04-25T13:16:38.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f8c6effd640 1 -- 172.21.15.52:0/799064380 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197669387 0 0) 0x7f8c70157b90 con 0x7f8c700753a0 2024-04-25T13:16:38.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f8c6effd640 1 -- 172.21.15.52:0/799064380 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c60005730 con 0x7f8c700753a0 2024-04-25T13:16:38.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f5e51098640 1 Processor -- start 2024-04-25T13:16:38.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f393a529640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f392c006f60 0x7f392c0e33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f4008e1f640 1 -- 172.21.15.52:0/847747933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ff4004800 msgr2=0x7f3ff4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f4008e1f640 1 --2- 172.21.15.52:0/847747933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ff4004800 0x7f3ff4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f4008e1f640 1 -- 172.21.15.52:0/847747933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ff40051c0 msgr2=0x7f3ff400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f4008e1f640 1 --2- 172.21.15.52:0/847747933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ff40051c0 0x7f3ff400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f4008e1f640 1 -- 172.21.15.52:0/847747933 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff4003520 con 0x7f3ff40039e0 2024-04-25T13:16:38.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f393a529640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0e6950 0x7f392c007340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f39337fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0e6950 0x7f392c007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f84bdc10640 1 -- 172.21.15.52:0/1625675337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b00e37a0 msgr2=0x7f84b004be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f84bdc10640 1 --2- 172.21.15.52:0/1625675337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b00e37a0 0x7f84b004be80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0097a0 tx=0x7f84ac02a200 comp rx=0 tx=0).stop 2024-04-25T13:16:38.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f39337fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0e6950 0x7f392c007340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:45644/0 (socket says 172.21.15.52:45644) 2024-04-25T13:16:38.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f39337fe640 1 -- 172.21.15.52:0/2014819126 learned_addr learned my addr 172.21.15.52:0/2014819126 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:38.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f84bdc10640 1 -- 172.21.15.52:0/1625675337 shutdown_connections 2024-04-25T13:16:38.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f84bdc10640 1 --2- 172.21.15.52:0/1625675337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b00e37a0 0x7f84b004be80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f84bdc10640 1 -- 172.21.15.52:0/1625675337 >> 172.21.15.52:0/1625675337 conn(0x7f84b0050180 msgr2=0x7f84b0050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f84bdc10640 1 -- 172.21.15.52:0/1625675337 shutdown_connections 2024-04-25T13:16:38.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f8c6ffff640 1 -- 172.21.15.52:0/799064380 >> v1:172.21.15.102:6789/0 conn(0x7f8c700753a0 legacy=0x7f8c700cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f8c6ffff640 1 -- 172.21.15.52:0/799064380 >> v1:172.21.15.52:6789/0 conn(0x7f8c700cbc10 legacy=0x7f8c70150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f393a529640 1 -- 172.21.15.52:0/2014819126 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392c04b9e0 con 0x7f392c007880 2024-04-25T13:16:38.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f3933fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f392c006f60 0x7f392c0e33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f8c6ffff640 1 -- 172.21.15.52:0/799064380 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c70157e70 con 0x7f8c70074fc0 2024-04-25T13:16:38.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f84bdc10640 1 -- 172.21.15.52:0/1625675337 wait complete. 2024-04-25T13:16:38.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f393a529640 1 -- 172.21.15.52:0/2014819126 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f392c04bd10 con 0x7f392c006f60 2024-04-25T13:16:38.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f393a529640 1 -- 172.21.15.52:0/2014819126 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f392c0e3a20 con 0x7f392c0e6950 2024-04-25T13:16:38.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f315759e640 1 Processor -- start 2024-04-25T13:16:38.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424868937 0 0) 0x7f392c04b9e0 con 0x7f392c007880 2024-04-25T13:16:38.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f315759e640 1 -- start start 2024-04-25T13:16:38.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3924003520 con 0x7f392c007880 2024-04-25T13:16:38.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.675+0000 7f5e51098640 1 -- start start 2024-04-25T13:16:38.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f5e51098640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e4c0c86e0 0x7f5e4c13d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f5e51098640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e4c0cc600 0x7f5e4c1576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f5e51098640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e4c0cc9e0 0x7f5e4c13ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f2cb286c640 1 --2- 172.21.15.52:0/2389500636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cac06e390 0x7f2cac06e7a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009e50 tx=0x7f2ca402a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55c487685c1afc48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 151176699 0 0) 0x7f3924003520 con 0x7f392c007880 2024-04-25T13:16:38.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f4008e1f640 1 --2- 172.21.15.52:0/847747933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ff40039e0 0x7f3ff4003e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f400406ab50 tx=0x7f3ff4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1f910f865b0d514 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004050bd0 con 0x7f3ff40039e0 2024-04-25T13:16:38.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40040ad600 con 0x7f3ff40039e0 2024-04-25T13:16:38.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f40037fe640 1 -- 172.21.15.52:0/847747933 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40040ada30 con 0x7f3ff40039e0 2024-04-25T13:16:38.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7fcd90951640 1 -- 172.21.15.52:0/2241533421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd8c06e850 msgr2=0x7fcd8c0c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7fcd90951640 1 --2- 172.21.15.52:0/2241533421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd8c06e850 0x7fcd8c0c3b80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c06c320 tx=0x7fcd8402a710 comp rx=0 tx=0).stop 2024-04-25T13:16:38.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0e6950 msgr2=0x7f392c007340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 --2- 172.21.15.52:0/2014819126 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0e6950 0x7f392c007340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f2cb1069640 1 -- 172.21.15.52:0/2389500636 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4036070 con 0x7f2cac06e390 2024-04-25T13:16:38.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7fcd90951640 1 -- 172.21.15.52:0/2241533421 shutdown_connections 2024-04-25T13:16:38.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7fcd90951640 1 --2- 172.21.15.52:0/2241533421 >> v2:172.21.15.52:3300/0 conn(0x7fcd8c06ec30 0x7fcd8c155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7fcd90951640 1 --2- 172.21.15.52:0/2241533421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd8c06e850 0x7fcd8c0c3b80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7fcd90951640 1 -- 172.21.15.52:0/2241533421 >> 172.21.15.52:0/2241533421 conn(0x7fcd8c0c8f00 msgr2=0x7fcd8c0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f2cb1069640 1 -- 172.21.15.52:0/2389500636 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca4031600 con 0x7f2cac06e390 2024-04-25T13:16:38.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f8c6ffff640 1 --2- 172.21.15.52:0/799064380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c70074fc0 0x7f8c700c3900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00a8f0 tx=0x7f8c5c02a220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfcde6d74ea7d2ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f5e51098640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c0c4010 con 0x7f5e4c0cc600 2024-04-25T13:16:38.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f5e51098640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c163280 con 0x7f5e4c0c86e0 2024-04-25T13:16:38.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f5e51098640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5e4c15f9d0 con 0x7f5e4c0cc9e0 2024-04-25T13:16:38.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f5e4bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e4c0c86e0 0x7f5e4c13d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f5e4bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e4c0c86e0 0x7f5e4c13d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:42884/0 (socket says 172.21.15.52:42884) 2024-04-25T13:16:38.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f5e4bfff640 1 -- 172.21.15.52:0/4293876735 learned_addr learned my addr 172.21.15.52:0/4293876735 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:38.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f5e4b7fe640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e4c0cc600 0x7f5e4c1576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.676+0000 7f5e50897640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e4c0cc9e0 0x7f5e4c13ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f5e4b7fe640 1 -- 172.21.15.52:0/4293876735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e4c0cc9e0 msgr2=0x7f5e4c13ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f5e4b7fe640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e4c0cc9e0 0x7f5e4c13ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f5e4b7fe640 1 -- 172.21.15.52:0/4293876735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e4c0c86e0 msgr2=0x7f5e4c13d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f5e4b7fe640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e4c0c86e0 0x7f5e4c13d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f5e4b7fe640 1 -- 172.21.15.52:0/4293876735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c0cbbd0 con 0x7f5e4c0cc600 2024-04-25T13:16:38.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 >> v2:172.21.15.102:3300/0 conn(0x7f392c006f60 msgr2=0x7f392c0e33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 --2- 172.21.15.52:0/2014819126 >> v2:172.21.15.102:3300/0 conn(0x7f392c006f60 0x7f392c0e33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c0e3d00 con 0x7f392c007880 2024-04-25T13:16:38.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f3934074ad0 con 0x7f392c007880 2024-04-25T13:16:38.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 >> v1:172.21.15.102:6789/0 conn(0x7f392c007880 legacy=0x7f392c04c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 --2- 172.21.15.52:0/2014819126 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39240039b0 0x7f3924003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 --2- 172.21.15.52:0/2014819126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3924004350 0x7f3924004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 --2- 172.21.15.52:0/2014819126 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3924004ef0 0x7f392400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f392c04bd10 con 0x7f3924004350 2024-04-25T13:16:38.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0e3a20 con 0x7f39240039b0 2024-04-25T13:16:38.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f392400bf00 con 0x7f3924004ef0 2024-04-25T13:16:38.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f8c6effd640 1 -- 172.21.15.52:0/799064380 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c037070 con 0x7f8c70074fc0 2024-04-25T13:16:38.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f8c6effd640 1 -- 172.21.15.52:0/799064380 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5c032440 con 0x7f8c70074fc0 2024-04-25T13:16:38.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3938ac6640 1 --2- 172.21.15.52:0/2014819126 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3924004ef0 0x7f392400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.677+0000 7f3933fff640 1 --2- 172.21.15.52:0/2014819126 >> v2:172.21.15.102:3300/0 conn(0x7f392c006f60 0x7f392c0e33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:38.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f8c6effd640 1 -- 172.21.15.52:0/799064380 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c032810 con 0x7f8c70074fc0 2024-04-25T13:16:38.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f315759e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f31500343d0 0x7f3150034840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f315759e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315004bb80 con 0x7f31500d7020 2024-04-25T13:16:38.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f315759e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315004be60 con 0x7f315004c470 2024-04-25T13:16:38.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f315759e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f315004b930 con 0x7f31500343d0 2024-04-25T13:16:38.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7fcd90951640 1 -- 172.21.15.52:0/2241533421 shutdown_connections 2024-04-25T13:16:38.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f3938ac6640 1 -- 172.21.15.52:0/2014819126 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39240039b0 msgr2=0x7f3924003dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:16:38.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f3938ac6640 1 --2- 172.21.15.52:0/2014819126 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39240039b0 0x7f3924003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f3938ac6640 1 -- 172.21.15.52:0/2014819126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3924004350 msgr2=0x7f3924004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7fcd90951640 1 -- 172.21.15.52:0/2241533421 wait complete. 2024-04-25T13:16:38.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f39337fe640 1 --2- 172.21.15.52:0/2014819126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3924004350 0x7f3924004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f5e4b7fe640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e4c0cc600 0x7f5e4c1576a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5e40031000 tx=0x7f5e400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f2cb306d640 1 -- 172.21.15.52:0/2389500636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cac06e390 msgr2=0x7f2cac06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f2cb306d640 1 --2- 172.21.15.52:0/2389500636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cac06e390 0x7f2cac06e7a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009e50 tx=0x7f2ca402a780 comp rx=0 tx=0).stop 2024-04-25T13:16:38.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f315659c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f31500d7020 0x7f31500e0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46232/0 (socket says 172.21.15.52:46232) 2024-04-25T13:16:38.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f4009620640 1 -- 172.21.15.52:0/847747933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ff40039e0 msgr2=0x7f3ff4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f4009620640 1 --2- 172.21.15.52:0/847747933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ff40039e0 0x7f3ff4003e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f400406ab50 tx=0x7f3ff4005830 comp rx=0 tx=0).stop 2024-04-25T13:16:38.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f84bdc10640 1 Processor -- start 2024-04-25T13:16:38.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f315659c640 1 -- 172.21.15.52:0/617643062 learned_addr learned my addr 172.21.15.52:0/617643062 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:38.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f400b083640 1 -- 172.21.15.52:0/847747933 reap_dead start 2024-04-25T13:16:38.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f84bdc10640 1 -- start start 2024-04-25T13:16:38.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f4009620640 1 -- 172.21.15.52:0/847747933 shutdown_connections 2024-04-25T13:16:38.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f4009620640 1 -- 172.21.15.52:0/847747933 >> 172.21.15.52:0/847747933 conn(0x7f3ffc0501b0 msgr2=0x7f3ffc0505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f5e48ff9640 1 -- 172.21.15.52:0/4293876735 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40040020 con 0x7f5e4c0cc600 2024-04-25T13:16:38.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f5e48ff9640 1 -- 172.21.15.52:0/4293876735 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e40038040 con 0x7f5e4c0cc600 2024-04-25T13:16:38.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f5e48ff9640 1 -- 172.21.15.52:0/4293876735 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40037070 con 0x7f5e4c0cc600 2024-04-25T13:16:38.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f3938ac6640 1 --2- 172.21.15.52:0/2014819126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3924004350 0x7f3924004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f3938ac6640 1 -- 172.21.15.52:0/2014819126 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c0e3d00 con 0x7f3924004ef0 2024-04-25T13:16:38.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f39337fe640 1 --2- 172.21.15.52:0/2014819126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3924004350 0x7f3924004820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:38.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f8c769cd640 1 -- 172.21.15.52:0/799064380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c70074fc0 msgr2=0x7f8c700c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f8c769cd640 1 --2- 172.21.15.52:0/799064380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c70074fc0 0x7f8c700c3900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00a8f0 tx=0x7f8c5c02a220 comp rx=0 tx=0).stop 2024-04-25T13:16:38.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f8c769cd640 1 -- 172.21.15.52:0/799064380 shutdown_connections 2024-04-25T13:16:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f8c769cd640 1 --2- 172.21.15.52:0/799064380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c70074fc0 0x7f8c700c3900 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f8c769cd640 1 -- 172.21.15.52:0/799064380 >> 172.21.15.52:0/799064380 conn(0x7f8c700c8cf0 msgr2=0x7f8c700c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f2cb306d640 1 -- 172.21.15.52:0/2389500636 shutdown_connections 2024-04-25T13:16:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f2cb306d640 1 --2- 172.21.15.52:0/2389500636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cac06e390 0x7f2cac06e7a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f2cb306d640 1 -- 172.21.15.52:0/2389500636 >> 172.21.15.52:0/2389500636 conn(0x7f2cac0c8e00 msgr2=0x7f2cac0c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.678+0000 7f2cb306d640 1 -- 172.21.15.52:0/2389500636 shutdown_connections 2024-04-25T13:16:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f3156d9d640 1 --2- 172.21.15.52:0/617643062 >> v2:172.21.15.102:3300/0 conn(0x7f31500343d0 0x7f3150034840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f2cb306d640 1 -- 172.21.15.52:0/2389500636 wait complete. 2024-04-25T13:16:38.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f5e51098640 1 -- 172.21.15.52:0/4293876735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4c1569e0 con 0x7f5e4c0cc600 2024-04-25T13:16:38.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f3938ac6640 1 --2- 172.21.15.52:0/2014819126 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3924004ef0 0x7f392400b9c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f393406aa90 tx=0x7f3924005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a9b8e0c0aa7f2e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f315559a640 1 -- 172.21.15.52:0/617643062 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1731604252 0 0) 0x7f315004bb80 con 0x7f31500d7020 2024-04-25T13:16:38.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f315559a640 1 -- 172.21.15.52:0/617643062 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3140003520 con 0x7f31500d7020 2024-04-25T13:16:38.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f315559a640 1 -- 172.21.15.52:0/617643062 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4199321435 0 0) 0x7f315004be60 con 0x7f315004c470 2024-04-25T13:16:38.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39340b4070 con 0x7f3924004ef0 2024-04-25T13:16:38.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39340a7b30 con 0x7f3924004ef0 2024-04-25T13:16:38.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f3932ffd640 1 -- 172.21.15.52:0/2014819126 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934068cc0 con 0x7f3924004ef0 2024-04-25T13:16:38.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f5e51098640 1 -- 172.21.15.52:0/4293876735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e4c158450 con 0x7f5e4c0cc600 2024-04-25T13:16:38.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f4009620640 1 -- 172.21.15.52:0/847747933 shutdown_connections 2024-04-25T13:16:38.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f315559a640 1 -- 172.21.15.52:0/617643062 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f315004bb80 con 0x7f315004c470 2024-04-25T13:16:38.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7f84bdc10640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b004ba60 0x7f84b004a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7fcd90951640 1 Processor -- start 2024-04-25T13:16:38.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7f84bcc0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b004ba60 0x7f84b004a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7f84bcc0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b004ba60 0x7f84b004a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49828/0 (socket says 172.21.15.52:49828) 2024-04-25T13:16:38.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7f393a529640 1 -- 172.21.15.52:0/2014819126 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3924004ef0 msgr2=0x7f392400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7f393a529640 1 --2- 172.21.15.52:0/2014819126 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3924004ef0 0x7f392400b9c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f393406aa90 tx=0x7f3924005830 comp rx=0 tx=0).stop 2024-04-25T13:16:38.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7f3938ac6640 1 -- 172.21.15.52:0/2014819126 reap_dead start 2024-04-25T13:16:38.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7f84bcc0e640 1 -- 172.21.15.52:0/1045278387 learned_addr learned my addr 172.21.15.52:0/1045278387 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:38.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7f84bdc10640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84b00dd3c0 0x7f84b0178e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7f2cb306d640 1 Processor -- start 2024-04-25T13:16:38.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7f315559a640 1 -- 172.21.15.52:0/617643062 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3912265334 0 0) 0x7f315004bb80 con 0x7f315004c470 2024-04-25T13:16:38.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f3156d9d640 1 -- 172.21.15.52:0/617643062 >> v1:172.21.15.102:6789/0 conn(0x7f315004c470 legacy=0x7f3150033cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f84bdc10640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b00e37a0 0x7f84b004aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7fcd90951640 1 -- start start 2024-04-25T13:16:38.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f3156d9d640 1 -- 172.21.15.52:0/617643062 >> v1:172.21.15.52:6789/0 conn(0x7f31500d7020 legacy=0x7f31500e0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f84b7fff640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84b00dd3c0 0x7f84b0178e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f3156d9d640 1 -- 172.21.15.52:0/617643062 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315004c140 con 0x7f31500343d0 2024-04-25T13:16:38.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.680+0000 7f4009620640 1 -- 172.21.15.52:0/847747933 wait complete. 2024-04-25T13:16:38.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f84bd40f640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b00e37a0 0x7f84b004aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84b00456a0 con 0x7f84b004ba60 2024-04-25T13:16:38.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f393a529640 1 -- 172.21.15.52:0/2014819126 shutdown_connections 2024-04-25T13:16:38.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f393a529640 1 -- 172.21.15.52:0/2014819126 >> 172.21.15.52:0/2014819126 conn(0x7f392c0061d0 msgr2=0x7f392c0065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f5e51098640 1 -- 172.21.15.52:0/4293876735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e4c158830 con 0x7f5e4c0cc600 2024-04-25T13:16:38.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f393a529640 1 -- 172.21.15.52:0/2014819126 shutdown_connections 2024-04-25T13:16:38.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f393a529640 1 -- 172.21.15.52:0/2014819126 wait complete. 2024-04-25T13:16:38.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7fcd90951640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd8c06e850 0x7fcd8c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f84b0045fd0 con 0x7f84b00e37a0 2024-04-25T13:16:38.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7fcd90951640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd8c06ec30 0x7fcd8c1e7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f84b0045980 con 0x7f84b00dd3c0 2024-04-25T13:16:38.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7fcd8a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd8c06e850 0x7fcd8c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7fcd8a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd8c06e850 0x7fcd8c0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:42910/0 (socket says 172.21.15.52:42910) 2024-04-25T13:16:38.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7fcd89d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd8c06ec30 0x7fcd8c1e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7fcd89d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd8c06ec30 0x7fcd8c1e7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:45684/0 (socket says 172.21.15.52:45684) 2024-04-25T13:16:38.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7fcd8a59c640 1 -- 172.21.15.52:0/920840829 learned_addr learned my addr 172.21.15.52:0/920840829 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:38.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7fcd90951640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd8c0c8160 0x7fcd8c146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f4009620640 1 Processor -- start 2024-04-25T13:16:38.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f4009620640 1 -- start start 2024-04-25T13:16:38.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f2cb306d640 1 -- start start 2024-04-25T13:16:38.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f2cb306d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac06e390 0x7f2cac1f9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f2cb306d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cac0c3800 0x7f2cac1579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f2cb306d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2cac1598a0 0x7f2cac1f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f2cb306d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac0c7880 con 0x7f2cac06e390 2024-04-25T13:16:38.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7fcd90951640 1 -- 172.21.15.52:0/920840829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c06f4a0 con 0x7fcd8c0c8160 2024-04-25T13:16:38.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f2cb306d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac0c6d00 con 0x7f2cac0c3800 2024-04-25T13:16:38.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f2cb306d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2cac0c7510 con 0x7f2cac1598a0 2024-04-25T13:16:38.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7fcd90951640 1 -- 172.21.15.52:0/920840829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c0c7840 con 0x7fcd8c06e850 2024-04-25T13:16:38.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7fcd90951640 1 -- 172.21.15.52:0/920840829 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8c06f620 con 0x7fcd8c06ec30 2024-04-25T13:16:38.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f3156d9d640 1 --2- 172.21.15.52:0/617643062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31500343d0 0x7f3150034840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31480097a0 tx=0x7f314802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ce9703e2feb8169 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f84bcc0e640 1 -- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84b00dd3c0 msgr2=0x7f84b0178e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f84bcc0e640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84b00dd3c0 0x7f84b0178e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f2cb186a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cac0c3800 0x7f2cac1579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f2cb186a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cac0c3800 0x7f2cac1579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:42920/0 (socket says 172.21.15.52:42920) 2024-04-25T13:16:38.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f2cb186a640 1 -- 172.21.15.52:0/1322714597 learned_addr learned my addr 172.21.15.52:0/1322714597 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:38.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f84bcc0e640 1 -- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b00e37a0 msgr2=0x7f84b004aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f84bcc0e640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84b00e37a0 0x7f84b004aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f315559a640 1 -- 172.21.15.52:0/617643062 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148037070 con 0x7f31500343d0 2024-04-25T13:16:38.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f2cb286c640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2cac1598a0 0x7f2cac1f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f315559a640 1 -- 172.21.15.52:0/617643062 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f314802aaf0 con 0x7f31500343d0 2024-04-25T13:16:38.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f8c769cd640 1 -- 172.21.15.52:0/799064380 shutdown_connections 2024-04-25T13:16:38.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.679+0000 7f8c769cd640 1 -- 172.21.15.52:0/799064380 wait complete. 2024-04-25T13:16:38.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f315559a640 1 -- 172.21.15.52:0/617643062 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148037070 con 0x7f31500343d0 2024-04-25T13:16:38.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.681+0000 7f8c769cd640 1 Processor -- start 2024-04-25T13:16:38.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f8c769cd640 1 -- start start 2024-04-25T13:16:38.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.682+0000 7f84bcc0e640 1 -- 172.21.15.52:0/1045278387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b00da900 con 0x7f84b004ba60 2024-04-25T13:16:38.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7fcd8ad9d640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd8c0c8160 0x7fcd8c146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f2cb206b640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac06e390 0x7f2cac1f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7fcd8a59c640 1 -- 172.21.15.52:0/920840829 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd8c06ec30 msgr2=0x7fcd8c1e7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7fcd8a59c640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd8c06ec30 0x7fcd8c1e7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7fcd8a59c640 1 -- 172.21.15.52:0/920840829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd8c0c8160 msgr2=0x7fcd8c146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7fcd8a59c640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd8c0c8160 0x7fcd8c146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7fcd8a59c640 1 -- 172.21.15.52:0/920840829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c1566f0 con 0x7fcd8c06e850 2024-04-25T13:16:38.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f4009620640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ffc04f110 0x7f3ffc0474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f4009620640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ffc04a0f0 0x7f3ffc04f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f4009620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc1816f0 0x7f3ffc181b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7fcd89d9b640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd8c06ec30 0x7fcd8c1e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:38.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f8c769cd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c70074fc0 0x7f8c701f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f8c769cd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c700753a0 0x7f8c701557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f8c769cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c700cbc10 0x7f8c701f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f8c769cd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8c700ca610 con 0x7f8c70074fc0 2024-04-25T13:16:38.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f8c769cd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8c700ca330 con 0x7f8c700cbc10 2024-04-25T13:16:38.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f8c769cd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8c70075a00 con 0x7f8c700753a0 2024-04-25T13:16:38.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f2cb286c640 1 -- 172.21.15.52:0/1322714597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cac0c3800 msgr2=0x7f2cac1579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f2cb286c640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cac0c3800 0x7f2cac1579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f2cb286c640 1 -- 172.21.15.52:0/1322714597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac06e390 msgr2=0x7f2cac1f9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f4009620640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc0e38a0 con 0x7f3ffc04f110 2024-04-25T13:16:38.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f2cb286c640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cac06e390 0x7f2cac1f9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f2cb286c640 1 -- 172.21.15.52:0/1322714597 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac160390 con 0x7f2cac1598a0 2024-04-25T13:16:38.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f4009620640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc0dd740 con 0x7f3ffc1816f0 2024-04-25T13:16:38.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f4009620640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3ffc0e2f90 con 0x7f3ffc04a0f0 2024-04-25T13:16:38.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f393a529640 1 Processor -- start 2024-04-25T13:16:38.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f400b083640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc1816f0 0x7f3ffc181b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f400b083640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc1816f0 0x7f3ffc181b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:42952/0 (socket says 172.21.15.52:42952) 2024-04-25T13:16:38.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f400b083640 1 -- 172.21.15.52:0/2645204335 learned_addr learned my addr 172.21.15.52:0/2645204335 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:38.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7fcd8a59c640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd8c06e850 0x7fcd8c0cbc50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009e80 tx=0x7fcd84004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f8c6f7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c700753a0 0x7f8c701557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f8c6f7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c700753a0 0x7f8c701557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:45704/0 (socket says 172.21.15.52:45704) 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f8c6f7fe640 1 -- 172.21.15.52:0/1655371746 learned_addr learned my addr 172.21.15.52:0/1655371746 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f8c74f6a640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c700cbc10 0x7f8c701f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f8c6ffff640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c70074fc0 0x7f8c701f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f2cb286c640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2cac1598a0 0x7f2cac1f5930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2cac075ef0 tx=0x7f2ca4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.683+0000 7f5e48ff9640 1 -- 172.21.15.52:0/4293876735 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5e40043020 con 0x7f5e4c0cc600 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f393a529640 1 -- start start 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f2ca2ffd640 1 -- 172.21.15.52:0/1322714597 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4041030 con 0x7f2cac1598a0 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f84bcc0e640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b004ba60 0x7f84b004a050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f84b8050f50 tx=0x7f84b8069e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7fcd7affd640 1 -- 172.21.15.52:0/920840829 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84040070 con 0x7fcd8c06e850 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7fcd7affd640 1 -- 172.21.15.52:0/920840829 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd84031bc0 con 0x7fcd8c06e850 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7fcd7affd640 1 -- 172.21.15.52:0/920840829 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8403c420 con 0x7fcd8c06e850 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7fcd90951640 1 -- 172.21.15.52:0/920840829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8c1572c0 con 0x7fcd8c06e850 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f8c6f7fe640 1 -- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c700cbc10 msgr2=0x7f8c701f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f8c6f7fe640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c700cbc10 0x7f8c701f4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f8c6f7fe640 1 -- 172.21.15.52:0/1655371746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c70074fc0 msgr2=0x7f8c701f01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f8c6f7fe640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c70074fc0 0x7f8c701f01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f8c6f7fe640 1 -- 172.21.15.52:0/1655371746 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c70071310 con 0x7f8c700753a0 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7fcd90951640 1 -- 172.21.15.52:0/920840829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8c157880 con 0x7fcd8c06e850 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f2cb306d640 1 -- 172.21.15.52:0/1322714597 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cac15c080 con 0x7f2cac1598a0 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f2cb306d640 1 -- 172.21.15.52:0/1322714597 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cac15c640 con 0x7f2cac1598a0 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f8c6f7fe640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c700753a0 0x7f8c701557b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800c7c0 tx=0x7f8c6800cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f2ca2ffd640 1 -- 172.21.15.52:0/1322714597 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca40317f0 con 0x7f2cac1598a0 2024-04-25T13:16:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f2ca2ffd640 1 -- 172.21.15.52:0/1322714597 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4036040 con 0x7f2cac1598a0 2024-04-25T13:16:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f4008e1f640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ffc04f110 0x7f3ffc0474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f5e48ff9640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5e3806c9f0 0x7f5e3806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f315759e640 1 -- 172.21.15.52:0/617643062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31500343d0 msgr2=0x7f3150034840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f5e48ff9640 1 -- 172.21.15.52:0/4293876735 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5e400ac1a0 con 0x7f5e4c0cc600 2024-04-25T13:16:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f5e48ff9640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] conn(0x7f5e38076160 0x7f5e380785a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f5e48ff9640 1 -- 172.21.15.52:0/4293876735 --> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e4000af30 con 0x7f5e38076160 2024-04-25T13:16:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f5e48ff9640 1 -- 172.21.15.52:0/4293876735 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5e400b3050 con 0x7f5e4c0cc600 2024-04-25T13:16:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f5e4bfff640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5e3806c9f0 0x7f5e3806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f84b57fa640 1 -- 172.21.15.52:0/1045278387 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8074460 con 0x7f84b004ba60 2024-04-25T13:16:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f84b57fa640 1 -- 172.21.15.52:0/1045278387 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b80763a0 con 0x7f84b004ba60 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f84b57fa640 1 -- 172.21.15.52:0/1045278387 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b806bb60 con 0x7f84b004ba60 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b017ca00 con 0x7f84b004ba60 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b017cfc0 con 0x7f84b004ba60 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f393a529640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3924004ef0 0x7f392c0e3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f393a529640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0e1720 0x7f392c0d6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f3933fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3924004ef0 0x7f392c0e3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.686+0000 7f3933fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3924004ef0 0x7f392c0e3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49860/0 (socket says 172.21.15.52:49860) 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f400b083640 1 -- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ffc04a0f0 msgr2=0x7f3ffc04f4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f400b083640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ffc04a0f0 0x7f3ffc04f4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f400b083640 1 -- 172.21.15.52:0/2645204335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ffc04f110 msgr2=0x7f3ffc0474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f400b083640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ffc04f110 0x7f3ffc0474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f400b083640 1 -- 172.21.15.52:0/2645204335 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc184d90 con 0x7f3ffc1816f0 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f400b083640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc1816f0 0x7f3ffc181b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00e6d0 tx=0x7f3ff800f840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f8c6cff9640 1 -- 172.21.15.52:0/1655371746 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c68016020 con 0x7f8c700753a0 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f8c6cff9640 1 -- 172.21.15.52:0/1655371746 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6800aa50 con 0x7f8c700753a0 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f8c769cd640 1 -- 172.21.15.52:0/1655371746 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c701f0710 con 0x7f8c700753a0 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f8c769cd640 1 -- 172.21.15.52:0/1655371746 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c700c6e70 con 0x7f8c700753a0 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f8c6cff9640 1 -- 172.21.15.52:0/1655371746 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800ae40 con 0x7f8c700753a0 2024-04-25T13:16:38.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f393a529640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392c0e1ba0 0x7f392c0d69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.686+0000 7f39337fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0e1720 0x7f392c0d6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.686+0000 7f39337fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0e1720 0x7f392c0d6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:45716/0 (socket says 172.21.15.52:45716) 2024-04-25T13:16:38.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.686+0000 7f2cb306d640 1 -- 172.21.15.52:0/1322714597 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2c94001030 con 0x7f2cac1598a0 2024-04-25T13:16:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.686+0000 7f5e4bfff640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5e3806c9f0 0x7f5e3806eeb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5e440012e0 tx=0x7f5e44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.686+0000 7fcd78ff9640 1 -- 172.21.15.52:0/920840829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd70001030 con 0x7fcd8c06e850 2024-04-25T13:16:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.686+0000 7f3933fff640 1 -- 172.21.15.52:0/665488065 learned_addr learned my addr 172.21.15.52:0/665488065 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.686+0000 7f3938ac6640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392c0e1ba0 0x7f392c0d69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.686+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f392c04c8b0 con 0x7f3924004ef0 2024-04-25T13:16:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0e42c0 con 0x7f392c0e1ba0 2024-04-25T13:16:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f40017fa640 1 -- 172.21.15.52:0/2645204335 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80052e0 con 0x7f3ffc1816f0 2024-04-25T13:16:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.685+0000 7f40017fa640 1 -- 172.21.15.52:0/2645204335 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff8018070 con 0x7f3ffc1816f0 2024-04-25T13:16:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.686+0000 7f40017fa640 1 -- 172.21.15.52:0/2645204335 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8003850 con 0x7f3ffc1816f0 2024-04-25T13:16:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f392c04ca30 con 0x7f392c0e1720 2024-04-25T13:16:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.684+0000 7f315759e640 1 --2- 172.21.15.52:0/617643062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31500343d0 0x7f3150034840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31480097a0 tx=0x7f314802a060 comp rx=0 tx=0).stop 2024-04-25T13:16:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f315759e640 1 -- 172.21.15.52:0/617643062 shutdown_connections 2024-04-25T13:16:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f315759e640 1 --2- 172.21.15.52:0/617643062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31500343d0 0x7f3150034840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f315759e640 1 -- 172.21.15.52:0/617643062 >> 172.21.15.52:0/617643062 conn(0x7f3150050180 msgr2=0x7f3150050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.686+0000 7fcd7affd640 1 -- 172.21.15.52:0/920840829 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd84039040 con 0x7fcd8c06e850 2024-04-25T13:16:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f4009620640 1 -- 172.21.15.52:0/2645204335 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ffc047b50 con 0x7f3ffc1816f0 2024-04-25T13:16:38.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f5e50897640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] conn(0x7f5e38076160 0x7f5e380785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f8c769cd640 1 -- 172.21.15.52:0/1655371746 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c70068cc0 con 0x7f8c700753a0 2024-04-25T13:16:38.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f2ca2ffd640 1 -- 172.21.15.52:0/1322714597 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ca4044070 con 0x7f2cac1598a0 2024-04-25T13:16:38.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f315759e640 1 -- 172.21.15.52:0/617643062 shutdown_connections 2024-04-25T13:16:38.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f4009620640 1 -- 172.21.15.52:0/2645204335 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ffc047e10 con 0x7f3ffc1816f0 2024-04-25T13:16:38.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f8c6cff9640 1 -- 172.21.15.52:0/1655371746 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c68019020 con 0x7f8c700753a0 2024-04-25T13:16:38.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84b0005390 con 0x7f84b004ba60 2024-04-25T13:16:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f3938ac6640 1 -- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0e1720 msgr2=0x7f392c0d6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f3938ac6640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f392c0e1720 0x7f392c0d6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f3938ac6640 1 -- 172.21.15.52:0/665488065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3924004ef0 msgr2=0x7f392c0e3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f3938ac6640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3924004ef0 0x7f392c0e3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f3938ac6640 1 -- 172.21.15.52:0/665488065 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c0d84b0 con 0x7f392c0e1ba0 2024-04-25T13:16:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7f315759e640 1 -- 172.21.15.52:0/617643062 wait complete. 2024-04-25T13:16:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f3933fff640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3924004ef0 0x7f392c0e3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f2ca2ffd640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2c9006c8f0 0x7f2c9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f3938ac6640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392c0e1ba0 0x7f392c0d69d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3934064fa0 tx=0x7f393406b520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.687+0000 7fcd7affd640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcd6c06c9f0 0x7fcd6c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7fcd89d9b640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcd6c06c9f0 0x7fcd6c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7fcd7affd640 1 -- 172.21.15.52:0/920840829 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcd840ad120 con 0x7fcd8c06e850 2024-04-25T13:16:38.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f8c6cff9640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8c5406c940 0x7f8c5406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f84b57fa640 1 -- 172.21.15.52:0/1045278387 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84b806bd00 con 0x7f84b004ba60 2024-04-25T13:16:38.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f2ca2ffd640 1 -- 172.21.15.52:0/1322714597 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2ca40acee0 con 0x7f2cac1598a0 2024-04-25T13:16:38.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f2ca2ffd640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] conn(0x7f2c90075fe0 0x7f2c90078420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f2ca2ffd640 1 -- 172.21.15.52:0/1322714597 --> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ca4035e90 con 0x7f2c90075fe0 2024-04-25T13:16:38.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f5e50897640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] conn(0x7f5e38076160 0x7f5e380785a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7fcd89d9b640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcd6c06c9f0 0x7fcd6c06eeb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c1e8230 tx=0x7fcd80007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7fcd7affd640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] conn(0x7fcd6c076160 0x7fcd6c0785a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f8c6cff9640 1 -- 172.21.15.52:0/1655371746 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8c6808bf70 con 0x7f8c700753a0 2024-04-25T13:16:38.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f84b57fa640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f849c06c9c0 0x7f849c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7fcd7affd640 1 -- 172.21.15.52:0/920840829 --> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd6c078c70 con 0x7fcd6c076160 2024-04-25T13:16:38.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7fcd7affd640 1 -- 172.21.15.52:0/920840829 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcd840b4050 con 0x7fcd8c06e850 2024-04-25T13:16:38.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7f2cb206b640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2c9006c8f0 0x7f2c9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7f84b57fa640 1 -- 172.21.15.52:0/1045278387 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f84b8107830 con 0x7f84b004ba60 2024-04-25T13:16:38.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7f8c6cff9640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] conn(0x7f8c540760b0 0x7f8c540784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7f8c6cff9640 1 -- 172.21.15.52:0/1655371746 --> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c68010e50 con 0x7f8c540760b0 2024-04-25T13:16:38.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7f8c6cff9640 1 -- 172.21.15.52:0/1655371746 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8c68093050 con 0x7f8c700753a0 2024-04-25T13:16:38.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7f84b7fff640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f849c06c9c0 0x7f849c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7fcd8ad9d640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] conn(0x7fcd6c076160 0x7fcd6c0785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7f2cb186a640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] conn(0x7f2c90075fe0 0x7f2c90078420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7f8c74f6a640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] conn(0x7f8c540760b0 0x7f8c540784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7f2ca2ffd640 1 -- 172.21.15.52:0/1322714597 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2ca4076ad0 con 0x7f2cac1598a0 2024-04-25T13:16:38.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7f315759e640 1 Processor -- start 2024-04-25T13:16:38.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f3930ff9640 1 -- 172.21.15.52:0/665488065 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39340b4040 con 0x7f392c0e1ba0 2024-04-25T13:16:38.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c0d8730 con 0x7f392c0e1ba0 2024-04-25T13:16:38.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c04f7f0 con 0x7f392c0e1ba0 2024-04-25T13:16:38.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f3930ff9640 1 -- 172.21.15.52:0/665488065 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3934074ad0 con 0x7f392c0e1ba0 2024-04-25T13:16:38.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7f8c6ffff640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8c5406c940 0x7f8c5406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.688+0000 7f3930ff9640 1 -- 172.21.15.52:0/665488065 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934068cc0 con 0x7f392c0e1ba0 2024-04-25T13:16:38.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.689+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f392c005810 con 0x7f392c0e1ba0 2024-04-25T13:16:38.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.690+0000 7f315759e640 1 -- start start 2024-04-25T13:16:38.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.690+0000 7f2cb186a640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] conn(0x7f2c90075fe0 0x7f2c90078420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.690+0000 7f2cb206b640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2c9006c8f0 0x7f2c9006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c004ea0 tx=0x7f2c9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.690+0000 7f5e48ff9640 1 -- 172.21.15.52:0/4293876735 <== osd.1 v2:172.21.15.52:6800/760490446 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e4000af30 con 0x7f5e38076160 2024-04-25T13:16:38.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.690+0000 7fcd8ad9d640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] conn(0x7fcd6c076160 0x7fcd6c0785a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.690+0000 7f84b57fa640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] conn(0x7f849c076140 0x7f849c078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.690+0000 7f84b57fa640 1 -- 172.21.15.52:0/1045278387 --> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84b8096e50 con 0x7f849c076140 2024-04-25T13:16:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.690+0000 7f84b57fa640 1 -- 172.21.15.52:0/1045278387 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f84b810c2a0 con 0x7f84b004ba60 2024-04-25T13:16:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.690+0000 7f3930ff9640 1 -- 172.21.15.52:0/665488065 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39340c0020 con 0x7f392c0e1ba0 2024-04-25T13:16:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.690+0000 7f8c6ffff640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8c5406c940 0x7f8c5406ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c034000 tx=0x7f8c5c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.690+0000 7f4009620640 1 -- 172.21.15.52:0/2645204335 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ffc0d73e0 con 0x7f3ffc1816f0 2024-04-25T13:16:38.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.690+0000 7f84b7fff640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f849c06c9c0 0x7f849c06ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f84b00da890 tx=0x7f84a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f3930ff9640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f391806c940 0x7f391806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f2ca2ffd640 1 -- 172.21.15.52:0/1322714597 <== osd.0 v2:172.21.15.52:6817/4019725320 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ca4035e90 con 0x7f2c90075fe0 2024-04-25T13:16:38.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f3930ff9640 1 -- 172.21.15.52:0/665488065 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3934050bd0 con 0x7f392c0e1ba0 2024-04-25T13:16:38.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f315759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31500343d0 0x7f31500d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f84bd40f640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] conn(0x7f849c076140 0x7f849c078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f3930ff9640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] conn(0x7f39180760c0 0x7f3918078500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f3930ff9640 1 -- 172.21.15.52:0/665488065 --> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39340c0e80 con 0x7f39180760c0 2024-04-25T13:16:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f3930ff9640 1 -- 172.21.15.52:0/665488065 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f393412a460 con 0x7f392c0e1ba0 2024-04-25T13:16:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f8c74f6a640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] conn(0x7f8c540760b0 0x7f8c540784f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f315659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31500343d0 0x7f31500d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f315659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31500343d0 0x7f31500d2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49870/0 (socket says 172.21.15.52:49870) 2024-04-25T13:16:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f315659c640 1 -- 172.21.15.52:0/396633729 learned_addr learned my addr 172.21.15.52:0/396633729 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:38.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f39337fe640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] conn(0x7f39180760c0 0x7f3918078500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f315759e640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f315004c470 0x7f315016ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f315759e640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31500d7020 0x7f315016b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f3933fff640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f391806c940 0x7f391806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f315759e640 1 -- 172.21.15.52:0/396633729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f31500e0fa0 con 0x7f31500343d0 2024-04-25T13:16:38.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f40017fa640 1 -- 172.21.15.52:0/2645204335 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ff80039f0 con 0x7f3ffc1816f0 2024-04-25T13:16:38.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.691+0000 7f40017fa640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3fe806c9f0 0x7f3fe806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f315759e640 1 -- 172.21.15.52:0/396633729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f31500e0400 con 0x7f31500d7020 2024-04-25T13:16:38.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f315759e640 1 -- 172.21.15.52:0/396633729 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f315004c8b0 con 0x7f315004c470 2024-04-25T13:16:38.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f84bd40f640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] conn(0x7f849c076140 0x7f849c078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f3155d9b640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f315004c470 0x7f315016ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7fcd7affd640 1 -- 172.21.15.52:0/920840829 <== osd.3 v2:172.21.15.52:6816/3429485352 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcd6c078c70 con 0x7fcd6c076160 2024-04-25T13:16:38.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f40017fa640 1 -- 172.21.15.52:0/2645204335 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3ff808b420 con 0x7f3ffc1816f0 2024-04-25T13:16:38.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f40017fa640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] conn(0x7f3fe80760e0 0x7f3fe8078520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f40017fa640 1 -- 172.21.15.52:0/2645204335 --> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ff8018070 con 0x7f3fe80760e0 2024-04-25T13:16:38.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f3156d9d640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31500d7020 0x7f315016b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f40017fa640 1 -- 172.21.15.52:0/2645204335 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3ff8092050 con 0x7f3ffc1816f0 2024-04-25T13:16:38.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f4003fff640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] conn(0x7f3fe80760e0 0x7f3fe8078520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f4008e1f640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3fe806c9f0 0x7f3fe806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f8c6cff9640 1 -- 172.21.15.52:0/1655371746 <== osd.7 v2:172.21.15.102:6816/3909993822 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c68010e50 con 0x7f8c540760b0 2024-04-25T13:16:38.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f3155d9b640 1 -- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31500d7020 msgr2=0x7f315016b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f3155d9b640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31500d7020 0x7f315016b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f3155d9b640 1 -- 172.21.15.52:0/396633729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31500343d0 msgr2=0x7f31500d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f3155d9b640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31500343d0 0x7f31500d2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.692+0000 7f3155d9b640 1 -- 172.21.15.52:0/396633729 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3150178f60 con 0x7f315004c470 2024-04-25T13:16:38.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.693+0000 7f3933fff640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f391806c940 0x7f391806ee00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3928006d40 tx=0x7f3928008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.693+0000 7f39337fe640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] conn(0x7f39180760c0 0x7f3918078500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.693+0000 7f3155d9b640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f315004c470 0x7f315016ac40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c7a0 tx=0x7f314c00cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.693+0000 7f3146ffd640 1 -- 172.21.15.52:0/396633729 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c016020 con 0x7f315004c470 2024-04-25T13:16:38.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.693+0000 7f3146ffd640 1 -- 172.21.15.52:0/396633729 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f314c00aa70 con 0x7f315004c470 2024-04-25T13:16:38.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.693+0000 7f3146ffd640 1 -- 172.21.15.52:0/396633729 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c00ae60 con 0x7f315004c470 2024-04-25T13:16:38.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.693+0000 7f84b57fa640 1 -- 172.21.15.52:0/1045278387 <== osd.2 v2:172.21.15.52:6808/3392002317 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f84b8096e50 con 0x7f849c076140 2024-04-25T13:16:38.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.693+0000 7f315759e640 1 -- 172.21.15.52:0/396633729 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3150179240 con 0x7f315004c470 2024-04-25T13:16:38.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.693+0000 7f4008e1f640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3fe806c9f0 0x7f3fe806eeb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400c1e0 tx=0x7f40040ab000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.693+0000 7f315759e640 1 -- 172.21.15.52:0/396633729 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3150179800 con 0x7f315004c470 2024-04-25T13:16:38.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.693+0000 7f4003fff640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] conn(0x7f3fe80760e0 0x7f3fe8078520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.694+0000 7f3930ff9640 1 -- 172.21.15.52:0/665488065 <== osd.4 v2:172.21.15.102:6808/3635677901 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39340c0e80 con 0x7f39180760c0 2024-04-25T13:16:38.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.694+0000 7f40017fa640 1 -- 172.21.15.52:0/2645204335 <== osd.6 v2:172.21.15.102:6800/1825391266 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ff8018070 con 0x7f3fe80760e0 2024-04-25T13:16:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.695+0000 7f315759e640 1 -- 172.21.15.52:0/396633729 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f313c001030 con 0x7f315004c470 2024-04-25T13:16:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.696+0000 7f3146ffd640 1 -- 172.21.15.52:0/396633729 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f314c019020 con 0x7f315004c470 2024-04-25T13:16:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.696+0000 7f3146ffd640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f313806c940 0x7f313806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.696+0000 7f315659c640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f313806c940 0x7f313806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.697+0000 7f3146ffd640 1 -- 172.21.15.52:0/396633729 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f314c057b40 con 0x7f315004c470 2024-04-25T13:16:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.697+0000 7f3146ffd640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] conn(0x7f3138076d00 0x7f31380791a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.697+0000 7f3146ffd640 1 -- 172.21.15.52:0/396633729 --> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3138079870 con 0x7f3138076d00 2024-04-25T13:16:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.697+0000 7f315659c640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f313806c940 0x7f313806ee00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3158051690 tx=0x7f315806e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.698+0000 7f3156d9d640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] conn(0x7f3138076d00 0x7f31380791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.698+0000 7f3146ffd640 1 -- 172.21.15.52:0/396633729 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f314c0564d0 con 0x7f315004c470 2024-04-25T13:16:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.698+0000 7f3156d9d640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] conn(0x7f3138076d00 0x7f31380791a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.699+0000 7f3146ffd640 1 -- 172.21.15.52:0/396633729 <== osd.5 v2:172.21.15.102:6824/82766007 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3138079870 con 0x7f3138076d00 2024-04-25T13:16:38.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.723+0000 7f8c769cd640 1 -- 172.21.15.52:0/1655371746 --> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c7014d2e0 con 0x7f8c540760b0 2024-04-25T13:16:38.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.723+0000 7fcd78ff9640 1 -- 172.21.15.52:0/920840829 --> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcd70002dd0 con 0x7fcd6c076160 2024-04-25T13:16:38.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.724+0000 7f5e51098640 1 -- 172.21.15.52:0/4293876735 --> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e4c068cc0 con 0x7f5e38076160 2024-04-25T13:16:38.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.724+0000 7fcd7affd640 1 -- 172.21.15.52:0/920840829 <== osd.3 v2:172.21.15.52:6816/3429485352 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcd70002dd0 con 0x7fcd6c076160 2024-04-25T13:16:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.724+0000 7f8c6cff9640 1 -- 172.21.15.52:0/1655371746 <== osd.7 v2:172.21.15.102:6816/3909993822 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8c7014d2e0 con 0x7f8c540760b0 2024-04-25T13:16:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7f2cb306d640 1 -- 172.21.15.52:0/1322714597 --> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2c94002dd0 con 0x7f2c90075fe0 2024-04-25T13:16:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7f5e48ff9640 1 -- 172.21.15.52:0/4293876735 <== osd.1 v2:172.21.15.52:6800/760490446 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5e4c068cc0 con 0x7f5e38076160 2024-04-25T13:16:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7fcd78ff9640 1 -- 172.21.15.52:0/920840829 >> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] conn(0x7fcd6c076160 msgr2=0x7fcd6c0785a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7fcd78ff9640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] conn(0x7fcd6c076160 0x7fcd6c0785a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7fcd78ff9640 1 -- 172.21.15.52:0/920840829 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcd6c06c9f0 msgr2=0x7fcd6c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7fcd78ff9640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcd6c06c9f0 0x7fcd6c06eeb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c1e8230 tx=0x7fcd80007d30 comp rx=0 tx=0).stop 2024-04-25T13:16:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7fcd78ff9640 1 -- 172.21.15.52:0/920840829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd8c06e850 msgr2=0x7fcd8c0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7fcd78ff9640 1 --2- 172.21.15.52:0/920840829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd8c06e850 0x7fcd8c0cbc50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009e80 tx=0x7fcd84004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7fcd8ad9d640 1 -- 172.21.15.52:0/920840829 reap_dead start 2024-04-25T13:16:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7f8c769cd640 1 -- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] conn(0x7f8c540760b0 msgr2=0x7f8c540784f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7f8c769cd640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] conn(0x7f8c540760b0 0x7f8c540784f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7f2ca2ffd640 1 -- 172.21.15.52:0/1322714597 <== osd.0 v2:172.21.15.52:6817/4019725320 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2c94002dd0 con 0x7f2c90075fe0 2024-04-25T13:16:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7f8c769cd640 1 -- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8c5406c940 msgr2=0x7f8c5406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f8c769cd640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8c5406c940 0x7f8c5406ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c034000 tx=0x7f8c5c02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7fcd78ff9640 1 -- 172.21.15.52:0/920840829 shutdown_connections 2024-04-25T13:16:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7fcd78ff9640 1 -- 172.21.15.52:0/920840829 >> 172.21.15.52:0/920840829 conn(0x7fcd8c0c8f00 msgr2=0x7fcd8c0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f8c769cd640 1 -- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c700753a0 msgr2=0x7f8c701557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f8c769cd640 1 --2- 172.21.15.52:0/1655371746 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c700753a0 0x7f8c701557b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800c7c0 tx=0x7f8c6800cc80 comp rx=0 tx=0).stop 2024-04-25T13:16:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f8c74f6a640 1 -- 172.21.15.52:0/1655371746 reap_dead start 2024-04-25T13:16:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7fcd78ff9640 1 -- 172.21.15.52:0/920840829 shutdown_connections 2024-04-25T13:16:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7f5e51098640 1 -- 172.21.15.52:0/4293876735 >> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] conn(0x7f5e38076160 msgr2=0x7f5e380785a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.725+0000 7f5e51098640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] conn(0x7f5e38076160 0x7f5e380785a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7fcd78ff9640 1 -- 172.21.15.52:0/920840829 wait complete. 2024-04-25T13:16:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f8c769cd640 1 -- 172.21.15.52:0/1655371746 shutdown_connections 2024-04-25T13:16:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f8c769cd640 1 -- 172.21.15.52:0/1655371746 >> 172.21.15.52:0/1655371746 conn(0x7f8c700c8cf0 msgr2=0x7f8c7014dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f2cb306d640 1 -- 172.21.15.52:0/1322714597 >> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] conn(0x7f2c90075fe0 msgr2=0x7f2c90078420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f5e51098640 1 -- 172.21.15.52:0/4293876735 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5e3806c9f0 msgr2=0x7f5e3806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f5e51098640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5e3806c9f0 0x7f5e3806eeb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5e440012e0 tx=0x7f5e44009040 comp rx=0 tx=0).stop 2024-04-25T13:16:38.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f5e51098640 1 -- 172.21.15.52:0/4293876735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e4c0cc600 msgr2=0x7f5e4c1576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f5e51098640 1 --2- 172.21.15.52:0/4293876735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e4c0cc600 0x7f5e4c1576a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5e40031000 tx=0x7f5e400046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f8c769cd640 1 -- 172.21.15.52:0/1655371746 shutdown_connections 2024-04-25T13:16:38.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f8c769cd640 1 -- 172.21.15.52:0/1655371746 wait complete. 2024-04-25T13:16:38.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f2cb306d640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] conn(0x7f2c90075fe0 0x7f2c90078420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f2cb306d640 1 -- 172.21.15.52:0/1322714597 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2c9006c8f0 msgr2=0x7f2c9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.726+0000 7f5e50897640 1 -- 172.21.15.52:0/4293876735 reap_dead start 2024-04-25T13:16:38.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f2cb306d640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2c9006c8f0 0x7f2c9006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c004ea0 tx=0x7f2c9c009040 comp rx=0 tx=0).stop 2024-04-25T13:16:38.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f2cb306d640 1 -- 172.21.15.52:0/1322714597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2cac1598a0 msgr2=0x7f2cac1f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f2cb306d640 1 --2- 172.21.15.52:0/1322714597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2cac1598a0 0x7f2cac1f5930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2cac075ef0 tx=0x7f2ca4004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:38.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 --> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f84b004eac0 con 0x7f849c076140 2024-04-25T13:16:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f5e51098640 1 -- 172.21.15.52:0/4293876735 shutdown_connections 2024-04-25T13:16:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f5e51098640 1 -- 172.21.15.52:0/4293876735 >> 172.21.15.52:0/4293876735 conn(0x7f5e4c06eb20 msgr2=0x7f5e4c158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f5e51098640 1 -- 172.21.15.52:0/4293876735 shutdown_connections 2024-04-25T13:16:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f5e51098640 1 -- 172.21.15.52:0/4293876735 wait complete. 2024-04-25T13:16:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f2cb286c640 1 -- 172.21.15.52:0/1322714597 reap_dead start 2024-04-25T13:16:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f2cb306d640 1 -- 172.21.15.52:0/1322714597 shutdown_connections 2024-04-25T13:16:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f2cb306d640 1 -- 172.21.15.52:0/1322714597 >> 172.21.15.52:0/1322714597 conn(0x7f2cac0c8e00 msgr2=0x7f2cac0cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f2cb306d640 1 -- 172.21.15.52:0/1322714597 shutdown_connections 2024-04-25T13:16:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f2cb306d640 1 -- 172.21.15.52:0/1322714597 wait complete. 2024-04-25T13:16:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.727+0000 7f84b57fa640 1 -- 172.21.15.52:0/1045278387 <== osd.2 v2:172.21.15.52:6808/3392002317 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f84b004eac0 con 0x7f849c076140 2024-04-25T13:16:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.728+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 >> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] conn(0x7f849c076140 msgr2=0x7f849c078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.728+0000 7f84bdc10640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] conn(0x7f849c076140 0x7f849c078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.728+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f849c06c9c0 msgr2=0x7f849c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.728+0000 7f84bdc10640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f849c06c9c0 0x7f849c06ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f84b00da890 tx=0x7f84a4009040 comp rx=0 tx=0).stop 2024-04-25T13:16:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.728+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b004ba60 msgr2=0x7f84b004a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.728+0000 7f84bdc10640 1 --2- 172.21.15.52:0/1045278387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b004ba60 0x7f84b004a050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f84b8050f50 tx=0x7f84b8069e70 comp rx=0 tx=0).stop 2024-04-25T13:16:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.728+0000 7f84bd40f640 1 -- 172.21.15.52:0/1045278387 reap_dead start 2024-04-25T13:16:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.728+0000 7f4009620640 1 -- 172.21.15.52:0/2645204335 --> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3ffc04b670 con 0x7f3fe80760e0 2024-04-25T13:16:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.729+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 shutdown_connections 2024-04-25T13:16:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.729+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 >> 172.21.15.52:0/1045278387 conn(0x7f84b0050180 msgr2=0x7f84b00d8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.729+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 --> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f392c03a050 con 0x7f39180760c0 2024-04-25T13:16:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.729+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 shutdown_connections 2024-04-25T13:16:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.729+0000 7f84bdc10640 1 -- 172.21.15.52:0/1045278387 wait complete. 2024-04-25T13:16:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.729+0000 7f3930ff9640 1 -- 172.21.15.52:0/665488065 <== osd.4 v2:172.21.15.102:6808/3635677901 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f392c03a050 con 0x7f39180760c0 2024-04-25T13:16:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.729+0000 7f40017fa640 1 -- 172.21.15.52:0/2645204335 <== osd.6 v2:172.21.15.102:6800/1825391266 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3ffc04b670 con 0x7f3fe80760e0 2024-04-25T13:16:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.729+0000 7f4009620640 1 -- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] conn(0x7f3fe80760e0 msgr2=0x7f3fe8078520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f4009620640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] conn(0x7f3fe80760e0 0x7f3fe8078520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f4009620640 1 -- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3fe806c9f0 msgr2=0x7f3fe806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f4009620640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3fe806c9f0 0x7f3fe806eeb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400c1e0 tx=0x7f40040ab000 comp rx=0 tx=0).stop 2024-04-25T13:16:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f4009620640 1 -- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc1816f0 msgr2=0x7f3ffc181b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f4009620640 1 --2- 172.21.15.52:0/2645204335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ffc1816f0 0x7f3ffc181b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00e6d0 tx=0x7f3ff800f840 comp rx=0 tx=0).stop 2024-04-25T13:16:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f400b083640 1 -- 172.21.15.52:0/2645204335 reap_dead start 2024-04-25T13:16:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f4009620640 1 -- 172.21.15.52:0/2645204335 shutdown_connections 2024-04-25T13:16:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f4009620640 1 -- 172.21.15.52:0/2645204335 >> 172.21.15.52:0/2645204335 conn(0x7f3ffc0501b0 msgr2=0x7f3ffc0e21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] conn(0x7f39180760c0 msgr2=0x7f3918078500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f393a529640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] conn(0x7f39180760c0 0x7f3918078500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f4009620640 1 -- 172.21.15.52:0/2645204335 shutdown_connections 2024-04-25T13:16:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f391806c940 msgr2=0x7f391806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f393a529640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f391806c940 0x7f391806ee00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3928006d40 tx=0x7f3928008040 comp rx=0 tx=0).stop 2024-04-25T13:16:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.730+0000 7f315759e640 1 -- 172.21.15.52:0/396633729 --> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f313c002dd0 con 0x7f3138076d00 2024-04-25T13:16:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.731+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392c0e1ba0 msgr2=0x7f392c0d69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.731+0000 7f393a529640 1 --2- 172.21.15.52:0/665488065 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392c0e1ba0 0x7f392c0d69d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3934064fa0 tx=0x7f393406b520 comp rx=0 tx=0).stop 2024-04-25T13:16:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.731+0000 7f4009620640 1 -- 172.21.15.52:0/2645204335 wait complete. 2024-04-25T13:16:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.731+0000 7f3938ac6640 1 -- 172.21.15.52:0/665488065 reap_dead start 2024-04-25T13:16:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.731+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 shutdown_connections 2024-04-25T13:16:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.731+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 >> 172.21.15.52:0/665488065 conn(0x7f392c0061d0 msgr2=0x7f392c053560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.731+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 shutdown_connections 2024-04-25T13:16:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.731+0000 7f3146ffd640 1 -- 172.21.15.52:0/396633729 <== osd.5 v2:172.21.15.102:6824/82766007 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f313c002dd0 con 0x7f3138076d00 2024-04-25T13:16:38.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.731+0000 7f393a529640 1 -- 172.21.15.52:0/665488065 wait complete. 2024-04-25T13:16:38.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.732+0000 7f3144ff9640 1 -- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] conn(0x7f3138076d00 msgr2=0x7f31380791a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.732+0000 7f3144ff9640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] conn(0x7f3138076d00 0x7f31380791a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.732+0000 7f3144ff9640 1 -- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f313806c940 msgr2=0x7f313806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.732+0000 7f3144ff9640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f313806c940 0x7f313806ee00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3158051690 tx=0x7f315806e040 comp rx=0 tx=0).stop 2024-04-25T13:16:38.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.732+0000 7f3144ff9640 1 -- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f315004c470 msgr2=0x7f315016ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.732+0000 7f3144ff9640 1 --2- 172.21.15.52:0/396633729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f315004c470 0x7f315016ac40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c7a0 tx=0x7f314c00cc60 comp rx=0 tx=0).stop 2024-04-25T13:16:38.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.732+0000 7f3156d9d640 1 -- 172.21.15.52:0/396633729 reap_dead start 2024-04-25T13:16:38.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.732+0000 7f3144ff9640 1 -- 172.21.15.52:0/396633729 shutdown_connections 2024-04-25T13:16:38.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.732+0000 7f3144ff9640 1 -- 172.21.15.52:0/396633729 >> 172.21.15.52:0/396633729 conn(0x7f3150050180 msgr2=0x7f31500055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.734+0000 7f3144ff9640 1 -- 172.21.15.52:0/396633729 shutdown_connections 2024-04-25T13:16:38.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:38.734+0000 7f3144ff9640 1 -- 172.21.15.52:0/396633729 wait complete. 2024-04-25T13:16:38.791 INFO:teuthology.orchestra.run.smithi052.stdout:55834574858 2024-04-25T13:16:38.791 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T13:16:38.792 INFO:teuthology.orchestra.run.smithi052.stdout:55834574860 2024-04-25T13:16:38.792 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T13:16:38.793 INFO:teuthology.orchestra.run.smithi052.stdout:55834574859 2024-04-25T13:16:38.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T13:16:38.794 INFO:teuthology.orchestra.run.smithi052.stdout:55834574859 2024-04-25T13:16:38.794 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T13:16:38.795 INFO:teuthology.orchestra.run.smithi052.stdout:55834574859 2024-04-25T13:16:38.795 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T13:16:38.796 INFO:teuthology.orchestra.run.smithi052.stdout:55834574859 2024-04-25T13:16:38.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T13:16:38.797 INFO:teuthology.orchestra.run.smithi052.stdout:55834574861 2024-04-25T13:16:38.797 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T13:16:38.798 INFO:teuthology.orchestra.run.smithi052.stdout:55834574860 2024-04-25T13:16:38.798 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T13:16:39.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.007+0000 7fb6133ad640 1 Processor -- start 2024-04-25T13:16:39.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.007+0000 7fb6133ad640 1 -- start start 2024-04-25T13:16:39.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.007+0000 7f4e3de13640 1 Processor -- start 2024-04-25T13:16:39.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7fb6133ad640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb60c1554e0 0x7fb60c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.008+0000 7f4e3de13640 1 -- start start 2024-04-25T13:16:39.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7f4e3de13640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4e38151e70 0x7f4e380cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7f4e3de13640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e380c88f0 0x7f4e380cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7f4e3de13640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e38157e60 con 0x7f4e380ca610 2024-04-25T13:16:39.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7f4e3de13640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4e38157c30 con 0x7f4e38151e70 2024-04-25T13:16:39.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7f4e3de13640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4e38158100 con 0x7f4e380c88f0 2024-04-25T13:16:39.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7fb6133ad640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb60c0d08a0 0x7fb60c0d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7fb6133ad640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60c1558c0 con 0x7fb60c0b3c00 2024-04-25T13:16:39.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7f460a0ae640 1 Processor -- start 2024-04-25T13:16:39.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7fb611149640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb60c1554e0 0x7fb60c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7fb611149640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb60c1554e0 0x7fb60c15f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55082/0 (socket says 172.21.15.52:55082) 2024-04-25T13:16:39.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7fb611149640 1 -- 172.21.15.52:0/1557354048 learned_addr learned my addr 172.21.15.52:0/1557354048 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7fb61194a640 1 --2- 172.21.15.52:0/1557354048 >> v2:172.21.15.102:3300/0 conn(0x7fb60c0d08a0 0x7fb60c0d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7fb6133ad640 1 -- 172.21.15.52:0/1557354048 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb60c0b4a80 con 0x7fb60c1554e0 2024-04-25T13:16:39.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7fb6133ad640 1 -- 172.21.15.52:0/1557354048 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb60c15f630 con 0x7fb60c0d08a0 2024-04-25T13:16:39.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7f403bdc6640 1 Processor -- start 2024-04-25T13:16:39.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7fb611149640 1 -- 172.21.15.52:0/1557354048 >> v2:172.21.15.102:3300/0 conn(0x7fb60c0d08a0 msgr2=0x7fb60c0d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7fb611149640 1 --2- 172.21.15.52:0/1557354048 >> v2:172.21.15.102:3300/0 conn(0x7fb60c0d08a0 0x7fb60c0d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7fb611149640 1 -- 172.21.15.52:0/1557354048 >> v1:172.21.15.52:6789/0 conn(0x7fb60c0b3c00 legacy=0x7fb60c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7f4e36ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e380c88f0 0x7f4e380cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7f4e36ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e380c88f0 0x7f4e380cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:41908/0 (socket says 172.21.15.52:41908) 2024-04-25T13:16:39.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7f4e36ffd640 1 -- 172.21.15.52:0/1747010435 learned_addr learned my addr 172.21.15.52:0/1747010435 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7f4e36ffd640 1 -- 172.21.15.52:0/1747010435 >> v2:172.21.15.102:3300/0 conn(0x7f4e38151e70 msgr2=0x7f4e380cd890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:16:39.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7f4e36ffd640 1 --2- 172.21.15.52:0/1747010435 >> v2:172.21.15.102:3300/0 conn(0x7f4e38151e70 0x7f4e380cd890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7f4e36ffd640 1 -- 172.21.15.52:0/1747010435 >> v1:172.21.15.102:6789/0 conn(0x7f4e380ca610 legacy=0x7f4e38072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7f4e36ffd640 1 -- 172.21.15.52:0/1747010435 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e381583a0 con 0x7f4e380c88f0 2024-04-25T13:16:39.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7f403bdc6640 1 -- start start 2024-04-25T13:16:39.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.009+0000 7f460a0ae640 1 -- start start 2024-04-25T13:16:39.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7f460a0ae640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46040cdfa0 0x7f4604072250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7f460a0ae640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4604157e60 con 0x7f4604151e70 2024-04-25T13:16:39.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7f460a0ae640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4604158100 con 0x7f46040c88f0 2024-04-25T13:16:39.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7f460a0ae640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4604157c30 con 0x7f46040cdfa0 2024-04-25T13:16:39.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.011+0000 7f4603fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f46040c88f0 0x7f4604072790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:52950/0 (socket says 172.21.15.52:52950) 2024-04-25T13:16:39.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.011+0000 7f4603fff640 1 -- 172.21.15.52:0/2189855028 learned_addr learned my addr 172.21.15.52:0/2189855028 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:39.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.010+0000 7fb611149640 1 -- 172.21.15.52:0/1557354048 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60c0cb8c0 con 0x7fb60c1554e0 2024-04-25T13:16:39.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.011+0000 7f4602ffd640 1 --2- 172.21.15.52:0/2189855028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46040cdfa0 0x7f4604072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.011+0000 7f4e36ffd640 1 --2- 172.21.15.52:0/1747010435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e380c88f0 0x7f4e380cddd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c010bb0 tx=0x7f4e2c032c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f0f9f7c1921416a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.011+0000 7f4e367fc640 1 -- 172.21.15.52:0/1747010435 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c040070 con 0x7f4e380c88f0 2024-04-25T13:16:39.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.011+0000 7f4e367fc640 1 -- 172.21.15.52:0/1747010435 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c0339a0 con 0x7f4e380c88f0 2024-04-25T13:16:39.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.011+0000 7f4e367fc640 1 -- 172.21.15.52:0/1747010435 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c033db0 con 0x7f4e380c88f0 2024-04-25T13:16:39.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.012+0000 7fb611149640 1 --2- 172.21.15.52:0/1557354048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb60c1554e0 0x7fb60c15f0f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb60c08e520 tx=0x7fb60802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c3977e011071d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.011+0000 7f4602ffd640 1 -- 172.21.15.52:0/2189855028 >> v1:172.21.15.102:6789/0 conn(0x7f46040c88f0 legacy=0x7f4604072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.012+0000 7f4039b62640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f403406e850 0x7f4034150f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43210/0 (socket says 172.21.15.52:43210) 2024-04-25T13:16:39.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.011+0000 7f4602ffd640 1 -- 172.21.15.52:0/2189855028 >> v1:172.21.15.52:6789/0 conn(0x7f4604151e70 legacy=0x7f46040cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.012+0000 7f4039b62640 1 -- 172.21.15.52:0/701681934 learned_addr learned my addr 172.21.15.52:0/701681934 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:39.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.011+0000 7f4602ffd640 1 -- 172.21.15.52:0/2189855028 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46041583a0 con 0x7f46040cdfa0 2024-04-25T13:16:39.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.012+0000 7f403bdc6640 1 --2- 172.21.15.52:0/701681934 >> v2:172.21.15.102:3300/0 conn(0x7f403406f870 0x7f40341570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.012+0000 7fb603fff640 1 -- 172.21.15.52:0/1557354048 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608037070 con 0x7fb60c1554e0 2024-04-25T13:16:39.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.012+0000 7fb603fff640 1 -- 172.21.15.52:0/1557354048 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb608032440 con 0x7fb60c1554e0 2024-04-25T13:16:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.012+0000 7f4e3de13640 1 -- 172.21.15.52:0/1747010435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e380c88f0 msgr2=0x7f4e380cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.012+0000 7f4e3de13640 1 --2- 172.21.15.52:0/1747010435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e380c88f0 0x7f4e380cddd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c010bb0 tx=0x7f4e2c032c50 comp rx=0 tx=0).stop 2024-04-25T13:16:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.012+0000 7f403bdc6640 1 -- 172.21.15.52:0/701681934 --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40340c46b0 con 0x7f403406e850 2024-04-25T13:16:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.012+0000 7f4919413640 1 Processor -- start 2024-04-25T13:16:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f4e3de13640 1 -- 172.21.15.52:0/1747010435 shutdown_connections 2024-04-25T13:16:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f4e3de13640 1 --2- 172.21.15.52:0/1747010435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e380c88f0 0x7f4e380cddd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7fb603fff640 1 -- 172.21.15.52:0/1557354048 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608037070 con 0x7fb60c1554e0 2024-04-25T13:16:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f1b65a7c640 1 Processor -- start 2024-04-25T13:16:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f4e3de13640 1 --2- 172.21.15.52:0/1747010435 >> v2:172.21.15.102:3300/0 conn(0x7f4e38151e70 0x7f4e380cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f4e3de13640 1 -- 172.21.15.52:0/1747010435 >> 172.21.15.52:0/1747010435 conn(0x7f4e3806b920 msgr2=0x7f4e3806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f4039361640 1 --2- 172.21.15.52:0/701681934 >> v2:172.21.15.102:3300/0 conn(0x7f403406f870 0x7f40341570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f4e3de13640 1 -- 172.21.15.52:0/1747010435 shutdown_connections 2024-04-25T13:16:39.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7ffb13fff640 1 Processor -- start 2024-04-25T13:16:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f4e3de13640 1 -- 172.21.15.52:0/1747010435 wait complete. 2024-04-25T13:16:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281067268 0 0) 0x7f40340c46b0 con 0x7f403406e850 2024-04-25T13:16:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f403bdc6640 1 -- 172.21.15.52:0/701681934 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40340c4990 con 0x7f403406ec30 2024-04-25T13:16:39.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7ffb13fff640 1 -- start start 2024-04-25T13:16:39.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f403bdc6640 1 -- 172.21.15.52:0/701681934 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f40340c4c70 con 0x7f403406f870 2024-04-25T13:16:39.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f4602ffd640 1 --2- 172.21.15.52:0/2189855028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46040cdfa0 0x7f4604072250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f46041582d0 tx=0x7f45fc02c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da685cc689a7d566 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4020003520 con 0x7f403406e850 2024-04-25T13:16:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f96a6491640 1 Processor -- start 2024-04-25T13:16:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7fb6133ad640 1 -- 172.21.15.52:0/1557354048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb60c1554e0 msgr2=0x7fb60c15f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f96a6491640 1 -- start start 2024-04-25T13:16:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7fb6133ad640 1 --2- 172.21.15.52:0/1557354048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb60c1554e0 0x7fb60c15f0f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb60c08e520 tx=0x7fb60802a2a0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f1b65a7c640 1 -- start start 2024-04-25T13:16:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.013+0000 7f4919413640 1 -- start start 2024-04-25T13:16:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4919413640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f49141554e0 0x7f491415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4919413640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 0x7f49140b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4919413640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f49140b5450 0x7f49140d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4919413640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f49140b4a80 con 0x7f49141554e0 2024-04-25T13:16:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4919413640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f49141558c0 con 0x7f49140b5450 2024-04-25T13:16:39.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4919413640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f491415f630 con 0x7f49140b3c00 2024-04-25T13:16:39.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112468705 0 0) 0x7f40340c4990 con 0x7f403406ec30 2024-04-25T13:16:39.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40340c46b0 con 0x7f403406ec30 2024-04-25T13:16:39.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f49127fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 0x7f49140b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1785307986 0 0) 0x7f4020003520 con 0x7f403406e850 2024-04-25T13:16:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 >> v2:172.21.15.102:3300/0 conn(0x7f403406f870 msgr2=0x7f40341570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4038b60640 1 --2- 172.21.15.52:0/701681934 >> v2:172.21.15.102:3300/0 conn(0x7f403406f870 0x7f40341570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 >> v1:172.21.15.102:6789/0 conn(0x7f403406ec30 legacy=0x7f4034161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40340c4f50 con 0x7f403406e850 2024-04-25T13:16:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7ffb13fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb1406e600 0x7ffb140c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f1b65a7c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1b58047450 0x7f1b580e08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f1b65a7c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b580e0df0 0x7f1b5804d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f1b65a7c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b580d72b0 con 0x7f1b580d6ed0 2024-04-25T13:16:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f1b65a7c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1b58047ae0 con 0x7f1b580e0df0 2024-04-25T13:16:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f1b65a7c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1b580e0420 con 0x7f1b58047450 2024-04-25T13:16:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4e3de13640 1 Processor -- start 2024-04-25T13:16:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4912ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f49141554e0 0x7f491415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7ffb13fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb140c3870 0x7ffb14150c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f49137fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f49140b5450 0x7f49140d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f49127fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 0x7f49140b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:41928/0 (socket says 172.21.15.52:41928) 2024-04-25T13:16:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f49127fc640 1 -- 172.21.15.52:0/4292783762 learned_addr learned my addr 172.21.15.52:0/4292783762 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f1b5effd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1b58047450 0x7f1b580e08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f1b5effd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1b58047450 0x7f1b580e08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:37252/0 (socket says 172.21.15.52:37252) 2024-04-25T13:16:39.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f1b5effd640 1 -- 172.21.15.52:0/370060319 learned_addr learned my addr 172.21.15.52:0/370060319 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f4e3de13640 1 -- start start 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f1b5ffff640 1 --2- 172.21.15.52:0/370060319 >> v2:172.21.15.52:3300/0 conn(0x7f1b580e0df0 0x7f1b5804d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7ffb12ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb1406e600 0x7ffb140c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7ffb12ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb1406e600 0x7ffb140c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55108/0 (socket says 172.21.15.52:55108) 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7fb6133ad640 1 -- 172.21.15.52:0/1557354048 shutdown_connections 2024-04-25T13:16:39.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7ffb12ffd640 1 -- 172.21.15.52:0/3924514810 learned_addr learned my addr 172.21.15.52:0/3924514810 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7fb6133ad640 1 --2- 172.21.15.52:0/1557354048 >> v2:172.21.15.102:3300/0 conn(0x7fb60c0d08a0 0x7fb60c0d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7fb6133ad640 1 --2- 172.21.15.52:0/1557354048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb60c1554e0 0x7fb60c15f0f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7ffb13fff640 1 -- 172.21.15.52:0/3924514810 --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb14157ef0 con 0x7ffb1406e9e0 2024-04-25T13:16:39.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7fb6133ad640 1 -- 172.21.15.52:0/1557354048 >> 172.21.15.52:0/1557354048 conn(0x7fb60c074d50 msgr2=0x7fb60c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7ffb13fff640 1 -- 172.21.15.52:0/3924514810 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ffb140c8600 con 0x7ffb1406e600 2024-04-25T13:16:39.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7ffb13fff640 1 -- 172.21.15.52:0/3924514810 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffb140c6d00 con 0x7ffb140c3870 2024-04-25T13:16:39.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f1b5effd640 1 -- 172.21.15.52:0/370060319 >> v2:172.21.15.52:3300/0 conn(0x7f1b580e0df0 msgr2=0x7f1b5804d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f1b5effd640 1 --2- 172.21.15.52:0/370060319 >> v2:172.21.15.52:3300/0 conn(0x7f1b580e0df0 0x7f1b5804d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f1b5effd640 1 -- 172.21.15.52:0/370060319 >> v1:172.21.15.102:6789/0 conn(0x7f1b580d6ed0 legacy=0x7f1b5804e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f1b5effd640 1 -- 172.21.15.52:0/370060319 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b580dd120 con 0x7f1b58047450 2024-04-25T13:16:39.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f49127fc640 1 -- 172.21.15.52:0/4292783762 >> v2:172.21.15.102:3300/0 conn(0x7f49140b5450 msgr2=0x7f49140d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f49127fc640 1 --2- 172.21.15.52:0/4292783762 >> v2:172.21.15.102:3300/0 conn(0x7f49140b5450 0x7f49140d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f49127fc640 1 -- 172.21.15.52:0/4292783762 >> v2:172.21.15.52:3300/0 conn(0x7f49141554e0 msgr2=0x7f491415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f46027fc640 1 -- 172.21.15.52:0/2189855028 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc039070 con 0x7f46040cdfa0 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f46027fc640 1 -- 172.21.15.52:0/2189855028 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45fc030050 con 0x7f46040cdfa0 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f96a6491640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f96a0151490 0x7f96a0157a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4039361640 1 --2- 172.21.15.52:0/701681934 >> v2:172.21.15.102:3300/0 conn(0x7f403406f870 0x7f40341570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f40300015f0 con 0x7f403406e850 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 >> v1:172.21.15.52:6789/0 conn(0x7f403406e850 legacy=0x7f4034150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4038b60640 1 --2- 172.21.15.52:0/701681934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4020003b90 0x7f4020003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.014+0000 7f4038b60640 1 --2- 172.21.15.52:0/701681934 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4020004800 0x7f4020004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f4038b60640 1 --2- 172.21.15.52:0/701681934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200051c0 0x7f40200079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40340c4c70 con 0x7f4020003b90 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4020007fc0 con 0x7f40200051c0 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f40200081c0 con 0x7f4020004800 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f4039361640 1 --2- 172.21.15.52:0/701681934 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4020004800 0x7f4020004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f403a363640 1 --2- 172.21.15.52:0/701681934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200051c0 0x7f40200079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f403a363640 1 -- 172.21.15.52:0/701681934 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4020004800 msgr2=0x7f4020004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f403a363640 1 --2- 172.21.15.52:0/701681934 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4020004800 0x7f4020004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f403a363640 1 -- 172.21.15.52:0/701681934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4020003b90 msgr2=0x7f4020003f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f403a363640 1 --2- 172.21.15.52:0/701681934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4020003b90 0x7f4020003f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f403a363640 1 -- 172.21.15.52:0/701681934 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4020003520 con 0x7f40200051c0 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f46027fc640 1 -- 172.21.15.52:0/2189855028 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc009760 con 0x7f46040cdfa0 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7f96a6491640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a006f4a0 0x7f96a006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f96a6491640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a006f230 con 0x7f96a01510b0 2024-04-25T13:16:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f96a6491640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f96a00c7140 con 0x7f96a0151490 2024-04-25T13:16:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f969ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f96a01510b0 0x7f96a00c3b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43238/0 (socket says 172.21.15.52:43238) 2024-04-25T13:16:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f969ffff640 1 -- 172.21.15.52:0/2863061093 learned_addr learned my addr 172.21.15.52:0/2863061093 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f96a6491640 1 -- 172.21.15.52:0/2863061093 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f96a00c7420 con 0x7f96a006f4a0 2024-04-25T13:16:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7ffb137fe640 1 --2- 172.21.15.52:0/3924514810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb140c3870 0x7ffb14150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f969f7fe640 1 --2- 172.21.15.52:0/2863061093 >> v2:172.21.15.52:3300/0 conn(0x7f96a0151490 0x7f96a0157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7ffb12ffd640 1 -- 172.21.15.52:0/3924514810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb140c3870 msgr2=0x7ffb14150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7ffb12ffd640 1 --2- 172.21.15.52:0/3924514810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb140c3870 0x7ffb14150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f4e3de13640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e380c88f0 0x7f4e38154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f4e3de13640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e380ca610 0x7f4e381550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7ffb12ffd640 1 -- 172.21.15.52:0/3924514810 >> v1:172.21.15.52:6789/0 conn(0x7ffb1406e9e0 legacy=0x7ffb140c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.015+0000 7ffb12ffd640 1 -- 172.21.15.52:0/3924514810 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb140c6f50 con 0x7ffb1406e600 2024-04-25T13:16:39.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f4e3de13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e38151e70 0x7f4e38156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f4e3de13640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4e38152250 con 0x7f4e380c88f0 2024-04-25T13:16:39.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f4e3de13640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4e38158920 con 0x7f4e38151e70 2024-04-25T13:16:39.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f4e3de13640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4e381523d0 con 0x7f4e380ca610 2024-04-25T13:16:39.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f96a4a2e640 1 --2- 172.21.15.52:0/2863061093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a006f4a0 0x7f96a006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7fb6133ad640 1 -- 172.21.15.52:0/1557354048 shutdown_connections 2024-04-25T13:16:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f403a363640 1 -- 172.21.15.52:0/701681934 reap_dead start 2024-04-25T13:16:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f460a0ae640 1 -- 172.21.15.52:0/2189855028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46040cdfa0 msgr2=0x7f4604072250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f1b5effd640 1 --2- 172.21.15.52:0/370060319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b58047450 0x7f1b580e08b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b580352c0 tx=0x7f1b4c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fa7db412bb857f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7fb6133ad640 1 -- 172.21.15.52:0/1557354048 wait complete. 2024-04-25T13:16:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f4e377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e380c88f0 0x7f4e38154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f4e377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e380c88f0 0x7f4e38154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55134/0 (socket says 172.21.15.52:55134) 2024-04-25T13:16:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f4e377fe640 1 -- 172.21.15.52:0/177442756 learned_addr learned my addr 172.21.15.52:0/177442756 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f460a0ae640 1 --2- 172.21.15.52:0/2189855028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46040cdfa0 0x7f4604072250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f46041582d0 tx=0x7f45fc02c890 comp rx=0 tx=0).stop 2024-04-25T13:16:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f460a0ae640 1 -- 172.21.15.52:0/2189855028 shutdown_connections 2024-04-25T13:16:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f460a0ae640 1 --2- 172.21.15.52:0/2189855028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46040cdfa0 0x7f4604072250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f460a0ae640 1 -- 172.21.15.52:0/2189855028 >> 172.21.15.52:0/2189855028 conn(0x7f460406b920 msgr2=0x7f460406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f4e37fff640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e38151e70 0x7f4e38156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f969f7fe640 1 -- 172.21.15.52:0/2863061093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a006f4a0 msgr2=0x7f96a006e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f969f7fe640 1 --2- 172.21.15.52:0/2863061093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a006f4a0 0x7f96a006e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f969f7fe640 1 -- 172.21.15.52:0/2863061093 >> v1:172.21.15.52:6789/0 conn(0x7f96a01510b0 legacy=0x7f96a00c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f969effd640 1 -- 172.21.15.52:0/2863061093 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545349556 0 0) 0x7f96a006f230 con 0x7f96a01510b0 2024-04-25T13:16:39.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f969f7fe640 1 -- 172.21.15.52:0/2863061093 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a00c7700 con 0x7f96a0151490 2024-04-25T13:16:39.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f96a4a2e640 1 --2- 172.21.15.52:0/2863061093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a006f4a0 0x7f96a006e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:39.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f49127fc640 1 --2- 172.21.15.52:0/4292783762 >> v2:172.21.15.52:3300/0 conn(0x7f49141554e0 0x7f491415f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.016+0000 7f49127fc640 1 -- 172.21.15.52:0/4292783762 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49140cb8c0 con 0x7f49140b3c00 2024-04-25T13:16:39.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f4912ffd640 1 --2- 172.21.15.52:0/4292783762 >> v2:172.21.15.52:3300/0 conn(0x7f49141554e0 0x7f491415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:39.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f4e36ffd640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e380ca610 0x7f4e381550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7ffb12ffd640 1 --2- 172.21.15.52:0/3924514810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1406e600 0x7ffb140c80c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009e50 tx=0x7ffb0c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8574c27b53477cfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f4e377fe640 1 -- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e380ca610 msgr2=0x7f4e381550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f4e377fe640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e380ca610 0x7f4e381550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f4e377fe640 1 -- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e38151e70 msgr2=0x7f4e38156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f4e377fe640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e38151e70 0x7f4e38156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f4e377fe640 1 -- 172.21.15.52:0/177442756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e381ecf70 con 0x7f4e380c88f0 2024-04-25T13:16:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7ffb11ffb640 1 -- 172.21.15.52:0/3924514810 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c036070 con 0x7ffb1406e600 2024-04-25T13:16:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7ffb11ffb640 1 -- 172.21.15.52:0/3924514810 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0c031600 con 0x7ffb1406e600 2024-04-25T13:16:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7ffb11ffb640 1 -- 172.21.15.52:0/3924514810 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0319d0 con 0x7ffb1406e600 2024-04-25T13:16:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f460a0ae640 1 -- 172.21.15.52:0/2189855028 shutdown_connections 2024-04-25T13:16:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f460a0ae640 1 -- 172.21.15.52:0/2189855028 wait complete. 2024-04-25T13:16:39.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f4e377fe640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e380c88f0 0x7f4e38154ba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800b3e0 tx=0x7f4e2800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f1b5e7fc640 1 -- 172.21.15.52:0/370060319 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c037070 con 0x7f1b58047450 2024-04-25T13:16:39.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.017+0000 7f403a363640 1 --2- 172.21.15.52:0/701681934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200051c0 0x7f40200079a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f403406f040 tx=0x7f4020005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e0bd2dddc54474c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.018+0000 7f969f7fe640 1 --2- 172.21.15.52:0/2863061093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96a0151490 0x7f96a0157a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f969400b160 tx=0x7f969402aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4225c7a2f41526eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.018+0000 7f1b5e7fc640 1 -- 172.21.15.52:0/370060319 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c032440 con 0x7f1b58047450 2024-04-25T13:16:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.018+0000 7f1b5e7fc640 1 -- 172.21.15.52:0/370060319 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c032810 con 0x7f1b58047450 2024-04-25T13:16:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.018+0000 7f4e1ffff640 1 -- 172.21.15.52:0/177442756 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28015020 con 0x7f4e380c88f0 2024-04-25T13:16:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.018+0000 7f4e3de13640 1 -- 172.21.15.52:0/177442756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e381ed250 con 0x7f4e380c88f0 2024-04-25T13:16:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.018+0000 7f969effd640 1 -- 172.21.15.52:0/2863061093 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969402e870 con 0x7f96a0151490 2024-04-25T13:16:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.018+0000 7f969effd640 1 -- 172.21.15.52:0/2863061093 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969402ea10 con 0x7f96a0151490 2024-04-25T13:16:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.018+0000 7f969effd640 1 -- 172.21.15.52:0/2863061093 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969402ede0 con 0x7f96a0151490 2024-04-25T13:16:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.018+0000 7f4e3de13640 1 -- 172.21.15.52:0/177442756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e381ed810 con 0x7f4e380c88f0 2024-04-25T13:16:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.018+0000 7f4e1ffff640 1 -- 172.21.15.52:0/177442756 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e28011850 con 0x7f4e380c88f0 2024-04-25T13:16:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.018+0000 7ffb13fff640 1 -- 172.21.15.52:0/3924514810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1406e600 msgr2=0x7ffb140c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.018+0000 7ffb13fff640 1 --2- 172.21.15.52:0/3924514810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1406e600 0x7ffb140c80c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009e50 tx=0x7ffb0c02a6d0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7fb6133ad640 1 Processor -- start 2024-04-25T13:16:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7fb6133ad640 1 -- start start 2024-04-25T13:16:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f1b65a7c640 1 -- 172.21.15.52:0/370060319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b58047450 msgr2=0x7f1b580e08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f4e1ffff640 1 -- 172.21.15.52:0/177442756 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28011c40 con 0x7f4e380c88f0 2024-04-25T13:16:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f460a0ae640 1 Processor -- start 2024-04-25T13:16:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f96a6491640 1 -- 172.21.15.52:0/2863061093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96a0151490 msgr2=0x7f96a0157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f96a6491640 1 --2- 172.21.15.52:0/2863061093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96a0151490 0x7f96a0157a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f969400b160 tx=0x7f969402aab0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f96a6491640 1 -- 172.21.15.52:0/2863061093 shutdown_connections 2024-04-25T13:16:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f49127fc640 1 --2- 172.21.15.52:0/4292783762 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 0x7f49140b4f10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f49140caf10 tx=0x7f490802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=577ad0ab22497468 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f96a6491640 1 --2- 172.21.15.52:0/2863061093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96a0151490 0x7f96a0157a00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f96a6491640 1 --2- 172.21.15.52:0/2863061093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a006f4a0 0x7f96a006e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f96a6491640 1 -- 172.21.15.52:0/2863061093 >> 172.21.15.52:0/2863061093 conn(0x7f96a00c8f00 msgr2=0x7f96a00c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c001bf0 con 0x7f40200051c0 2024-04-25T13:16:39.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402c003b70 con 0x7f40200051c0 2024-04-25T13:16:39.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f4038b60640 1 -- 172.21.15.52:0/701681934 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c0050d0 con 0x7f40200051c0 2024-04-25T13:16:39.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f4911ffb640 1 -- 172.21.15.52:0/4292783762 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4908037070 con 0x7f49140b3c00 2024-04-25T13:16:39.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f4911ffb640 1 -- 172.21.15.52:0/4292783762 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4908032440 con 0x7f49140b3c00 2024-04-25T13:16:39.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f460a0ae640 1 -- start start 2024-04-25T13:16:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f4911ffb640 1 -- 172.21.15.52:0/4292783762 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4908037070 con 0x7f49140b3c00 2024-04-25T13:16:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f96a6491640 1 -- 172.21.15.52:0/2863061093 shutdown_connections 2024-04-25T13:16:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f96a6491640 1 -- 172.21.15.52:0/2863061093 wait complete. 2024-04-25T13:16:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7ffb13fff640 1 -- 172.21.15.52:0/3924514810 shutdown_connections 2024-04-25T13:16:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7ffb13fff640 1 --2- 172.21.15.52:0/3924514810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb140c3870 0x7ffb14150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7fb6133ad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb60c0b3c00 0x7fb60c15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7ffb13fff640 1 --2- 172.21.15.52:0/3924514810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1406e600 0x7ffb140c80c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f1b65a7c640 1 --2- 172.21.15.52:0/370060319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b58047450 0x7f1b580e08b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b580352c0 tx=0x7f1b4c02a230 comp rx=0 tx=0).stop 2024-04-25T13:16:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7fb6133ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb60c0d08a0 0x7fb60c1f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f1b65a7c640 1 -- 172.21.15.52:0/370060319 shutdown_connections 2024-04-25T13:16:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f1b65a7c640 1 --2- 172.21.15.52:0/370060319 >> v2:172.21.15.52:3300/0 conn(0x7f1b580e0df0 0x7f1b5804d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f1b65a7c640 1 --2- 172.21.15.52:0/370060319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b58047450 0x7f1b580e08b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f1b65a7c640 1 -- 172.21.15.52:0/370060319 >> 172.21.15.52:0/370060319 conn(0x7f1b58009da0 msgr2=0x7f1b5800a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f1b65a7c640 1 -- 172.21.15.52:0/370060319 shutdown_connections 2024-04-25T13:16:39.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.019+0000 7f1b65a7c640 1 -- 172.21.15.52:0/370060319 wait complete. 2024-04-25T13:16:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f4e1ffff640 1 -- 172.21.15.52:0/177442756 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e28018020 con 0x7f4e380c88f0 2024-04-25T13:16:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f403bdc6640 1 -- 172.21.15.52:0/701681934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200051c0 msgr2=0x7f40200079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f403bdc6640 1 --2- 172.21.15.52:0/701681934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200051c0 0x7f40200079a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f403406f040 tx=0x7f4020005830 comp rx=0 tx=0).stop 2024-04-25T13:16:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f403bdc6640 1 -- 172.21.15.52:0/701681934 shutdown_connections 2024-04-25T13:16:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f403bdc6640 1 --2- 172.21.15.52:0/701681934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200051c0 0x7f40200079a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f403bdc6640 1 -- 172.21.15.52:0/701681934 >> 172.21.15.52:0/701681934 conn(0x7f40340c8f00 msgr2=0x7f40340c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f460a0ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46040c88f0 0x7f4604150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f460a0ae640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46040cdfa0 0x7f460414f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f460a0ae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4604151e70 0x7f460414f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f460a0ae640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4604158920 con 0x7f46040c88f0 2024-04-25T13:16:39.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f460a0ae640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4604072ea0 con 0x7f4604151e70 2024-04-25T13:16:39.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f460a0ae640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4604152250 con 0x7f46040cdfa0 2024-04-25T13:16:39.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7fb611149640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb60c0b3c00 0x7fb60c15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7fb611149640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb60c0b3c00 0x7fb60c15b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:41986/0 (socket says 172.21.15.52:41986) 2024-04-25T13:16:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7fb611149640 1 -- 172.21.15.52:0/1357864084 learned_addr learned my addr 172.21.15.52:0/1357864084 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f4919413640 1 -- 172.21.15.52:0/4292783762 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 msgr2=0x7f49140b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7f4919413640 1 --2- 172.21.15.52:0/4292783762 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 0x7f49140b4f10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f49140caf10 tx=0x7f490802a270 comp rx=0 tx=0).stop 2024-04-25T13:16:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7fb610948640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb60c0d08a0 0x7fb60c1f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.020+0000 7ffb13fff640 1 -- 172.21.15.52:0/3924514810 >> 172.21.15.52:0/3924514810 conn(0x7ffb140c8e00 msgr2=0x7ffb140c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7fb6133ad640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb60c1554e0 0x7fb60c1f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f46037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46040c88f0 0x7f4604150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f4602ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46040cdfa0 0x7f460414f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f4603fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4604151e70 0x7f460414f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f4602ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46040cdfa0 0x7f460414f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:41998/0 (socket says 172.21.15.52:41998) 2024-04-25T13:16:39.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f4602ffd640 1 -- 172.21.15.52:0/1558080015 learned_addr learned my addr 172.21.15.52:0/1558080015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7ffb13fff640 1 -- 172.21.15.52:0/3924514810 shutdown_connections 2024-04-25T13:16:39.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f4e1ffff640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4e2406c940 0x7f4e2406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c0b4430 con 0x7fb60c1554e0 2024-04-25T13:16:39.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7ffb13fff640 1 -- 172.21.15.52:0/3924514810 wait complete. 2024-04-25T13:16:39.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c0b4150 con 0x7fb60c0d08a0 2024-04-25T13:16:39.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb60c0b4710 con 0x7fb60c0b3c00 2024-04-25T13:16:39.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f4e1ffff640 1 -- 172.21.15.52:0/177442756 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4e2808aef0 con 0x7f4e380c88f0 2024-04-25T13:16:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f4e36ffd640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4e2406c940 0x7f4e2406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f4603fff640 1 -- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46040cdfa0 msgr2=0x7f460414f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f4603fff640 1 --2- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46040cdfa0 0x7f460414f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f4603fff640 1 -- 172.21.15.52:0/1558080015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46040c88f0 msgr2=0x7f4604150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f4603fff640 1 --2- 172.21.15.52:0/1558080015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46040c88f0 0x7f4604150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f4603fff640 1 -- 172.21.15.52:0/1558080015 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460415af80 con 0x7f4604151e70 2024-04-25T13:16:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7fb61194a640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb60c1554e0 0x7fb60c1f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.021+0000 7f403bdc6640 1 -- 172.21.15.52:0/701681934 shutdown_connections 2024-04-25T13:16:39.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f403bdc6640 1 -- 172.21.15.52:0/701681934 wait complete. 2024-04-25T13:16:39.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f4603fff640 1 --2- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4604151e70 0x7f460414f5d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f45f800c3f0 tx=0x7f45f800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f4e3de13640 1 -- 172.21.15.52:0/177442756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e18005290 con 0x7f4e380c88f0 2024-04-25T13:16:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7fb61194a640 1 -- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb60c0b3c00 msgr2=0x7fb60c15b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7fb61194a640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb60c0b3c00 0x7fb60c15b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f96a6491640 1 Processor -- start 2024-04-25T13:16:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f45ebfff640 1 -- 172.21.15.52:0/1558080015 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8017070 con 0x7f4604151e70 2024-04-25T13:16:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f1b65a7c640 1 Processor -- start 2024-04-25T13:16:39.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7fb61194a640 1 -- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb60c0d08a0 msgr2=0x7fb60c1f0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7fb61194a640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb60c0d08a0 0x7fb60c1f0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7fb61194a640 1 -- 172.21.15.52:0/1357864084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60c15f080 con 0x7fb60c1554e0 2024-04-25T13:16:39.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f460a0ae640 1 -- 172.21.15.52:0/1558080015 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460415b260 con 0x7f4604151e70 2024-04-25T13:16:39.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f460a0ae640 1 -- 172.21.15.52:0/1558080015 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f460415b820 con 0x7f4604151e70 2024-04-25T13:16:39.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7fb610948640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb60c0d08a0 0x7fb60c1f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:39.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7fb611149640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb60c0b3c00 0x7fb60c15b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:39.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f96a6491640 1 -- start start 2024-04-25T13:16:39.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7fb61194a640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb60c1554e0 0x7fb60c1f1300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb604007d90 tx=0x7fb60400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7ffb13fff640 1 Processor -- start 2024-04-25T13:16:39.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f4919413640 1 -- 172.21.15.52:0/4292783762 shutdown_connections 2024-04-25T13:16:39.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f4919413640 1 --2- 172.21.15.52:0/4292783762 >> v2:172.21.15.102:3300/0 conn(0x7f49140b5450 0x7f49140d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f4919413640 1 --2- 172.21.15.52:0/4292783762 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 0x7f49140b4f10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f4919413640 1 --2- 172.21.15.52:0/4292783762 >> v2:172.21.15.52:3300/0 conn(0x7f49141554e0 0x7f491415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f4919413640 1 -- 172.21.15.52:0/4292783762 >> 172.21.15.52:0/4292783762 conn(0x7f4914074d50 msgr2=0x7f4914075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f1b65a7c640 1 -- start start 2024-04-25T13:16:39.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.023+0000 7ffb13fff640 1 -- start start 2024-04-25T13:16:39.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.023+0000 7f4919413640 1 -- 172.21.15.52:0/4292783762 shutdown_connections 2024-04-25T13:16:39.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.022+0000 7f45ebfff640 1 -- 172.21.15.52:0/1558080015 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f8005ce0 con 0x7f4604151e70 2024-04-25T13:16:39.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.023+0000 7f45ebfff640 1 -- 172.21.15.52:0/1558080015 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f80072f0 con 0x7f4604151e70 2024-04-25T13:16:39.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.023+0000 7f96a6491640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96a006f4a0 0x7f96a00c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.023+0000 7f96a6491640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96a01510b0 0x7f96a00c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f96a6491640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a0151490 0x7f96a0161b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f403bdc6640 1 Processor -- start 2024-04-25T13:16:39.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f4e36ffd640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4e2406c940 0x7f4e2406ee00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c03d000 tx=0x7f4e2c037000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.023+0000 7f1b65a7c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b58047450 0x7f1b580499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.023+0000 7f1b65a7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b580d6ed0 0x7f1b580527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.023+0000 7f1b65a7c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b580e0df0 0x7f1b58052d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f969ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96a006f4a0 0x7f96a00c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f969ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96a006f4a0 0x7f96a00c4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55172/0 (socket says 172.21.15.52:55172) 2024-04-25T13:16:39.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f969ffff640 1 -- 172.21.15.52:0/705814422 learned_addr learned my addr 172.21.15.52:0/705814422 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f96a6491640 1 -- 172.21.15.52:0/705814422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f96a00c7fa0 con 0x7f96a006f4a0 2024-04-25T13:16:39.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f969f7fe640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96a01510b0 0x7f96a00c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f96a6491640 1 -- 172.21.15.52:0/705814422 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f96a00c7cc0 con 0x7f96a01510b0 2024-04-25T13:16:39.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f96a6491640 1 -- 172.21.15.52:0/705814422 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f96a00c6e00 con 0x7f96a0151490 2024-04-25T13:16:39.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f96a4a2e640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a0151490 0x7f96a0161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.023+0000 7f4919413640 1 -- 172.21.15.52:0/4292783762 wait complete. 2024-04-25T13:16:39.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f1b5effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b580d6ed0 0x7f1b580527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f1b5effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b580d6ed0 0x7f1b580527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55158/0 (socket says 172.21.15.52:55158) 2024-04-25T13:16:39.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f1b5f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b58047450 0x7f1b580499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f1b5f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b58047450 0x7f1b580499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:37296/0 (socket says 172.21.15.52:37296) 2024-04-25T13:16:39.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f45e9ffb640 1 -- 172.21.15.52:0/1558080015 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f460415be30 con 0x7f4604151e70 2024-04-25T13:16:39.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f403bdc6640 1 -- start start 2024-04-25T13:16:39.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1b580dd9c0 con 0x7f1b580d6ed0 2024-04-25T13:16:39.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1b580dd6e0 con 0x7f1b58047450 2024-04-25T13:16:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1b580dcbb0 con 0x7f1b580e0df0 2024-04-25T13:16:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f1b5effd640 1 -- 172.21.15.52:0/1603574561 learned_addr learned my addr 172.21.15.52:0/1603574561 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f1b5ffff640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b580e0df0 0x7f1b58052d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f96a4a2e640 1 -- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96a01510b0 msgr2=0x7f96a00c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f96a4a2e640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96a01510b0 0x7f96a00c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f96a4a2e640 1 -- 172.21.15.52:0/705814422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96a006f4a0 msgr2=0x7f96a00c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f96a4a2e640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96a006f4a0 0x7f96a00c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7ffb13fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb1406e600 0x7ffb141ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f96a4a2e640 1 -- 172.21.15.52:0/705814422 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a015a2d0 con 0x7f96a0151490 2024-04-25T13:16:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.024+0000 7f969f7fe640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96a01510b0 0x7f96a00c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb13fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1406e9e0 0x7ffb1415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb13fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb140c3870 0x7ffb14154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7f969ffff640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96a006f4a0 0x7f96a00c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb13fff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffb140c77f0 con 0x7ffb1406e9e0 2024-04-25T13:16:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb12ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb1406e600 0x7ffb141ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb13fff640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffb140c7510 con 0x7ffb140c3870 2024-04-25T13:16:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb13fff640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffb14157b90 con 0x7ffb1406e600 2024-04-25T13:16:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb12ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb1406e600 0x7ffb141ed1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:42024/0 (socket says 172.21.15.52:42024) 2024-04-25T13:16:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb12ffd640 1 -- 172.21.15.52:0/3106997214 learned_addr learned my addr 172.21.15.52:0/3106997214 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb127fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1406e9e0 0x7ffb1415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7f1b5f7fe640 1 -- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b580e0df0 msgr2=0x7f1b58052d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7f1b5f7fe640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b580e0df0 0x7f1b58052d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7f1b5f7fe640 1 -- 172.21.15.52:0/1603574561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b580d6ed0 msgr2=0x7f1b580527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7f1b5f7fe640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b580d6ed0 0x7f1b580527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7f1b5f7fe640 1 -- 172.21.15.52:0/1603574561 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b58051d40 con 0x7f1b58047450 2024-04-25T13:16:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb137fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb140c3870 0x7ffb14154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7f1b5effd640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b580d6ed0 0x7f1b580527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7f96a4a2e640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a0151490 0x7f96a0161b70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9698007f20 tx=0x7f969800d560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7f1b5f7fe640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b58047450 0x7f1b580499c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400c410 tx=0x7f1b5400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7f969cff9640 1 -- 172.21.15.52:0/705814422 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969801a070 con 0x7f96a0151490 2024-04-25T13:16:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f969cff9640 1 -- 172.21.15.52:0/705814422 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9698003b90 con 0x7f96a0151490 2024-04-25T13:16:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f4919413640 1 Processor -- start 2024-04-25T13:16:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f403bdc6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200051c0 0x7f4034151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f969cff9640 1 -- 172.21.15.52:0/705814422 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698004030 con 0x7f96a0151490 2024-04-25T13:16:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb137fe640 1 -- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb1406e600 msgr2=0x7ffb141ed1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb137fe640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb1406e600 0x7ffb141ed1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb137fe640 1 -- 172.21.15.52:0/3106997214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1406e9e0 msgr2=0x7ffb1415ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb137fe640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1406e9e0 0x7ffb1415ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb137fe640 1 -- 172.21.15.52:0/3106997214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1414fa00 con 0x7ffb140c3870 2024-04-25T13:16:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.025+0000 7ffb127fc640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1406e9e0 0x7ffb1415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f96a6491640 1 -- 172.21.15.52:0/705814422 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a015a570 con 0x7f96a0151490 2024-04-25T13:16:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f403bdc6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40341582b0 0x7f4034159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f4919413640 1 -- start start 2024-04-25T13:16:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f403bdc6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40341598c0 0x7f403414ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f4039b62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200051c0 0x7f4034151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f96a6491640 1 -- 172.21.15.52:0/705814422 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a015ab30 con 0x7f96a0151490 2024-04-25T13:16:39.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7ffb137fe640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb140c3870 0x7ffb14154400 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400afd0 tx=0x7ffb0400c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f4039b62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200051c0 0x7f4034151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:37300/0 (socket says 172.21.15.52:37300) 2024-04-25T13:16:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f403a363640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40341598c0 0x7f403414ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f403a363640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40341598c0 0x7f403414ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55188/0 (socket says 172.21.15.52:55188) 2024-04-25T13:16:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f4039361640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40341582b0 0x7f4034159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f4039361640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40341582b0 0x7f4034159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:42026/0 (socket says 172.21.15.52:42026) 2024-04-25T13:16:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f4039b62640 1 -- 172.21.15.52:0/4125114967 learned_addr learned my addr 172.21.15.52:0/4125114967 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40340c99f0 con 0x7f40341598c0 2024-04-25T13:16:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f40340c5510 con 0x7f40200051c0 2024-04-25T13:16:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f40340c9b70 con 0x7f40341582b0 2024-04-25T13:16:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.026+0000 7f45ebfff640 1 -- 172.21.15.52:0/1558080015 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45f801a070 con 0x7f4604151e70 2024-04-25T13:16:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f45ebfff640 1 --2- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f45f006c940 0x7f45f006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f4919413640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 0x7f4914150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f4919413640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49140b5450 0x7f491415e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f4919413640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49141554e0 0x7f491415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f45ebfff640 1 -- 172.21.15.52:0/1558080015 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f45f808b540 con 0x7f4604151e70 2024-04-25T13:16:39.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f46037fe640 1 --2- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f45f006c940 0x7f45f006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f4919413640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f49140b4430 con 0x7f49141554e0 2024-04-25T13:16:39.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f4919413640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f49140b4150 con 0x7f49140b5450 2024-04-25T13:16:39.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f4919413640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f49140b4710 con 0x7f49140b3c00 2024-04-25T13:16:39.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f4912ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 0x7f4914150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f49127fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49140b5450 0x7f491415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f49137fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49141554e0 0x7f491415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f4912ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 0x7f4914150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:42030/0 (socket says 172.21.15.52:42030) 2024-04-25T13:16:39.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f4912ffd640 1 -- 172.21.15.52:0/527756221 learned_addr learned my addr 172.21.15.52:0/527756221 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:39.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f403a363640 1 -- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40341582b0 msgr2=0x7f4034159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f403a363640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40341582b0 0x7f4034159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f403a363640 1 -- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200051c0 msgr2=0x7f4034151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f403a363640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200051c0 0x7f4034151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f403a363640 1 -- 172.21.15.52:0/4125114967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403415a4b0 con 0x7f40341598c0 2024-04-25T13:16:39.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.027+0000 7f4039361640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40341582b0 0x7f4034159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:39.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f49137fe640 1 -- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 msgr2=0x7f4914150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f49137fe640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 0x7f4914150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f49137fe640 1 -- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49140b5450 msgr2=0x7f491415e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f49137fe640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49140b5450 0x7f491415e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f46037fe640 1 --2- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f45f006c940 0x7f45f006ee00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45f4006fd0 tx=0x7f45f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f49137fe640 1 -- 172.21.15.52:0/527756221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49140c9d10 con 0x7f49141554e0 2024-04-25T13:16:39.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f49127fc640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49140b5450 0x7f491415e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:39.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f969cff9640 1 -- 172.21.15.52:0/705814422 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f969801d070 con 0x7f96a0151490 2024-04-25T13:16:39.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f403a363640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40341598c0 0x7f403414ba40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f403406f4f0 tx=0x7f402c001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f49137fe640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49141554e0 0x7f491415ebd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f490400e7f0 tx=0x7f490400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f96a6491640 1 -- 172.21.15.52:0/705814422 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a0068e40 con 0x7f96a0151490 2024-04-25T13:16:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f969cff9640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f968c06c940 0x7f968c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f969cff9640 1 -- 172.21.15.52:0/705814422 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f969808c130 con 0x7f96a0151490 2024-04-25T13:16:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.028+0000 7f969ffff640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f968c06c940 0x7f968c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.029+0000 7f969ffff640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f968c06c940 0x7f968c06ee00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9690000f60 tx=0x7f9690009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7fb601ffb640 1 -- 172.21.15.52:0/1357864084 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60400edd0 con 0x7fb60c1554e0 2024-04-25T13:16:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7fb601ffb640 1 -- 172.21.15.52:0/1357864084 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb604003990 con 0x7fb60c1554e0 2024-04-25T13:16:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60c15c770 con 0x7fb60c1554e0 2024-04-25T13:16:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7fb601ffb640 1 -- 172.21.15.52:0/1357864084 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb604003d80 con 0x7fb60c1554e0 2024-04-25T13:16:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7f402a7fc640 1 -- 172.21.15.52:0/4125114967 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c041070 con 0x7f40341598c0 2024-04-25T13:16:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7f4e1ffff640 1 -- 172.21.15.52:0/177442756 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e28058a10 con 0x7f4e380c88f0 2024-04-25T13:16:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7ffafbfff640 1 -- 172.21.15.52:0/3106997214 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb04015070 con 0x7ffb140c3870 2024-04-25T13:16:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7ffafbfff640 1 -- 172.21.15.52:0/3106997214 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb04004240 con 0x7ffb140c3870 2024-04-25T13:16:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7ffafbfff640 1 -- 172.21.15.52:0/3106997214 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb04003610 con 0x7ffb140c3870 2024-04-25T13:16:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7ffb13fff640 1 -- 172.21.15.52:0/3106997214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb14151a00 con 0x7ffb140c3870 2024-04-25T13:16:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.031+0000 7ffb13fff640 1 -- 172.21.15.52:0/3106997214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb1414ff60 con 0x7ffb140c3870 2024-04-25T13:16:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7f48fb7fe640 1 -- 172.21.15.52:0/527756221 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904017070 con 0x7f49141554e0 2024-04-25T13:16:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7f4919413640 1 -- 172.21.15.52:0/527756221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49141efbd0 con 0x7f49141554e0 2024-04-25T13:16:39.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7f48fb7fe640 1 -- 172.21.15.52:0/527756221 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490400ee40 con 0x7f49141554e0 2024-04-25T13:16:39.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7f402a7fc640 1 -- 172.21.15.52:0/4125114967 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402c003970 con 0x7f40341598c0 2024-04-25T13:16:39.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7f402a7fc640 1 -- 172.21.15.52:0/4125114967 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c001bf0 con 0x7f40341598c0 2024-04-25T13:16:39.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40341ecf80 con 0x7f40341598c0 2024-04-25T13:16:39.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40341ed540 con 0x7f40341598c0 2024-04-25T13:16:39.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.031+0000 7f45ebfff640 1 -- 172.21.15.52:0/1558080015 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45f8021020 con 0x7f4604151e70 2024-04-25T13:16:39.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60c15eaa0 con 0x7fb60c1554e0 2024-04-25T13:16:39.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7f1b4bfff640 1 -- 172.21.15.52:0/1603574561 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54017070 con 0x7f1b58047450 2024-04-25T13:16:39.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7f1b4bfff640 1 -- 172.21.15.52:0/1603574561 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b54005230 con 0x7f1b58047450 2024-04-25T13:16:39.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.030+0000 7f1b4bfff640 1 -- 172.21.15.52:0/1603574561 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b540045e0 con 0x7f1b58047450 2024-04-25T13:16:39.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.031+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b580dc430 con 0x7f1b58047450 2024-04-25T13:16:39.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.032+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b58051fe0 con 0x7f1b58047450 2024-04-25T13:16:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.031+0000 7f4919413640 1 -- 172.21.15.52:0/527756221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49141f0190 con 0x7f49141554e0 2024-04-25T13:16:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.031+0000 7f48fb7fe640 1 -- 172.21.15.52:0/527756221 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490400cb00 con 0x7f49141554e0 2024-04-25T13:16:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.033+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60c068e40 con 0x7fb60c1554e0 2024-04-25T13:16:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.033+0000 7ffafbfff640 1 -- 172.21.15.52:0/3106997214 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb040037b0 con 0x7ffb140c3870 2024-04-25T13:16:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.033+0000 7ffb13fff640 1 -- 172.21.15.52:0/3106997214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf4005290 con 0x7ffb140c3870 2024-04-25T13:16:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.033+0000 7fb601ffb640 1 -- 172.21.15.52:0/1357864084 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb60401b020 con 0x7fb60c1554e0 2024-04-25T13:16:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.033+0000 7ffafbfff640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ffb0006c9c0 0x7ffb0006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.033+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b580053c0 con 0x7f1b58047450 2024-04-25T13:16:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.034+0000 7ffb12ffd640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ffb0006c9c0 0x7ffb0006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.034+0000 7fb601ffb640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb5f006c8f0 0x7fb5f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.034+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4034068e40 con 0x7f40341598c0 2024-04-25T13:16:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.034+0000 7f969cff9640 1 -- 172.21.15.52:0/705814422 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9698010070 con 0x7f96a0151490 2024-04-25T13:16:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.034+0000 7f1b4bfff640 1 -- 172.21.15.52:0/1603574561 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b5401a070 con 0x7f1b58047450 2024-04-25T13:16:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.034+0000 7ffafbfff640 1 -- 172.21.15.52:0/3106997214 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffb0408bb30 con 0x7ffb140c3870 2024-04-25T13:16:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.034+0000 7fb611149640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb5f006c8f0 0x7fb5f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.034+0000 7ffb12ffd640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ffb0006c9c0 0x7ffb0006ee80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c02a710 tx=0x7ffb0c009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.035+0000 7fb601ffb640 1 -- 172.21.15.52:0/1357864084 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb60408c170 con 0x7fb60c1554e0 2024-04-25T13:16:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.035+0000 7fb611149640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb5f006c8f0 0x7fb5f006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb608009280 tx=0x7fb60802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.035+0000 7f1b4bfff640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f1b4406c9f0 0x7f1b4406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.035+0000 7f1b4bfff640 1 -- 172.21.15.52:0/1603574561 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1b5408af90 con 0x7f1b58047450 2024-04-25T13:16:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.035+0000 7f1b5effd640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f1b4406c9f0 0x7f1b4406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.035+0000 7f48fb7fe640 1 -- 172.21.15.52:0/527756221 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f490401a070 con 0x7f49141554e0 2024-04-25T13:16:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.035+0000 7f48fb7fe640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f490006c8f0 0x7f490006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.035+0000 7f48fb7fe640 1 -- 172.21.15.52:0/527756221 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f490408bdf0 con 0x7f49141554e0 2024-04-25T13:16:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.036+0000 7f4919413640 1 -- 172.21.15.52:0/527756221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4914068e40 con 0x7f49141554e0 2024-04-25T13:16:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.036+0000 7f4912ffd640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f490006c8f0 0x7f490006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.036+0000 7f1b5effd640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f1b4406c9f0 0x7f1b4406eeb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c02a270 tx=0x7f1b4c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.036+0000 7f402a7fc640 1 -- 172.21.15.52:0/4125114967 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f402c039070 con 0x7f40341598c0 2024-04-25T13:16:39.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.036+0000 7f4912ffd640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f490006c8f0 0x7f490006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f490c007fd0 tx=0x7f490c0078d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.036+0000 7f402a7fc640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f401806c8f0 0x7f401806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.036+0000 7f402a7fc640 1 -- 172.21.15.52:0/4125114967 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f402c0ab030 con 0x7f40341598c0 2024-04-25T13:16:39.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.037+0000 7f4039b62640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f401806c8f0 0x7f401806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.037+0000 7f4039b62640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f401806c8f0 0x7f401806edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4030004a80 tx=0x7f40340c66f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.039+0000 7ffafbfff640 1 -- 172.21.15.52:0/3106997214 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffb04059520 con 0x7ffb140c3870 2024-04-25T13:16:39.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.040+0000 7fb601ffb640 1 -- 172.21.15.52:0/1357864084 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb60405a140 con 0x7fb60c1554e0 2024-04-25T13:16:39.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.043+0000 7f1b4bfff640 1 -- 172.21.15.52:0/1603574561 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b54058aa0 con 0x7f1b58047450 2024-04-25T13:16:39.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.045+0000 7f48fb7fe640 1 -- 172.21.15.52:0/527756221 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4904059760 con 0x7f49141554e0 2024-04-25T13:16:39.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.054+0000 7f402a7fc640 1 -- 172.21.15.52:0/4125114967 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f402c078ad0 con 0x7f40341598c0 2024-04-25T13:16:39.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.471+0000 7f96a6491640 1 -- 172.21.15.52:0/705814422 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f96a01616e0 con 0x7f96a0151490 2024-04-25T13:16:39.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.472+0000 7f969cff9640 1 -- 172.21.15.52:0/705814422 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f969805a300 con 0x7f96a0151490 2024-04-25T13:16:39.472 INFO:teuthology.orchestra.run.smithi052.stdout:55834574858 2024-04-25T13:16:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.475+0000 7f96867fc640 1 -- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f968c06c940 msgr2=0x7f968c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.475+0000 7f96867fc640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f968c06c940 0x7f968c06ee00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9690000f60 tx=0x7f9690009040 comp rx=0 tx=0).stop 2024-04-25T13:16:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.475+0000 7f96867fc640 1 -- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a0151490 msgr2=0x7f96a0161b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.475+0000 7f96867fc640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a0151490 0x7f96a0161b70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9698007f20 tx=0x7f969800d560 comp rx=0 tx=0).stop 2024-04-25T13:16:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.475+0000 7f96867fc640 1 -- 172.21.15.52:0/705814422 shutdown_connections 2024-04-25T13:16:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.475+0000 7f96867fc640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f968c06c940 0x7f968c06ee00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.475+0000 7f96867fc640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a0151490 0x7f96a0161b70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.475+0000 7f96867fc640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96a01510b0 0x7f96a00c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.476+0000 7f96867fc640 1 --2- 172.21.15.52:0/705814422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96a006f4a0 0x7f96a00c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.476+0000 7f96867fc640 1 -- 172.21.15.52:0/705814422 >> 172.21.15.52:0/705814422 conn(0x7f96a00c8f00 msgr2=0x7f96a0155730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.476+0000 7f96867fc640 1 -- 172.21.15.52:0/705814422 shutdown_connections 2024-04-25T13:16:39.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.476+0000 7f96867fc640 1 -- 172.21.15.52:0/705814422 wait complete. 2024-04-25T13:16:39.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.480+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb60c0cc260 con 0x7fb60c1554e0 2024-04-25T13:16:39.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.480+0000 7f4e3de13640 1 -- 172.21.15.52:0/177442756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4e18005850 con 0x7f4e380c88f0 2024-04-25T13:16:39.483 INFO:teuthology.orchestra.run.smithi052.stdout:55834574857 2024-04-25T13:16:39.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.481+0000 7f4e1ffff640 1 -- 172.21.15.52:0/177442756 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e2805cd10 con 0x7f4e380c88f0 2024-04-25T13:16:39.484 INFO:teuthology.orchestra.run.smithi052.stdout:55834574858 2024-04-25T13:16:39.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.481+0000 7fb601ffb640 1 -- 172.21.15.52:0/1357864084 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb6040790e0 con 0x7fb60c1554e0 2024-04-25T13:16:39.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.483+0000 7ffb13fff640 1 -- 172.21.15.52:0/3106997214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ffaf4005580 con 0x7ffb140c3870 2024-04-25T13:16:39.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.484+0000 7ffafbfff640 1 -- 172.21.15.52:0/3106997214 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffb0405d820 con 0x7ffb140c3870 2024-04-25T13:16:39.485 INFO:teuthology.orchestra.run.smithi052.stdout:55834574858 2024-04-25T13:16:39.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.484+0000 7f4e3de13640 1 -- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4e2406c940 msgr2=0x7f4e2406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.484+0000 7f4e3de13640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4e2406c940 0x7f4e2406ee00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c03d000 tx=0x7f4e2c037000 comp rx=0 tx=0).stop 2024-04-25T13:16:39.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.484+0000 7f4e3de13640 1 -- 172.21.15.52:0/177442756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e380c88f0 msgr2=0x7f4e38154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb5f006c8f0 msgr2=0x7fb5f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7fb6133ad640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb5f006c8f0 0x7fb5f006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb608009280 tx=0x7fb60802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:39.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb60c1554e0 msgr2=0x7fb60c1f1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7fb6133ad640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb60c1554e0 0x7fb60c1f1300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb604007d90 tx=0x7fb60400e4b0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.484+0000 7f4e3de13640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e380c88f0 0x7f4e38154ba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800b3e0 tx=0x7f4e2800b8a0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7f4e3de13640 1 -- 172.21.15.52:0/177442756 shutdown_connections 2024-04-25T13:16:39.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7f4e3de13640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4e2406c940 0x7f4e2406ee00 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c03d000 tx=0x7f4e2c037000 comp rx=0 tx=0).stop 2024-04-25T13:16:39.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7f4e3de13640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e380ca610 0x7f4e381550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 shutdown_connections 2024-04-25T13:16:39.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7fb6133ad640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb5f006c8f0 0x7fb5f006edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7fb6133ad640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb60c1554e0 0x7fb60c1f1300 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7fb6133ad640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb60c0d08a0 0x7fb60c1f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7fb6133ad640 1 --2- 172.21.15.52:0/1357864084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb60c0b3c00 0x7fb60c15b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 >> 172.21.15.52:0/1357864084 conn(0x7fb60c074d50 msgr2=0x7fb60c0cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 shutdown_connections 2024-04-25T13:16:39.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7fb6133ad640 1 -- 172.21.15.52:0/1357864084 wait complete. 2024-04-25T13:16:39.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7f4e3de13640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e38151e70 0x7f4e38156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7f4e3de13640 1 --2- 172.21.15.52:0/177442756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e380c88f0 0x7f4e38154ba0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7f4e3de13640 1 -- 172.21.15.52:0/177442756 >> 172.21.15.52:0/177442756 conn(0x7f4e3806b920 msgr2=0x7f4e38147fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.485+0000 7f4e3de13640 1 -- 172.21.15.52:0/177442756 shutdown_connections 2024-04-25T13:16:39.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.486+0000 7f4e3de13640 1 -- 172.21.15.52:0/177442756 wait complete. 2024-04-25T13:16:39.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.487+0000 7ffb13fff640 1 -- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ffb0006c9c0 msgr2=0x7ffb0006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.487+0000 7ffb13fff640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ffb0006c9c0 0x7ffb0006ee80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c02a710 tx=0x7ffb0c009000 comp rx=0 tx=0).stop 2024-04-25T13:16:39.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.487+0000 7ffb13fff640 1 -- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb140c3870 msgr2=0x7ffb14154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.487+0000 7ffb13fff640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb140c3870 0x7ffb14154400 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400afd0 tx=0x7ffb0400c950 comp rx=0 tx=0).stop 2024-04-25T13:16:39.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.487+0000 7ffb13fff640 1 -- 172.21.15.52:0/3106997214 shutdown_connections 2024-04-25T13:16:39.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.487+0000 7ffb13fff640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ffb0006c9c0 0x7ffb0006ee80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.487+0000 7ffb13fff640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb140c3870 0x7ffb14154400 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.487+0000 7ffb13fff640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1406e9e0 0x7ffb1415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.488+0000 7ffb13fff640 1 --2- 172.21.15.52:0/3106997214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb1406e600 0x7ffb141ed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.488+0000 7ffb13fff640 1 -- 172.21.15.52:0/3106997214 >> 172.21.15.52:0/3106997214 conn(0x7ffb140c8e00 msgr2=0x7ffb14155d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.488+0000 7ffb13fff640 1 -- 172.21.15.52:0/3106997214 shutdown_connections 2024-04-25T13:16:39.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.488+0000 7ffb13fff640 1 -- 172.21.15.52:0/3106997214 wait complete. 2024-04-25T13:16:39.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.488+0000 7f4919413640 1 -- 172.21.15.52:0/527756221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f49140cc260 con 0x7f49141554e0 2024-04-25T13:16:39.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.489+0000 7f48fb7fe640 1 -- 172.21.15.52:0/527756221 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f490405da60 con 0x7f49141554e0 2024-04-25T13:16:39.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.489+0000 7f45e9ffb640 1 -- 172.21.15.52:0/1558080015 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f460406c8b0 con 0x7f4604151e70 2024-04-25T13:16:39.494 INFO:teuthology.orchestra.run.smithi052.stdout:55834574859 2024-04-25T13:16:39.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.490+0000 7f45ebfff640 1 -- 172.21.15.52:0/1558080015 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f45f8059080 con 0x7f4604151e70 2024-04-25T13:16:39.494 INFO:teuthology.orchestra.run.smithi052.stdout:55834574858 2024-04-25T13:16:39.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.492+0000 7f4919413640 1 -- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f490006c8f0 msgr2=0x7f490006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f4919413640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f490006c8f0 0x7f490006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f490c007fd0 tx=0x7f490c0078d0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f4919413640 1 -- 172.21.15.52:0/527756221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49141554e0 msgr2=0x7f491415ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f4919413640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49141554e0 0x7f491415ebd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f490400e7f0 tx=0x7f490400ebf0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f45e9ffb640 1 -- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f45f006c940 msgr2=0x7f45f006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f45e9ffb640 1 --2- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f45f006c940 0x7f45f006ee00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45f4006fd0 tx=0x7f45f4008040 comp rx=0 tx=0).stop 2024-04-25T13:16:39.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f4919413640 1 -- 172.21.15.52:0/527756221 shutdown_connections 2024-04-25T13:16:39.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f4919413640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f490006c8f0 0x7f490006edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f4919413640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49141554e0 0x7f491415ebd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f4919413640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49140b5450 0x7f491415e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f4919413640 1 --2- 172.21.15.52:0/527756221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49140b3c00 0x7f4914150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f4919413640 1 -- 172.21.15.52:0/527756221 >> 172.21.15.52:0/527756221 conn(0x7f4914074d50 msgr2=0x7f49141546e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f45e9ffb640 1 -- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4604151e70 msgr2=0x7f460414f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f45e9ffb640 1 --2- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4604151e70 0x7f460414f5d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f45f800c3f0 tx=0x7f45f800c7f0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.493+0000 7f4919413640 1 -- 172.21.15.52:0/527756221 shutdown_connections 2024-04-25T13:16:39.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.494+0000 7f4919413640 1 -- 172.21.15.52:0/527756221 wait complete. 2024-04-25T13:16:39.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.495+0000 7f45e9ffb640 1 -- 172.21.15.52:0/1558080015 shutdown_connections 2024-04-25T13:16:39.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.495+0000 7f45e9ffb640 1 --2- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f45f006c940 0x7f45f006ee00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.495+0000 7f45e9ffb640 1 --2- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46040cdfa0 0x7f460414f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.495+0000 7f45e9ffb640 1 --2- 172.21.15.52:0/1558080015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4604151e70 0x7f460414f5d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.495+0000 7f45e9ffb640 1 --2- 172.21.15.52:0/1558080015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46040c88f0 0x7f4604150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2024-04-25T13:16:39.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.495+0000 7f45e9ffb640 1 -- 172.21.15.52:0/1558080015 >> 172.21.15.52:0/1558080015 conn(0x7f460406b920 msgr2=0x7f460414e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.495+0000 7f45e9ffb640 1 -- 172.21.15.52:0/1558080015 shutdown_connections 2024-04-25T13:16:39.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.495+0000 7f45e9ffb640 1 -- 172.21.15.52:0/1558080015 wait complete. 2024-04-25T13:16:39.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.497+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1b58005c80 con 0x7f1b58047450 2024-04-25T13:16:39.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.497+0000 7f1b4bfff640 1 -- 172.21.15.52:0/1603574561 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b5405cda0 con 0x7f1b58047450 2024-04-25T13:16:39.500 INFO:teuthology.orchestra.run.smithi052.stdout:55834574860 2024-04-25T13:16:39.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.500+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f40340ca6c0 con 0x7f40341598c0 2024-04-25T13:16:39.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.501+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f1b4406c9f0 msgr2=0x7f1b4406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.501+0000 7f1b65a7c640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f1b4406c9f0 0x7f1b4406eeb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c02a270 tx=0x7f1b4c02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:39.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.501+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b58047450 msgr2=0x7f1b580499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.501+0000 7f1b65a7c640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b58047450 0x7f1b580499c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400c410 tx=0x7f1b5400c8d0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.501+0000 7f402a7fc640 1 -- 172.21.15.52:0/4125114967 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f402c07cdd0 con 0x7f40341598c0 2024-04-25T13:16:39.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.501+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 shutdown_connections 2024-04-25T13:16:39.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.501+0000 7f1b65a7c640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f1b4406c9f0 0x7f1b4406eeb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.501+0000 7f1b65a7c640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b580e0df0 0x7f1b58052d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.501+0000 7f1b65a7c640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b580d6ed0 0x7f1b580527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.502+0000 7f1b65a7c640 1 --2- 172.21.15.52:0/1603574561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b58047450 0x7f1b580499c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.503 INFO:teuthology.orchestra.run.smithi052.stdout:55834574859 2024-04-25T13:16:39.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.502+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 >> 172.21.15.52:0/1603574561 conn(0x7f1b58009da0 msgr2=0x7f1b58048ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.502+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 shutdown_connections 2024-04-25T13:16:39.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.502+0000 7f1b65a7c640 1 -- 172.21.15.52:0/1603574561 wait complete. 2024-04-25T13:16:39.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.506+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f401806c8f0 msgr2=0x7f401806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.506+0000 7f403bdc6640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f401806c8f0 0x7f401806edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4030004a80 tx=0x7f40340c66f0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.506+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40341598c0 msgr2=0x7f403414ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.506+0000 7f403bdc6640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40341598c0 0x7f403414ba40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f403406f4f0 tx=0x7f402c001650 comp rx=0 tx=0).stop 2024-04-25T13:16:39.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-04-25T13:16:39.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.506+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 shutdown_connections 2024-04-25T13:16:39.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.506+0000 7f403bdc6640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f401806c8f0 0x7f401806edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.506+0000 7f403bdc6640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40341582b0 0x7f4034159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.506+0000 7f403bdc6640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40341598c0 0x7f403414ba40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.506+0000 7f403bdc6640 1 --2- 172.21.15.52:0/4125114967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40200051c0 0x7f4034151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.506+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 >> 172.21.15.52:0/4125114967 conn(0x7f40340c8f00 msgr2=0x7f40340cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.506+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 shutdown_connections 2024-04-25T13:16:39.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:39.506+0000 7f403bdc6640 1 -- 172.21.15.52:0/4125114967 wait complete. 2024-04-25T13:16:39.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-04-25T13:16:39.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2024-04-25T13:16:39.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2024-04-25T13:16:39.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.6 2024-04-25T13:16:39.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574860 for osd.5 2024-04-25T13:16:39.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.7 2024-04-25T13:16:39.698 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:16:39.701 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:16:40.499 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T13:16:40.508 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T13:16:40.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T13:16:40.511 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T13:16:40.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T13:16:40.516 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T13:16:40.520 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T13:16:40.521 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T13:16:40.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.648+0000 7f26f0c60640 1 Processor -- start 2024-04-25T13:16:40.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.648+0000 7f26f0c60640 1 -- start start 2024-04-25T13:16:40.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.650+0000 7f26f0c60640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f26e40db200 0x7f26e40d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.650+0000 7f26f0c60640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26e40dce00 0x7f26e404be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.650+0000 7f26f0c60640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26e40d56a0 con 0x7f26e404b9a0 2024-04-25T13:16:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.650+0000 7f26f0c60640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f26e40080d0 con 0x7f26e40db200 2024-04-25T13:16:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.650+0000 7f26f0c60640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f26e40071e0 con 0x7f26e40dce00 2024-04-25T13:16:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.650+0000 7f26e9d9b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f26e404b9a0 0x7f26e40dc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:52976/0 (socket says 172.21.15.52:52976) 2024-04-25T13:16:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.650+0000 7f26e9d9b640 1 -- 172.21.15.52:0/3222325182 learned_addr learned my addr 172.21.15.52:0/3222325182 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.651+0000 7f26ead9d640 1 --2- 172.21.15.52:0/3222325182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26e40dce00 0x7f26e404be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.651+0000 7f26e959a640 1 -- 172.21.15.52:0/3222325182 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498161364 0 0) 0x7f26e40d56a0 con 0x7f26e404b9a0 2024-04-25T13:16:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.651+0000 7f26e959a640 1 -- 172.21.15.52:0/3222325182 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26d4003520 con 0x7f26e404b9a0 2024-04-25T13:16:40.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.651+0000 7f26ea59c640 1 --2- 172.21.15.52:0/3222325182 >> v2:172.21.15.52:3300/0 conn(0x7f26e40db200 0x7f26e40d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.652+0000 7f26ead9d640 1 -- 172.21.15.52:0/3222325182 >> v2:172.21.15.52:3300/0 conn(0x7f26e40db200 msgr2=0x7f26e40d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.652+0000 7f26ead9d640 1 --2- 172.21.15.52:0/3222325182 >> v2:172.21.15.52:3300/0 conn(0x7f26e40db200 0x7f26e40d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.652+0000 7f26ead9d640 1 -- 172.21.15.52:0/3222325182 >> v1:172.21.15.102:6789/0 conn(0x7f26e404b9a0 legacy=0x7f26e40dc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.652+0000 7f26ead9d640 1 -- 172.21.15.52:0/3222325182 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e40074c0 con 0x7f26e40dce00 2024-04-25T13:16:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.653+0000 7f26ea59c640 1 --2- 172.21.15.52:0/3222325182 >> v2:172.21.15.52:3300/0 conn(0x7f26e40db200 0x7f26e40d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.653+0000 7f26ead9d640 1 --2- 172.21.15.52:0/3222325182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26e40dce00 0x7f26e404be10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0097a0 tx=0x7f26dc02a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aca1f68ec7feeef5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.662+0000 7f26e959a640 1 -- 172.21.15.52:0/3222325182 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc037070 con 0x7f26e40dce00 2024-04-25T13:16:40.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.662+0000 7f26e959a640 1 -- 172.21.15.52:0/3222325182 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26dc02aaf0 con 0x7f26e40dce00 2024-04-25T13:16:40.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.663+0000 7f26f0c60640 1 -- 172.21.15.52:0/3222325182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26e40dce00 msgr2=0x7f26e404be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.663+0000 7f26f0c60640 1 --2- 172.21.15.52:0/3222325182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26e40dce00 0x7f26e404be10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0097a0 tx=0x7f26dc02a060 comp rx=0 tx=0).stop 2024-04-25T13:16:40.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.672+0000 7f26f0c60640 1 -- 172.21.15.52:0/3222325182 shutdown_connections 2024-04-25T13:16:40.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.672+0000 7f26f0c60640 1 --2- 172.21.15.52:0/3222325182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26e40dce00 0x7f26e404be10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.672+0000 7f26f0c60640 1 --2- 172.21.15.52:0/3222325182 >> v2:172.21.15.52:3300/0 conn(0x7f26e40db200 0x7f26e40d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.672+0000 7f26f0c60640 1 -- 172.21.15.52:0/3222325182 >> 172.21.15.52:0/3222325182 conn(0x7f26e404d4a0 msgr2=0x7f26e404d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:40.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.681+0000 7f26f0c60640 1 -- 172.21.15.52:0/3222325182 shutdown_connections 2024-04-25T13:16:40.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.691+0000 7f26f0c60640 1 -- 172.21.15.52:0/3222325182 wait complete. 2024-04-25T13:16:40.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.693+0000 7f26f0c60640 1 Processor -- start 2024-04-25T13:16:40.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.704+0000 7f26f0c60640 1 -- start start 2024-04-25T13:16:40.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.705+0000 7f26f0c60640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26e404b9a0 0x7f26e40d5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.705+0000 7f26f0c60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40db200 0x7f26e40d6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.706+0000 7f26e9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40db200 0x7f26e40d6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.706+0000 7f26e9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40db200 0x7f26e40d6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55212/0 (socket says 172.21.15.52:55212) 2024-04-25T13:16:40.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.714+0000 7f26ea59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26e404b9a0 0x7f26e40d5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.714+0000 7f26e9d9b640 1 -- 172.21.15.52:0/156856145 learned_addr learned my addr 172.21.15.52:0/156856145 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:40.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.714+0000 7f26f0c60640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26e40dce00 0x7f26e404f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.714+0000 7f26f0c60640 1 -- 172.21.15.52:0/156856145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26e4007d60 con 0x7f26e40db200 2024-04-25T13:16:40.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.715+0000 7f26f0c60640 1 -- 172.21.15.52:0/156856145 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f26e4007a80 con 0x7f26e40dce00 2024-04-25T13:16:40.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.715+0000 7f26ead9d640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26e40dce00 0x7f26e404f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.715+0000 7f26f0c60640 1 -- 172.21.15.52:0/156856145 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f26e404cfa0 con 0x7f26e404b9a0 2024-04-25T13:16:40.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.715+0000 7f26e9d9b640 1 -- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26e404b9a0 msgr2=0x7f26e40d5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.715+0000 7f26e9d9b640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26e404b9a0 0x7f26e40d5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.715+0000 7f26e9d9b640 1 -- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26e40dce00 msgr2=0x7f26e404f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.715+0000 7f26e9d9b640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26e40dce00 0x7f26e404f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.715+0000 7f26e9d9b640 1 -- 172.21.15.52:0/156856145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e40500e0 con 0x7f26e40db200 2024-04-25T13:16:40.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.716+0000 7f26e9d9b640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40db200 0x7f26e40d6130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f26ec065470 tx=0x7f26ec06cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.717+0000 7f26ea59c640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26e404b9a0 0x7f26e40d5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:40.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.717+0000 7f26ead9d640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26e40dce00 0x7f26e404f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:40.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.717+0000 7f26daffd640 1 -- 172.21.15.52:0/156856145 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec091070 con 0x7f26e40db200 2024-04-25T13:16:40.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.717+0000 7f26f0c60640 1 -- 172.21.15.52:0/156856145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e4050360 con 0x7f26e40db200 2024-04-25T13:16:40.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.717+0000 7f26f0c60640 1 -- 172.21.15.52:0/156856145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e4050920 con 0x7f26e40db200 2024-04-25T13:16:40.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.721+0000 7f26daffd640 1 -- 172.21.15.52:0/156856145 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ec069e10 con 0x7f26e40db200 2024-04-25T13:16:40.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.721+0000 7f26daffd640 1 -- 172.21.15.52:0/156856145 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec074460 con 0x7f26e40db200 2024-04-25T13:16:40.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.724+0000 7fca1a21a640 1 Processor -- start 2024-04-25T13:16:40.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.724+0000 7fca1a21a640 1 -- start start 2024-04-25T13:16:40.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.723+0000 7f26daffd640 1 -- 172.21.15.52:0/156856145 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f26ec094070 con 0x7f26e40db200 2024-04-25T13:16:40.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.723+0000 7f26daffd640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f26cc06ca20 0x7f26cc06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.723+0000 7f26daffd640 1 -- 172.21.15.52:0/156856145 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f26ec108430 con 0x7f26e40db200 2024-04-25T13:16:40.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.724+0000 7f26d8ff9640 1 -- 172.21.15.52:0/156856145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d0005290 con 0x7f26e40db200 2024-04-25T13:16:40.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.725+0000 7fca1a21a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca14151e50 0x7fca14072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.725+0000 7fca1a21a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca141586f0 con 0x7fca140c99d0 2024-04-25T13:16:40.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.725+0000 7fca18a17640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fca140c99d0 0x7fca140c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43244/0 (socket says 172.21.15.52:43244) 2024-04-25T13:16:40.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.725+0000 7fca18a17640 1 -- 172.21.15.52:0/980358827 learned_addr learned my addr 172.21.15.52:0/980358827 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:40.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.725+0000 7fca1a21a640 1 -- 172.21.15.52:0/980358827 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1415b0f0 con 0x7fca14157a80 2024-04-25T13:16:40.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.725+0000 7fca1a21a640 1 -- 172.21.15.52:0/980358827 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fca141589d0 con 0x7fca14151e50 2024-04-25T13:16:40.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.726+0000 7f26ea59c640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f26cc06ca20 0x7f26cc06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.726+0000 7fca19218640 1 --2- 172.21.15.52:0/980358827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca14151e50 0x7fca14072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.726+0000 7f6f34ffe640 1 Processor -- start 2024-04-25T13:16:40.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.726+0000 7f6f34ffe640 1 -- start start 2024-04-25T13:16:40.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.726+0000 7f26ea59c640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f26cc06ca20 0x7f26cc06eee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f26e0006fd0 tx=0x7f26e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.727+0000 7fca19218640 1 -- 172.21.15.52:0/980358827 >> v1:172.21.15.102:6789/0 conn(0x7fca14157a80 legacy=0x7fca14157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.727+0000 7fca19218640 1 -- 172.21.15.52:0/980358827 >> v1:172.21.15.52:6789/0 conn(0x7fca140c99d0 legacy=0x7fca140c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.727+0000 7fca19218640 1 -- 172.21.15.52:0/980358827 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1415b3d0 con 0x7fca14151e50 2024-04-25T13:16:40.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.728+0000 7f6f34ffe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f30159340 0x7f6f3015fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.728+0000 7f6f34ffe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f301607d0 0x7f6f30074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.728+0000 7f6f34ffe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6f30160c10 0x7f6f30075290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.728+0000 7f6f2dd9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f301607d0 0x7f6f30074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.728+0000 7f6f2dd9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f301607d0 0x7f6f30074d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55216/0 (socket says 172.21.15.52:55216) 2024-04-25T13:16:40.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.728+0000 7f6f2dd9b640 1 -- 172.21.15.52:0/4239687229 learned_addr learned my addr 172.21.15.52:0/4239687229 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:40.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.728+0000 7f6f34ffe640 1 -- 172.21.15.52:0/4239687229 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6f30163200 con 0x7f6f301607d0 2024-04-25T13:16:40.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.728+0000 7f6f34ffe640 1 -- 172.21.15.52:0/4239687229 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6f300cddf0 con 0x7f6f30160c10 2024-04-25T13:16:40.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.728+0000 7f6f34ffe640 1 -- 172.21.15.52:0/4239687229 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6f300ce090 con 0x7f6f30159340 2024-04-25T13:16:40.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.728+0000 7f6f2e59c640 1 --2- 172.21.15.52:0/4239687229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f30159340 0x7f6f3015fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.728+0000 7f6f2ed9d640 1 --2- 172.21.15.52:0/4239687229 >> v2:172.21.15.102:3300/0 conn(0x7f6f30160c10 0x7f6f30075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.729+0000 7f6f2dd9b640 1 -- 172.21.15.52:0/4239687229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f30159340 msgr2=0x7f6f3015fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:40.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.729+0000 7f6f2dd9b640 1 --2- 172.21.15.52:0/4239687229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f30159340 0x7f6f3015fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.729+0000 7f6f2dd9b640 1 -- 172.21.15.52:0/4239687229 >> v2:172.21.15.102:3300/0 conn(0x7f6f30160c10 msgr2=0x7f6f30075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:40.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.729+0000 7f6f2dd9b640 1 --2- 172.21.15.52:0/4239687229 >> v2:172.21.15.102:3300/0 conn(0x7f6f30160c10 0x7f6f30075290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.729+0000 7f6f2dd9b640 1 -- 172.21.15.52:0/4239687229 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f300ce370 con 0x7f6f301607d0 2024-04-25T13:16:40.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.730+0000 7feb40423640 1 Processor -- start 2024-04-25T13:16:40.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.730+0000 7feb40423640 1 -- start start 2024-04-25T13:16:40.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.730+0000 7f6f2dd9b640 1 --2- 172.21.15.52:0/4239687229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f301607d0 0x7f6f30074d50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6f300c48d0 tx=0x7f6f1802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822b6d7259914a04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.730+0000 7fca19218640 1 --2- 172.21.15.52:0/980358827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca14151e50 0x7fca14072120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fca100097d0 tx=0x7fca1002c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adadd9642a81c23f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.730+0000 7fca0bfff640 1 -- 172.21.15.52:0/980358827 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10038070 con 0x7fca14151e50 2024-04-25T13:16:40.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.730+0000 7fca0bfff640 1 -- 172.21.15.52:0/980358827 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10031710 con 0x7fca14151e50 2024-04-25T13:16:40.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.730+0000 7fca0bfff640 1 -- 172.21.15.52:0/980358827 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10031b20 con 0x7fca14151e50 2024-04-25T13:16:40.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.731+0000 7feb40423640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb381551b0 0x7feb3815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.731+0000 7feb40423640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feb380cc3b0 0x7feb380cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.731+0000 7feb40423640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3815e5b0 con 0x7feb3806d480 2024-04-25T13:16:40.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.731+0000 7feb40423640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7feb380cbf20 con 0x7feb381551b0 2024-04-25T13:16:40.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.731+0000 7feb40423640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7feb38155590 con 0x7feb380cc3b0 2024-04-25T13:16:40.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.731+0000 7feb3e1bf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb381551b0 0x7feb3815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.731+0000 7feb3e1bf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb381551b0 0x7feb3815b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55222/0 (socket says 172.21.15.52:55222) 2024-04-25T13:16:40.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.731+0000 7feb3d9be640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7feb3806d480 0x7feb380d0c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:52990/0 (socket says 172.21.15.52:52990) 2024-04-25T13:16:40.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.731+0000 7feb3e1bf640 1 -- 172.21.15.52:0/772339222 learned_addr learned my addr 172.21.15.52:0/772339222 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:40.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.731+0000 7feb3e9c0640 1 --2- 172.21.15.52:0/772339222 >> v2:172.21.15.102:3300/0 conn(0x7feb380cc3b0 0x7feb380cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.732+0000 7fca1a21a640 1 -- 172.21.15.52:0/980358827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca14151e50 msgr2=0x7fca14072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.732+0000 7fca1a21a640 1 --2- 172.21.15.52:0/980358827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca14151e50 0x7fca14072120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fca100097d0 tx=0x7fca1002c4f0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.732+0000 7feb3e1bf640 1 -- 172.21.15.52:0/772339222 >> v2:172.21.15.102:3300/0 conn(0x7feb380cc3b0 msgr2=0x7feb380cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:40.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.732+0000 7feb3e1bf640 1 --2- 172.21.15.52:0/772339222 >> v2:172.21.15.102:3300/0 conn(0x7feb380cc3b0 0x7feb380cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.732+0000 7feb3e1bf640 1 -- 172.21.15.52:0/772339222 >> v1:172.21.15.102:6789/0 conn(0x7feb3806d480 legacy=0x7feb380d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.732+0000 7feb3e1bf640 1 -- 172.21.15.52:0/772339222 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3815e890 con 0x7feb381551b0 2024-04-25T13:16:40.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.732+0000 7fca1a21a640 1 -- 172.21.15.52:0/980358827 shutdown_connections 2024-04-25T13:16:40.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.732+0000 7fca1a21a640 1 --2- 172.21.15.52:0/980358827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca14151e50 0x7fca14072120 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.732+0000 7fca1a21a640 1 -- 172.21.15.52:0/980358827 >> 172.21.15.52:0/980358827 conn(0x7fca1406b920 msgr2=0x7fca1406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:40.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.732+0000 7fca1a21a640 1 -- 172.21.15.52:0/980358827 shutdown_connections 2024-04-25T13:16:40.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.732+0000 7fca1a21a640 1 -- 172.21.15.52:0/980358827 wait complete. 2024-04-25T13:16:40.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.732+0000 7feb3e1bf640 1 --2- 172.21.15.52:0/772339222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb381551b0 0x7feb3815b8c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feb380c79a0 tx=0x7feb3402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9873a7b940789d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.733+0000 7f5afb4e2640 1 Processor -- start 2024-04-25T13:16:40.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.733+0000 7f5afb4e2640 1 -- start start 2024-04-25T13:16:40.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.733+0000 7f914decb640 1 Processor -- start 2024-04-25T13:16:40.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.733+0000 7f914decb640 1 -- start start 2024-04-25T13:16:40.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.734+0000 7f5afb4e2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5aec0d8f30 0x7f5aec045800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.734+0000 7f5afb4e2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aec0df440 con 0x7f5aec04b0d0 2024-04-25T13:16:40.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.734+0000 7fca1a21a640 1 Processor -- start 2024-04-25T13:16:40.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.734+0000 7f5afb4e2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aec0df720 con 0x7f5aec0dec90 2024-04-25T13:16:40.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.734+0000 7fca1a21a640 1 -- start start 2024-04-25T13:16:40.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.734+0000 7f5afb4e2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5aec045d40 con 0x7f5aec0d8f30 2024-04-25T13:16:40.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.734+0000 7f26daffd640 1 -- 172.21.15.52:0/156856145 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f26e40500e0 con 0x7f26e40db200 2024-04-25T13:16:40.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7feb3d1bd640 1 -- 172.21.15.52:0/772339222 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34037070 con 0x7feb381551b0 2024-04-25T13:16:40.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7feb3d1bd640 1 -- 172.21.15.52:0/772339222 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb34032440 con 0x7feb381551b0 2024-04-25T13:16:40.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7feb3d1bd640 1 -- 172.21.15.52:0/772339222 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb340327f0 con 0x7feb381551b0 2024-04-25T13:16:40.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f5af9cdf640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f5aec0dec90 0x7f5aec046880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:53000/0 (socket says 172.21.15.52:53000) 2024-04-25T13:16:40.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f5af9cdf640 1 -- 172.21.15.52:0/1541516770 learned_addr learned my addr 172.21.15.52:0/1541516770 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:40.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f5afa4e0640 1 --2- 172.21.15.52:0/1541516770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5aec0d8f30 0x7f5aec045800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f5afa4e0640 1 -- 172.21.15.52:0/1541516770 >> v1:172.21.15.102:6789/0 conn(0x7f5aec0dec90 legacy=0x7f5aec046880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:40.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f5afa4e0640 1 -- 172.21.15.52:0/1541516770 >> v1:172.21.15.52:6789/0 conn(0x7f5aec04b0d0 legacy=0x7f5aec0e9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:40.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f5afa4e0640 1 -- 172.21.15.52:0/1541516770 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec0dfa00 con 0x7f5aec0d8f30 2024-04-25T13:16:40.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7fca1a21a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca140c99d0 0x7fca14159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7fca1a21a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca14151e50 0x7fca141f0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f914decb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480cdfa0 0x7f9148072250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f91477fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f9148151e70 0x7f91480cd890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:53002/0 (socket says 172.21.15.52:53002) 2024-04-25T13:16:40.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f91477fe640 1 -- 172.21.15.52:0/2706532083 learned_addr learned my addr 172.21.15.52:0/2706532083 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:40.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f914decb640 1 --2- 172.21.15.52:0/2706532083 >> v2:172.21.15.52:3300/0 conn(0x7f91480c88f0 0x7f9148072790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f9146ffd640 1 --2- 172.21.15.52:0/2706532083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480cdfa0 0x7f9148072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f914decb640 1 -- 172.21.15.52:0/2706532083 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9148157e60 con 0x7f9148151e70 2024-04-25T13:16:40.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f914decb640 1 -- 172.21.15.52:0/2706532083 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9148157c30 con 0x7f91480c88f0 2024-04-25T13:16:40.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f914decb640 1 -- 172.21.15.52:0/2706532083 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9148158100 con 0x7f91480cdfa0 2024-04-25T13:16:40.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f91467fc640 1 -- 172.21.15.52:0/2706532083 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402100826 0 0) 0x7f9148157e60 con 0x7f9148151e70 2024-04-25T13:16:40.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7f91467fc640 1 -- 172.21.15.52:0/2706532083 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9130003520 con 0x7f9148151e70 2024-04-25T13:16:40.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.734+0000 7f6f2d59a640 1 -- 172.21.15.52:0/4239687229 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18037070 con 0x7f6f301607d0 2024-04-25T13:16:40.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f6f2d59a640 1 -- 172.21.15.52:0/4239687229 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f18032440 con 0x7f6f301607d0 2024-04-25T13:16:40.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.735+0000 7f6f2d59a640 1 -- 172.21.15.52:0/4239687229 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f180327f0 con 0x7f6f301607d0 2024-04-25T13:16:40.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7f6f34ffe640 1 -- 172.21.15.52:0/4239687229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f301607d0 msgr2=0x7f6f30074d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7f6f34ffe640 1 --2- 172.21.15.52:0/4239687229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f301607d0 0x7f6f30074d50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6f300c48d0 tx=0x7f6f1802a290 comp rx=0 tx=0).stop 2024-04-25T13:16:40.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7feb40423640 1 -- 172.21.15.52:0/772339222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb381551b0 msgr2=0x7feb3815b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7feb40423640 1 --2- 172.21.15.52:0/772339222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb381551b0 0x7feb3815b8c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feb380c79a0 tx=0x7feb3402a290 comp rx=0 tx=0).stop 2024-04-25T13:16:40.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7feb40423640 1 -- 172.21.15.52:0/772339222 shutdown_connections 2024-04-25T13:16:40.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7feb40423640 1 --2- 172.21.15.52:0/772339222 >> v2:172.21.15.102:3300/0 conn(0x7feb380cc3b0 0x7feb380cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7feb40423640 1 --2- 172.21.15.52:0/772339222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb381551b0 0x7feb3815b8c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7feb40423640 1 -- 172.21.15.52:0/772339222 >> 172.21.15.52:0/772339222 conn(0x7feb38073300 msgr2=0x7feb38073710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:40.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7feb40423640 1 -- 172.21.15.52:0/772339222 shutdown_connections 2024-04-25T13:16:40.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7feb40423640 1 -- 172.21.15.52:0/772339222 wait complete. 2024-04-25T13:16:40.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7f5afa4e0640 1 --2- 172.21.15.52:0/1541516770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5aec0d8f30 0x7f5aec045800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5af00097d0 tx=0x7f5af002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba44cf470df80bc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7f5af94de640 1 -- 172.21.15.52:0/1541516770 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0037070 con 0x7f5aec0d8f30 2024-04-25T13:16:40.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7fca1a21a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca14157a80 0x7fca14144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7fca18a17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca14151e50 0x7fca141f0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7fca18a17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca14151e50 0x7fca141f0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:37340/0 (socket says 172.21.15.52:37340) 2024-04-25T13:16:40.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7fca18a17640 1 -- 172.21.15.52:0/113478591 learned_addr learned my addr 172.21.15.52:0/113478591 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:40.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7fca19a19640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca14157a80 0x7fca14144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca1415b990 con 0x7fca140c99d0 2024-04-25T13:16:40.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fca14152230 con 0x7fca14151e50 2024-04-25T13:16:40.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fca1415beb0 con 0x7fca14157a80 2024-04-25T13:16:40.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7fca19a19640 1 -- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca14151e50 msgr2=0x7fca141f0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7fca19a19640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca14151e50 0x7fca141f0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7fca19a19640 1 -- 172.21.15.52:0/113478591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca140c99d0 msgr2=0x7fca14159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7fca19a19640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca140c99d0 0x7fca14159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7fca19a19640 1 -- 172.21.15.52:0/113478591 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca141f0b30 con 0x7fca14157a80 2024-04-25T13:16:40.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7f9146ffd640 1 -- 172.21.15.52:0/2706532083 >> v2:172.21.15.52:3300/0 conn(0x7f91480c88f0 msgr2=0x7f9148072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:40.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7f9146ffd640 1 --2- 172.21.15.52:0/2706532083 >> v2:172.21.15.52:3300/0 conn(0x7f91480c88f0 0x7f9148072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7f9146ffd640 1 -- 172.21.15.52:0/2706532083 >> v1:172.21.15.102:6789/0 conn(0x7f9148151e70 legacy=0x7f91480cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.736+0000 7f9146ffd640 1 -- 172.21.15.52:0/2706532083 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91481583a0 con 0x7f91480cdfa0 2024-04-25T13:16:40.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7f9146ffd640 1 --2- 172.21.15.52:0/2706532083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480cdfa0 0x7f9148072250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f913c0097a0 tx=0x7f913c02c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6801fe5515e713b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7f5af94de640 1 -- 172.21.15.52:0/1541516770 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af0032440 con 0x7f5aec0d8f30 2024-04-25T13:16:40.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7f5af94de640 1 -- 172.21.15.52:0/1541516770 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0032810 con 0x7f5aec0d8f30 2024-04-25T13:16:40.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7f91467fc640 1 -- 172.21.15.52:0/2706532083 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c039070 con 0x7f91480cdfa0 2024-04-25T13:16:40.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7fca19a19640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca14157a80 0x7fca14144940 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fca0400c3c0 tx=0x7fca0400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7f91467fc640 1 -- 172.21.15.52:0/2706532083 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913c034640 con 0x7f91480cdfa0 2024-04-25T13:16:40.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7f91467fc640 1 -- 172.21.15.52:0/2706532083 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c034a10 con 0x7f91480cdfa0 2024-04-25T13:16:40.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.737+0000 7fca09ffb640 1 -- 172.21.15.52:0/113478591 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04017070 con 0x7fca14157a80 2024-04-25T13:16:40.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.738+0000 7feb40423640 1 Processor -- start 2024-04-25T13:16:40.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.738+0000 7f5afb4e2640 1 -- 172.21.15.52:0/1541516770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5aec0d8f30 msgr2=0x7f5aec045800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.738+0000 7f5afb4e2640 1 --2- 172.21.15.52:0/1541516770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5aec0d8f30 0x7f5aec045800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5af00097d0 tx=0x7f5af002a200 comp rx=0 tx=0).stop 2024-04-25T13:16:40.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.738+0000 7f914decb640 1 -- 172.21.15.52:0/2706532083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480cdfa0 msgr2=0x7f9148072250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.738+0000 7f914decb640 1 --2- 172.21.15.52:0/2706532083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480cdfa0 0x7f9148072250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f913c0097a0 tx=0x7f913c02c390 comp rx=0 tx=0).stop 2024-04-25T13:16:40.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.738+0000 7feb40423640 1 -- start start 2024-04-25T13:16:40.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.739+0000 7f914decb640 1 -- 172.21.15.52:0/2706532083 shutdown_connections 2024-04-25T13:16:40.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.739+0000 7f914decb640 1 --2- 172.21.15.52:0/2706532083 >> v2:172.21.15.52:3300/0 conn(0x7f91480c88f0 0x7f9148072790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.739+0000 7f914decb640 1 --2- 172.21.15.52:0/2706532083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480cdfa0 0x7f9148072250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.739+0000 7f914decb640 1 -- 172.21.15.52:0/2706532083 >> 172.21.15.52:0/2706532083 conn(0x7f914806b920 msgr2=0x7f914806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:40.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.739+0000 7f5afb4e2640 1 -- 172.21.15.52:0/1541516770 shutdown_connections 2024-04-25T13:16:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.739+0000 7f914decb640 1 -- 172.21.15.52:0/2706532083 shutdown_connections 2024-04-25T13:16:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.739+0000 7f914decb640 1 -- 172.21.15.52:0/2706532083 wait complete. 2024-04-25T13:16:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.739+0000 7f5afb4e2640 1 --2- 172.21.15.52:0/1541516770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5aec0d8f30 0x7f5aec045800 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.738+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca14144490 con 0x7fca14157a80 2024-04-25T13:16:40.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.738+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca14159af0 con 0x7fca14157a80 2024-04-25T13:16:40.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.739+0000 7f5afb4e2640 1 -- 172.21.15.52:0/1541516770 >> 172.21.15.52:0/1541516770 conn(0x7f5aec0505c0 msgr2=0x7f5aec0509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:40.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.739+0000 7f5afb4e2640 1 -- 172.21.15.52:0/1541516770 shutdown_connections 2024-04-25T13:16:40.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.739+0000 7f5afb4e2640 1 -- 172.21.15.52:0/1541516770 wait complete. 2024-04-25T13:16:40.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.739+0000 7fca09ffb640 1 -- 172.21.15.52:0/113478591 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca040052d0 con 0x7fca14157a80 2024-04-25T13:16:40.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7f6f34ffe640 1 -- 172.21.15.52:0/4239687229 shutdown_connections 2024-04-25T13:16:40.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7feb40423640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3806d480 0x7feb381597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7f6f34ffe640 1 --2- 172.21.15.52:0/4239687229 >> v2:172.21.15.102:3300/0 conn(0x7f6f30160c10 0x7f6f30075290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7feb40423640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb380cc3b0 0x7feb38158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7f6f34ffe640 1 --2- 172.21.15.52:0/4239687229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f301607d0 0x7f6f30074d50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7f6f34ffe640 1 --2- 172.21.15.52:0/4239687229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f30159340 0x7f6f3015fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7f6f34ffe640 1 -- 172.21.15.52:0/4239687229 >> 172.21.15.52:0/4239687229 conn(0x7f6f3006b920 msgr2=0x7f6f3006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7feb3d9be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb380cc3b0 0x7feb38158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7feb3e1bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3806d480 0x7feb381597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7feb3e1bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3806d480 0x7feb381597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:37352/0 (socket says 172.21.15.52:37352) 2024-04-25T13:16:40.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7feb3d9be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb380cc3b0 0x7feb38158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55236/0 (socket says 172.21.15.52:55236) 2024-04-25T13:16:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7feb3e1bf640 1 -- 172.21.15.52:0/272983993 learned_addr learned my addr 172.21.15.52:0/272983993 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7feb40423640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb381551b0 0x7feb381591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7fca09ffb640 1 -- 172.21.15.52:0/113478591 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04003830 con 0x7fca14157a80 2024-04-25T13:16:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb3815f130 con 0x7feb380cc3b0 2024-04-25T13:16:40.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.740+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feb3815ee50 con 0x7feb3806d480 2024-04-25T13:16:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.741+0000 7f6f34ffe640 1 -- 172.21.15.52:0/4239687229 shutdown_connections 2024-04-25T13:16:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.741+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feb380ccd10 con 0x7feb381551b0 2024-04-25T13:16:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.741+0000 7f6f34ffe640 1 -- 172.21.15.52:0/4239687229 wait complete. 2024-04-25T13:16:40.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.741+0000 7feb3e9c0640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb381551b0 0x7feb381591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.741+0000 7f914decb640 1 Processor -- start 2024-04-25T13:16:40.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.741+0000 7f914decb640 1 -- start start 2024-04-25T13:16:40.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.741+0000 7feb3d9be640 1 -- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb381551b0 msgr2=0x7feb381591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.742+0000 7f5afb4e2640 1 Processor -- start 2024-04-25T13:16:40.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.741+0000 7feb3d9be640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb381551b0 0x7feb381591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.742+0000 7f5afb4e2640 1 -- start start 2024-04-25T13:16:40.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.741+0000 7feb3d9be640 1 -- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3806d480 msgr2=0x7feb381597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.741+0000 7feb3d9be640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3806d480 0x7feb381597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.742+0000 7feb3d9be640 1 -- 172.21.15.52:0/272983993 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb38151100 con 0x7feb380cc3b0 2024-04-25T13:16:40.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.742+0000 7fca09ffb640 1 -- 172.21.15.52:0/113478591 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca0401a070 con 0x7fca14157a80 2024-04-25T13:16:40.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.742+0000 7fca09ffb640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc9f806c920 0x7fc9f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.742+0000 7fca19218640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc9f806c920 0x7fc9f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7fca09ffb640 1 -- 172.21.15.52:0/113478591 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fca0408b0c0 con 0x7fca14157a80 2024-04-25T13:16:40.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f914decb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480c88f0 0x7f9148154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.742+0000 7feb3d9be640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb380cc3b0 0x7feb38158cb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feb2800c7b0 tx=0x7feb2800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f914decb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91480cdfa0 0x7f91481e3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7fca19218640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc9f806c920 0x7fc9f806ede0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fca10035000 tx=0x7fca10030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f91477fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480c88f0 0x7f9148154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f91477fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480c88f0 0x7f9148154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:42118/0 (socket says 172.21.15.52:42118) 2024-04-25T13:16:40.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f6f34ffe640 1 Processor -- start 2024-04-25T13:16:40.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f4005290 con 0x7fca14157a80 2024-04-25T13:16:40.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f6f34ffe640 1 -- start start 2024-04-25T13:16:40.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f5afb4e2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5aec04b0d0 0x7f5aec0d5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f5afb4e2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0d8f30 0x7f5aec0d7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f9146ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91480cdfa0 0x7f91481e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f9146ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91480cdfa0 0x7f91481e3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55250/0 (socket says 172.21.15.52:55250) 2024-04-25T13:16:40.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f91477fe640 1 -- 172.21.15.52:0/1794878285 learned_addr learned my addr 172.21.15.52:0/1794878285 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:40.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f914decb640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9148151e70 0x7f91480730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f5afb4e2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5aec0dec90 0x7f5aec178b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f5afb4e2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec0062d0 con 0x7f5aec0d8f30 2024-04-25T13:16:40.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f5afb4e2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec0463f0 con 0x7f5aec04b0d0 2024-04-25T13:16:40.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f5afb4e2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5aec0d9310 con 0x7f5aec0dec90 2024-04-25T13:16:40.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f5af9cdf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0d8f30 0x7f5aec0d7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f914decb640 1 -- 172.21.15.52:0/1794878285 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9148152250 con 0x7f91480cdfa0 2024-04-25T13:16:40.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f914decb640 1 -- 172.21.15.52:0/1794878285 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9148158920 con 0x7f9148151e70 2024-04-25T13:16:40.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f5af9cdf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0d8f30 0x7f5aec0d7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55262/0 (socket says 172.21.15.52:55262) 2024-04-25T13:16:40.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.743+0000 7f5af9cdf640 1 -- 172.21.15.52:0/3002356014 learned_addr learned my addr 172.21.15.52:0/3002356014 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:40.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f5afa4e0640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5aec04b0d0 0x7f5aec0d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f914decb640 1 -- 172.21.15.52:0/1794878285 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f91481523d0 con 0x7f91480c88f0 2024-04-25T13:16:40.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f9147fff640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9148151e70 0x7f91480730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f5aface1640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5aec0dec90 0x7f5aec178b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f5af9cdf640 1 -- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5aec0dec90 msgr2=0x7f5aec178b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f5af9cdf640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5aec0dec90 0x7f5aec178b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f5af9cdf640 1 -- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5aec04b0d0 msgr2=0x7f5aec0d5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f5af9cdf640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5aec04b0d0 0x7f5aec0d5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f5af9cdf640 1 -- 172.21.15.52:0/3002356014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec0d78a0 con 0x7f5aec0d8f30 2024-04-25T13:16:40.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f5aface1640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5aec0dec90 0x7f5aec178b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:40.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f91477fe640 1 -- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9148151e70 msgr2=0x7f91480730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f91477fe640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9148151e70 0x7f91480730f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f91477fe640 1 -- 172.21.15.52:0/1794878285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91480cdfa0 msgr2=0x7f91481e3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f91477fe640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91480cdfa0 0x7f91481e3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f5af9cdf640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0d8f30 0x7f5aec0d7b70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400b430 tx=0x7f5ae400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f91477fe640 1 -- 172.21.15.52:0/1794878285 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9148155030 con 0x7f91480c88f0 2024-04-25T13:16:40.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.744+0000 7f9146ffd640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91480cdfa0 0x7f91481e3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:40.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7feb2effd640 1 -- 172.21.15.52:0/272983993 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28018070 con 0x7feb380cc3b0 2024-04-25T13:16:40.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7f91477fe640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480c88f0 0x7f9148154af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9138001bf0 tx=0x7f913800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7feb2effd640 1 -- 172.21.15.52:0/272983993 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb28007070 con 0x7feb380cc3b0 2024-04-25T13:16:40.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7feb2effd640 1 -- 172.21.15.52:0/272983993 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28007420 con 0x7feb380cc3b0 2024-04-25T13:16:40.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3814ff90 con 0x7feb380cc3b0 2024-04-25T13:16:40.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb381f52e0 con 0x7feb380cc3b0 2024-04-25T13:16:40.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7f6f34ffe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f30159340 0x7f6f300ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7f6f34ffe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f301607d0 0x7f6f300ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7f6f34ffe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f30160c10 0x7f6f301f88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7f6f2e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f30159340 0x7f6f300ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7f6f34ffe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30162e90 con 0x7f6f30159340 2024-04-25T13:16:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7f6f2dd9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f301607d0 0x7f6f300ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7f6f2dd9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f301607d0 0x7f6f300ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:42148/0 (socket says 172.21.15.52:42148) 2024-04-25T13:16:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7f6f2dd9b640 1 -- 172.21.15.52:0/2927136346 learned_addr learned my addr 172.21.15.52:0/2927136346 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7f6f2ed9d640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f30160c10 0x7f6f301f88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.747+0000 7f5aeaffd640 1 -- 172.21.15.52:0/3002356014 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4015020 con 0x7f5aec0d8f30 2024-04-25T13:16:40.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.745+0000 7f6f2e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f30159340 0x7f6f300ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55272/0 (socket says 172.21.15.52:55272) 2024-04-25T13:16:40.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.747+0000 7f5aeaffd640 1 -- 172.21.15.52:0/3002356014 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae4011850 con 0x7f5aec0d8f30 2024-04-25T13:16:40.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.747+0000 7f6f34ffe640 1 -- 172.21.15.52:0/2927136346 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30162bb0 con 0x7f6f30160c10 2024-04-25T13:16:40.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.747+0000 7f5afb4e2640 1 -- 172.21.15.52:0/3002356014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aec1793e0 con 0x7f5aec0d8f30 2024-04-25T13:16:40.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.747+0000 7f6f34ffe640 1 -- 172.21.15.52:0/2927136346 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6f30159720 con 0x7f6f301607d0 2024-04-25T13:16:40.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.747+0000 7f5afb4e2640 1 -- 172.21.15.52:0/3002356014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aec031f70 con 0x7f5aec0d8f30 2024-04-25T13:16:40.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.747+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb20005290 con 0x7feb380cc3b0 2024-04-25T13:16:40.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.747+0000 7feb2effd640 1 -- 172.21.15.52:0/272983993 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb2801b070 con 0x7feb380cc3b0 2024-04-25T13:16:40.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.748+0000 7feb2effd640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7feb1c06c940 0x7feb1c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.748+0000 7f6f2e59c640 1 -- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f301607d0 msgr2=0x7f6f300ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.748+0000 7f6f2e59c640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f301607d0 0x7f6f300ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.748+0000 7f6f2e59c640 1 -- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f30160c10 msgr2=0x7f6f301f88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.748+0000 7f6f2e59c640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f30160c10 0x7f6f301f88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.748+0000 7f6f2e59c640 1 -- 172.21.15.52:0/2927136346 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f301ea690 con 0x7f6f30159340 2024-04-25T13:16:40.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.748+0000 7feb2effd640 1 -- 172.21.15.52:0/272983993 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feb2808af00 con 0x7feb380cc3b0 2024-04-25T13:16:40.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.748+0000 7f5aeaffd640 1 -- 172.21.15.52:0/3002356014 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011c40 con 0x7f5aec0d8f30 2024-04-25T13:16:40.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.748+0000 7f6f2e59c640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f30159340 0x7f6f300ca270 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f20007d80 tx=0x7f6f2000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.748+0000 7f6f26ffd640 1 -- 172.21.15.52:0/2927136346 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20014420 con 0x7f6f30159340 2024-04-25T13:16:40.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.749+0000 7f6f34ffe640 1 -- 172.21.15.52:0/2927136346 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f301ea950 con 0x7f6f30159340 2024-04-25T13:16:40.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.749+0000 7f6f34ffe640 1 -- 172.21.15.52:0/2927136346 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f301eaf10 con 0x7f6f30159340 2024-04-25T13:16:40.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.749+0000 7feb3e1bf640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7feb1c06c940 0x7feb1c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.749+0000 7fca09ffb640 1 -- 172.21.15.52:0/113478591 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fca04058af0 con 0x7fca14157a80 2024-04-25T13:16:40.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.749+0000 7f5afb4e2640 1 -- 172.21.15.52:0/3002356014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aec0057d0 con 0x7f5aec0d8f30 2024-04-25T13:16:40.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.750+0000 7f1a13459640 1 Processor -- start 2024-04-25T13:16:40.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.750+0000 7f6f34ffe640 1 -- 172.21.15.52:0/2927136346 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f30068e40 con 0x7f6f30159340 2024-04-25T13:16:40.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.750+0000 7f1a13459640 1 -- start start 2024-04-25T13:16:40.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.749+0000 7feb3e1bf640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7feb1c06c940 0x7feb1c06ee00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb34009630 tx=0x7feb3402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.751+0000 7f1a13459640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1a0404b4f0 0x7f1a040dac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.751+0000 7f1a13459640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1a0404b8d0 0x7f1a04005e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.751+0000 7f1a13459640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a040063c0 0x7f1a04034a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f1a13459640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1a04007700 con 0x7f1a040063c0 2024-04-25T13:16:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f1a13459640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1a040068a0 con 0x7f1a0404b4f0 2024-04-25T13:16:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f1a13459640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1a04006b80 con 0x7f1a0404b8d0 2024-04-25T13:16:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f1a12c58640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a040063c0 0x7f1a04034a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f1a12c58640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a040063c0 0x7f1a04034a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55274/0 (socket says 172.21.15.52:55274) 2024-04-25T13:16:40.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f1a12c58640 1 -- 172.21.15.52:0/660027900 learned_addr learned my addr 172.21.15.52:0/660027900 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:40.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f5aeaffd640 1 -- 172.21.15.52:0/3002356014 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ae4018020 con 0x7f5aec0d8f30 2024-04-25T13:16:40.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f1a12c58640 1 -- 172.21.15.52:0/660027900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1a0404b8d0 msgr2=0x7f1a04005e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:16:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f1a12c58640 1 --2- 172.21.15.52:0/660027900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1a0404b8d0 0x7f1a04005e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f1a12c58640 1 -- 172.21.15.52:0/660027900 >> v2:172.21.15.102:3300/0 conn(0x7f1a0404b4f0 msgr2=0x7f1a040dac50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:16:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f1a12c58640 1 --2- 172.21.15.52:0/660027900 >> v2:172.21.15.102:3300/0 conn(0x7f1a0404b4f0 0x7f1a040dac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f1a12c58640 1 -- 172.21.15.52:0/660027900 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a04006e60 con 0x7f1a040063c0 2024-04-25T13:16:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.753+0000 7f5aeaffd640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5ad806c9c0 0x7f5ad806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.753+0000 7f5aeaffd640 1 -- 172.21.15.52:0/3002356014 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5ae408bce0 con 0x7f5aec0d8f30 2024-04-25T13:16:40.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.753+0000 7f1a12c58640 1 --2- 172.21.15.52:0/660027900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a040063c0 0x7f1a04034a30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0515e0 tx=0x7f1a0c0a6930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191b03df94cad882 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f912ffff640 1 -- 172.21.15.52:0/1794878285 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91380138e0 con 0x7f91480c88f0 2024-04-25T13:16:40.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.752+0000 7f912ffff640 1 -- 172.21.15.52:0/1794878285 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9138013aa0 con 0x7f91480c88f0 2024-04-25T13:16:40.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.753+0000 7f914decb640 1 -- 172.21.15.52:0/1794878285 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91481ecb80 con 0x7f91480c88f0 2024-04-25T13:16:40.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.753+0000 7f914decb640 1 -- 172.21.15.52:0/1794878285 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91481ed3c0 con 0x7f91480c88f0 2024-04-25T13:16:40.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.753+0000 7f912ffff640 1 -- 172.21.15.52:0/1794878285 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91380058b0 con 0x7f91480c88f0 2024-04-25T13:16:40.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.754+0000 7f5afa4e0640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5ad806c9c0 0x7f5ad806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.756+0000 7f912ffff640 1 -- 172.21.15.52:0/1794878285 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9138005a50 con 0x7f91480c88f0 2024-04-25T13:16:40.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.756+0000 7f912ffff640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f913406c9c0 0x7f913406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.757+0000 7f6f26ffd640 1 -- 172.21.15.52:0/2927136346 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f20019070 con 0x7f6f30159340 2024-04-25T13:16:40.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.757+0000 7f912ffff640 1 -- 172.21.15.52:0/1794878285 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9138093fe0 con 0x7f91480c88f0 2024-04-25T13:16:40.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.757+0000 7f6f26ffd640 1 -- 172.21.15.52:0/2927136346 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f200147c0 con 0x7f6f30159340 2024-04-25T13:16:40.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.757+0000 7feb2effd640 1 -- 172.21.15.52:0/272983993 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb28058a10 con 0x7feb380cc3b0 2024-04-25T13:16:40.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.757+0000 7f9146ffd640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f913406c9c0 0x7f913406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.758+0000 7f1a11455640 1 -- 172.21.15.52:0/660027900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0b0020 con 0x7f1a040063c0 2024-04-25T13:16:40.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.758+0000 7f5afa4e0640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5ad806c9c0 0x7f5ad806ee80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5af0034000 tx=0x7f5af002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.758+0000 7f914decb640 1 -- 172.21.15.52:0/1794878285 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f914806c8b0 con 0x7f91480c88f0 2024-04-25T13:16:40.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.758+0000 7fa8d9649640 1 Processor -- start 2024-04-25T13:16:40.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.759+0000 7f9146ffd640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f913406c9c0 0x7f913406ee80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f913c036000 tx=0x7f913c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.758+0000 7fa8d9649640 1 -- start start 2024-04-25T13:16:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.760+0000 7fa8d9649640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8d406e850 0x7fa8d406f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.760+0000 7fa8d9649640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8d415f6e0 con 0x7fa8d4159920 2024-04-25T13:16:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.760+0000 7fa8d9649640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8d415f9a0 con 0x7fa8d406ec30 2024-04-25T13:16:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.760+0000 7fa8d9649640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa8d40c48b0 con 0x7fa8d406e850 2024-04-25T13:16:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.760+0000 7fa8d2ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8d406e850 0x7fa8d406f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.760+0000 7fa8d2ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8d406e850 0x7fa8d406f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:37386/0 (socket says 172.21.15.52:37386) 2024-04-25T13:16:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.760+0000 7fa8d2ffd640 1 -- 172.21.15.52:0/902489395 learned_addr learned my addr 172.21.15.52:0/902489395 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.760+0000 7fa8d2ffd640 1 -- 172.21.15.52:0/902489395 >> v1:172.21.15.102:6789/0 conn(0x7fa8d406ec30 legacy=0x7fa8d4159210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:16:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.760+0000 7fa8d2ffd640 1 -- 172.21.15.52:0/902489395 >> v1:172.21.15.52:6789/0 conn(0x7fa8d4159920 legacy=0x7fa8d40c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.760+0000 7fa8d2ffd640 1 -- 172.21.15.52:0/902489395 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d415fc80 con 0x7fa8d406e850 2024-04-25T13:16:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.761+0000 7fa8d2ffd640 1 --2- 172.21.15.52:0/902489395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8d406e850 0x7fa8d406f4a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009e50 tx=0x7fa8cc02a7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b4ad4ae8e7819c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.762+0000 7fa8d1ffb640 1 -- 172.21.15.52:0/902489395 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc036070 con 0x7fa8d406e850 2024-04-25T13:16:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.762+0000 7fa8d1ffb640 1 -- 172.21.15.52:0/902489395 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8cc031600 con 0x7fa8d406e850 2024-04-25T13:16:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.762+0000 7fa8d1ffb640 1 -- 172.21.15.52:0/902489395 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0319d0 con 0x7fa8d406e850 2024-04-25T13:16:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.763+0000 7fa8d9649640 1 -- 172.21.15.52:0/902489395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8d406e850 msgr2=0x7fa8d406f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.763+0000 7fa8d9649640 1 --2- 172.21.15.52:0/902489395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8d406e850 0x7fa8d406f4a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009e50 tx=0x7fa8cc02a7f0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.763+0000 7fa8d9649640 1 -- 172.21.15.52:0/902489395 shutdown_connections 2024-04-25T13:16:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.763+0000 7fa8d9649640 1 --2- 172.21.15.52:0/902489395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8d406e850 0x7fa8d406f4a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.763+0000 7f912ffff640 1 -- 172.21.15.52:0/1794878285 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f91481ecb80 con 0x7f91480c88f0 2024-04-25T13:16:40.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.763+0000 7fa8d9649640 1 -- 172.21.15.52:0/902489395 >> 172.21.15.52:0/902489395 conn(0x7fa8d40c8f00 msgr2=0x7fa8d40c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:40.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.763+0000 7fa8d9649640 1 -- 172.21.15.52:0/902489395 shutdown_connections 2024-04-25T13:16:40.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.763+0000 7fa8d9649640 1 -- 172.21.15.52:0/902489395 wait complete. 2024-04-25T13:16:40.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.765+0000 7fa8d9649640 1 Processor -- start 2024-04-25T13:16:40.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.766+0000 7fa8d9649640 1 -- start start 2024-04-25T13:16:40.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.766+0000 7f5aeaffd640 1 -- 172.21.15.52:0/3002356014 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5ae401f020 con 0x7f5aec0d8f30 2024-04-25T13:16:40.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.768+0000 7f6f26ffd640 1 -- 172.21.15.52:0/2927136346 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f20014960 con 0x7f6f30159340 2024-04-25T13:16:40.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.769+0000 7f6f26ffd640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6f1006c920 0x7f6f1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.769+0000 7f1a11455640 1 -- 172.21.15.52:0/660027900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0c0ac930 con 0x7f1a040063c0 2024-04-25T13:16:40.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.769+0000 7f1a11455640 1 -- 172.21.15.52:0/660027900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0acda0 con 0x7f1a040063c0 2024-04-25T13:16:40.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.769+0000 7f6f26ffd640 1 -- 172.21.15.52:0/2927136346 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6f2008d5b0 con 0x7f6f30159340 2024-04-25T13:16:40.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.771+0000 7fa8d9649640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8d406e850 0x7fa8d40cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.771+0000 7fa8d9649640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d406ec30 0x7fa8d4156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.771+0000 7fa8d27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d406ec30 0x7fa8d4156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.771+0000 7fa8d27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d406ec30 0x7fa8d4156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55288/0 (socket says 172.21.15.52:55288) 2024-04-25T13:16:40.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.771+0000 7fa8d27fc640 1 -- 172.21.15.52:0/3334921156 learned_addr learned my addr 172.21.15.52:0/3334921156 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:40.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.772+0000 7fa8d9649640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8d4159920 0x7fa8d414b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.772+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d415f3d0 con 0x7fa8d406ec30 2024-04-25T13:16:40.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.772+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d4160240 con 0x7fa8d406e850 2024-04-25T13:16:40.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.772+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d406f9e0 con 0x7fa8d4159920 2024-04-25T13:16:40.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.773+0000 7fa8d37fe640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8d4159920 0x7fa8d414b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.772+0000 7f1a13459640 1 -- 172.21.15.52:0/660027900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a040063c0 msgr2=0x7f1a04034a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.772+0000 7f1a13459640 1 --2- 172.21.15.52:0/660027900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a040063c0 0x7f1a04034a30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0515e0 tx=0x7f1a0c0a6930 comp rx=0 tx=0).stop 2024-04-25T13:16:40.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.773+0000 7fa8d27fc640 1 -- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8d4159920 msgr2=0x7fa8d414b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.773+0000 7f1a13459640 1 -- 172.21.15.52:0/660027900 shutdown_connections 2024-04-25T13:16:40.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.773+0000 7f1a13459640 1 --2- 172.21.15.52:0/660027900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a040063c0 0x7f1a04034a30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.773+0000 7f1a13459640 1 --2- 172.21.15.52:0/660027900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1a0404b8d0 0x7f1a04005e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.773+0000 7f1a13459640 1 --2- 172.21.15.52:0/660027900 >> v2:172.21.15.102:3300/0 conn(0x7f1a0404b4f0 0x7f1a040dac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.773+0000 7f1a13459640 1 -- 172.21.15.52:0/660027900 >> 172.21.15.52:0/660027900 conn(0x7f1a04050170 msgr2=0x7f1a04050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:40.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.773+0000 7f1a13459640 1 -- 172.21.15.52:0/660027900 shutdown_connections 2024-04-25T13:16:40.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.773+0000 7fa8d27fc640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8d4159920 0x7fa8d414b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.773+0000 7fa8d27fc640 1 -- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8d406e850 msgr2=0x7fa8d40cb960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:16:40.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.773+0000 7fa8d27fc640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8d406e850 0x7fa8d40cb960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.773+0000 7fa8d27fc640 1 -- 172.21.15.52:0/3334921156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d40cc1f0 con 0x7fa8d406ec30 2024-04-25T13:16:40.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.774+0000 7fa8d27fc640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d406ec30 0x7fa8d4156d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400b750 tx=0x7fa8c400bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.775+0000 7f6f2dd9b640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6f1006c920 0x7f6f1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.774+0000 7f1a13459640 1 -- 172.21.15.52:0/660027900 wait complete. 2024-04-25T13:16:40.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.776+0000 7f1a13459640 1 Processor -- start 2024-04-25T13:16:40.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.776+0000 7f1a13459640 1 -- start start 2024-04-25T13:16:40.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.777+0000 7f6f26ffd640 1 -- 172.21.15.52:0/2927136346 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f2005b5f0 con 0x7f6f30159340 2024-04-25T13:16:40.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.777+0000 7f6f2dd9b640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6f1006c920 0x7f6f1006ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f301f61c0 tx=0x7f6f1802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.779+0000 7fa8bb7fe640 1 -- 172.21.15.52:0/3334921156 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4019070 con 0x7fa8d406ec30 2024-04-25T13:16:40.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.779+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d40730b0 con 0x7fa8d406ec30 2024-04-25T13:16:40.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.779+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d4071930 con 0x7fa8d406ec30 2024-04-25T13:16:40.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.779+0000 7fa8bb7fe640 1 -- 172.21.15.52:0/3334921156 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c400c720 con 0x7fa8d406ec30 2024-04-25T13:16:40.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.779+0000 7fa8bb7fe640 1 -- 172.21.15.52:0/3334921156 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400caf0 con 0x7fa8d406ec30 2024-04-25T13:16:40.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.777+0000 7f1a13459640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1a040063c0 0x7f1a0419b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.777+0000 7f1a13459640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a0404b4f0 0x7f1a040d5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.777+0000 7f1a13459640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a0404b8d0 0x7f1a040c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.777+0000 7f1a11c56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a0404b4f0 0x7f1a040d5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.777+0000 7f1a12457640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1a040063c0 0x7f1a0419b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.777+0000 7f1a12457640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1a040063c0 0x7f1a0419b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:42152/0 (socket says 172.21.15.52:42152) 2024-04-25T13:16:40.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.778+0000 7f1a11c56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a0404b4f0 0x7f1a040d5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:37398/0 (socket says 172.21.15.52:37398) 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.778+0000 7f1a12c58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a0404b8d0 0x7f1a040c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.778+0000 7f1a12c58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a0404b8d0 0x7f1a040c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55292/0 (socket says 172.21.15.52:55292) 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.778+0000 7f1a12457640 1 -- 172.21.15.52:0/3712703853 learned_addr learned my addr 172.21.15.52:0/3712703853 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.778+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0404bcf0 con 0x7f1a0404b8d0 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.778+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1a04007420 con 0x7f1a0404b4f0 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.778+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1a040d4ff0 con 0x7f1a040063c0 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.778+0000 7f1a12c58640 1 -- 172.21.15.52:0/3712703853 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1a040063c0 msgr2=0x7f1a0419b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.778+0000 7f1a12c58640 1 --2- 172.21.15.52:0/3712703853 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1a040063c0 0x7f1a0419b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.778+0000 7f1a12c58640 1 -- 172.21.15.52:0/3712703853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a0404b4f0 msgr2=0x7f1a040d5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.778+0000 7f1a12c58640 1 --2- 172.21.15.52:0/3712703853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a0404b4f0 0x7f1a040d5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.778+0000 7f1a12c58640 1 -- 172.21.15.52:0/3712703853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a040c4ab0 con 0x7f1a0404b8d0 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.779+0000 7f1a12c58640 1 --2- 172.21.15.52:0/3712703853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a0404b8d0 0x7f1a040c4570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c06a140 tx=0x7f1a0c0ab000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.781+0000 7f1a02ffd640 1 -- 172.21.15.52:0/3712703853 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c08b070 con 0x7f1a0404b8d0 2024-04-25T13:16:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.783+0000 7fa8bb7fe640 1 -- 172.21.15.52:0/3334921156 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8c401c070 con 0x7fa8d406ec30 2024-04-25T13:16:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.781+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a040d6450 con 0x7f1a0404b8d0 2024-04-25T13:16:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.787+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b4005290 con 0x7fa8d406ec30 2024-04-25T13:16:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.788+0000 7fa8bb7fe640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa8c006c9c0 0x7fa8c006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.788+0000 7fa8bb7fe640 1 -- 172.21.15.52:0/3334921156 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa8c408b380 con 0x7fa8d406ec30 2024-04-25T13:16:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.788+0000 7fa8d2ffd640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa8c006c9c0 0x7fa8c006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.781+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a040c3a90 con 0x7f1a0404b8d0 2024-04-25T13:16:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.789+0000 7f1a02ffd640 1 -- 172.21.15.52:0/3712703853 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0c0ab820 con 0x7f1a0404b8d0 2024-04-25T13:16:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.789+0000 7f1a02ffd640 1 -- 172.21.15.52:0/3712703853 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0abbd0 con 0x7f1a0404b8d0 2024-04-25T13:16:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.789+0000 7fa8d2ffd640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa8c006c9c0 0x7fa8c006ee80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa8d406c410 tx=0x7fa8cc009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.789+0000 7f1a02ffd640 1 -- 172.21.15.52:0/3712703853 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a0c0b3020 con 0x7f1a0404b8d0 2024-04-25T13:16:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.790+0000 7f1a02ffd640 1 --2- 172.21.15.52:0/3712703853 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f19f006c920 0x7f19f006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.790+0000 7f1a02ffd640 1 -- 172.21.15.52:0/3712703853 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1a0c117440 con 0x7f1a0404b8d0 2024-04-25T13:16:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.790+0000 7f1a12457640 1 --2- 172.21.15.52:0/3712703853 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f19f006c920 0x7f19f006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.791+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a04005380 con 0x7f1a0404b8d0 2024-04-25T13:16:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.796+0000 7fa8bb7fe640 1 -- 172.21.15.52:0/3334921156 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa8d40cc1f0 con 0x7fa8d406ec30 2024-04-25T13:16:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.808+0000 7f1a12457640 1 --2- 172.21.15.52:0/3712703853 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f19f006c920 0x7f19f006ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a080099f0 tx=0x7f1a080090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:40.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:40.811+0000 7f1a02ffd640 1 -- 172.21.15.52:0/3712703853 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1a0c0e4ec0 con 0x7f1a0404b8d0 2024-04-25T13:16:41.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.160+0000 7f914decb640 1 -- 172.21.15.52:0/1794878285 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9148068e40 con 0x7f91480c88f0 2024-04-25T13:16:41.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.168+0000 7f912ffff640 1 -- 172.21.15.52:0/1794878285 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9138062140 con 0x7f91480c88f0 2024-04-25T13:16:41.174 INFO:teuthology.orchestra.run.smithi052.stdout:55834574861 2024-04-25T13:16:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.179+0000 7f912dffb640 1 -- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f913406c9c0 msgr2=0x7f913406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.179+0000 7f912dffb640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f913406c9c0 0x7f913406ee80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f913c036000 tx=0x7f913c030000 comp rx=0 tx=0).stop 2024-04-25T13:16:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.178+0000 7f26d8ff9640 1 -- 172.21.15.52:0/156856145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f26d0005580 con 0x7f26e40db200 2024-04-25T13:16:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.179+0000 7f912dffb640 1 -- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480c88f0 msgr2=0x7f9148154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.179+0000 7f912dffb640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480c88f0 0x7f9148154af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9138001bf0 tx=0x7f913800a430 comp rx=0 tx=0).stop 2024-04-25T13:16:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.179+0000 7f912dffb640 1 -- 172.21.15.52:0/1794878285 shutdown_connections 2024-04-25T13:16:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.179+0000 7f912dffb640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f913406c9c0 0x7f913406ee80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.179+0000 7f912dffb640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9148151e70 0x7f91480730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.179+0000 7f912dffb640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91480cdfa0 0x7f91481e3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.179+0000 7f912dffb640 1 --2- 172.21.15.52:0/1794878285 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91480c88f0 0x7f9148154af0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.179+0000 7f912dffb640 1 -- 172.21.15.52:0/1794878285 >> 172.21.15.52:0/1794878285 conn(0x7f914806b920 msgr2=0x7f91480c79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.180+0000 7f26daffd640 1 -- 172.21.15.52:0/156856145 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f26ec0d6590 con 0x7f26e40db200 2024-04-25T13:16:41.181 INFO:teuthology.orchestra.run.smithi052.stdout:55834574859 2024-04-25T13:16:41.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.180+0000 7f912dffb640 1 -- 172.21.15.52:0/1794878285 shutdown_connections 2024-04-25T13:16:41.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.180+0000 7f912dffb640 1 -- 172.21.15.52:0/1794878285 wait complete. 2024-04-25T13:16:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.195+0000 7f26d8ff9640 1 -- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f26cc06ca20 msgr2=0x7f26cc06eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.195+0000 7f26d8ff9640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f26cc06ca20 0x7f26cc06eee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f26e0006fd0 tx=0x7f26e0008040 comp rx=0 tx=0).stop 2024-04-25T13:16:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.195+0000 7f26d8ff9640 1 -- 172.21.15.52:0/156856145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40db200 msgr2=0x7f26e40d6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.195+0000 7f26d8ff9640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40db200 0x7f26e40d6130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f26ec065470 tx=0x7f26ec06cd00 comp rx=0 tx=0).stop 2024-04-25T13:16:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.195+0000 7f26d8ff9640 1 -- 172.21.15.52:0/156856145 shutdown_connections 2024-04-25T13:16:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.195+0000 7f26d8ff9640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f26cc06ca20 0x7f26cc06eee0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.195+0000 7f26d8ff9640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26e40dce00 0x7f26e404f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.195+0000 7f26d8ff9640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e40db200 0x7f26e40d6130 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.195+0000 7f26d8ff9640 1 --2- 172.21.15.52:0/156856145 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26e404b9a0 0x7f26e40d5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.195+0000 7f26d8ff9640 1 -- 172.21.15.52:0/156856145 >> 172.21.15.52:0/156856145 conn(0x7f26e404d4a0 msgr2=0x7f26e404d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.195+0000 7f26d8ff9640 1 -- 172.21.15.52:0/156856145 shutdown_connections 2024-04-25T13:16:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.195+0000 7f26d8ff9640 1 -- 172.21.15.52:0/156856145 wait complete. 2024-04-25T13:16:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.204+0000 7f5afb4e2640 1 -- 172.21.15.52:0/3002356014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5aec04bc80 con 0x7f5aec0d8f30 2024-04-25T13:16:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.206+0000 7f5aeaffd640 1 -- 172.21.15.52:0/3002356014 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ae4059db0 con 0x7f5aec0d8f30 2024-04-25T13:16:41.207 INFO:teuthology.orchestra.run.smithi052.stdout:55834574859 2024-04-25T13:16:41.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-04-25T13:16:41.212 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:41.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.5 2024-04-25T13:16:41.213 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:41.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.211+0000 7f5afb4e2640 1 -- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5ad806c9c0 msgr2=0x7f5ad806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.211+0000 7f5afb4e2640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5ad806c9c0 0x7f5ad806ee80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5af0034000 tx=0x7f5af002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:41.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.211+0000 7f5afb4e2640 1 -- 172.21.15.52:0/3002356014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0d8f30 msgr2=0x7f5aec0d7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.211+0000 7f5afb4e2640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0d8f30 0x7f5aec0d7b70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400b430 tx=0x7f5ae400b8f0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.211+0000 7f5afb4e2640 1 -- 172.21.15.52:0/3002356014 shutdown_connections 2024-04-25T13:16:41.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.211+0000 7f5afb4e2640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5ad806c9c0 0x7f5ad806ee80 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5af0034000 tx=0x7f5af002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.211+0000 7f5afb4e2640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5aec0dec90 0x7f5aec178b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.211+0000 7f5afb4e2640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0d8f30 0x7f5aec0d7b70 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400b430 tx=0x7f5ae400b8f0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.211+0000 7f5afb4e2640 1 --2- 172.21.15.52:0/3002356014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5aec04b0d0 0x7f5aec0d5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.211+0000 7f5afb4e2640 1 -- 172.21.15.52:0/3002356014 >> 172.21.15.52:0/3002356014 conn(0x7f5aec0505c0 msgr2=0x7f5aec0dd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.212+0000 7f5afb4e2640 1 -- 172.21.15.52:0/3002356014 shutdown_connections 2024-04-25T13:16:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.212+0000 7f5afb4e2640 1 -- 172.21.15.52:0/3002356014 wait complete. 2024-04-25T13:16:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.222+0000 7f6f34ffe640 1 -- 172.21.15.52:0/2927136346 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6f30070540 con 0x7f6f30159340 2024-04-25T13:16:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.223+0000 7f6f26ffd640 1 -- 172.21.15.52:0/2927136346 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f2005aef0 con 0x7f6f30159340 2024-04-25T13:16:41.223 INFO:teuthology.orchestra.run.smithi052.stdout:55834574860 2024-04-25T13:16:41.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-04-25T13:16:41.224 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.225+0000 7f6f34ffe640 1 -- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6f1006c920 msgr2=0x7f6f1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.225+0000 7f6f34ffe640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6f1006c920 0x7f6f1006ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f301f61c0 tx=0x7f6f1802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.225+0000 7f6f34ffe640 1 -- 172.21.15.52:0/2927136346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f30159340 msgr2=0x7f6f300ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.225+0000 7f6f34ffe640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f30159340 0x7f6f300ca270 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f20007d80 tx=0x7f6f2000e4b0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.225+0000 7f6f34ffe640 1 -- 172.21.15.52:0/2927136346 shutdown_connections 2024-04-25T13:16:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.225+0000 7f6f34ffe640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6f1006c920 0x7f6f1006ede0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.225+0000 7f6f34ffe640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f301607d0 0x7f6f300ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.225+0000 7f6f34ffe640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f30160c10 0x7f6f301f88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.225+0000 7f6f34ffe640 1 --2- 172.21.15.52:0/2927136346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f30159340 0x7f6f300ca270 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.225+0000 7f6f34ffe640 1 -- 172.21.15.52:0/2927136346 >> 172.21.15.52:0/2927136346 conn(0x7f6f3006b920 msgr2=0x7f6f30161d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.225+0000 7f6f34ffe640 1 -- 172.21.15.52:0/2927136346 shutdown_connections 2024-04-25T13:16:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.225+0000 7f6f34ffe640 1 -- 172.21.15.52:0/2927136346 wait complete. 2024-04-25T13:16:41.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.7 2024-04-25T13:16:41.241 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:41.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.249+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc9f4005580 con 0x7fca14157a80 2024-04-25T13:16:41.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.250+0000 7fca09ffb640 1 -- 172.21.15.52:0/113478591 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca0405cdf0 con 0x7fca14157a80 2024-04-25T13:16:41.250 INFO:teuthology.orchestra.run.smithi052.stdout:55834574860 2024-04-25T13:16:41.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.252+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc9f806c920 msgr2=0x7fc9f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.252+0000 7fca1a21a640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc9f806c920 0x7fc9f806ede0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fca10035000 tx=0x7fca10030000 comp rx=0 tx=0).stop 2024-04-25T13:16:41.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.252+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca14157a80 msgr2=0x7fca14144940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.252+0000 7fca1a21a640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca14157a80 0x7fca14144940 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fca0400c3c0 tx=0x7fca0400c880 comp rx=0 tx=0).stop 2024-04-25T13:16:41.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.252+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 shutdown_connections 2024-04-25T13:16:41.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.252+0000 7fca1a21a640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc9f806c920 0x7fc9f806ede0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.252+0000 7fca1a21a640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca14157a80 0x7fca14144940 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.252+0000 7fca1a21a640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca14151e50 0x7fca141f0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.252+0000 7fca1a21a640 1 --2- 172.21.15.52:0/113478591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca140c99d0 0x7fca14159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.252+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 >> 172.21.15.52:0/113478591 conn(0x7fca1406b920 msgr2=0x7fca14074ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.252+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 shutdown_connections 2024-04-25T13:16:41.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.252+0000 7fca1a21a640 1 -- 172.21.15.52:0/113478591 wait complete. 2024-04-25T13:16:41.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.6 2024-04-25T13:16:41.267 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:41.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.286+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa8b4005580 con 0x7fa8d406ec30 2024-04-25T13:16:41.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.286+0000 7fa8bb7fe640 1 -- 172.21.15.52:0/3334921156 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa8c4059450 con 0x7fa8d406ec30 2024-04-25T13:16:41.287 INFO:teuthology.orchestra.run.smithi052.stdout:55834574858 2024-04-25T13:16:41.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.289+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa8c006c9c0 msgr2=0x7fa8c006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.289+0000 7fa8d9649640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa8c006c9c0 0x7fa8c006ee80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa8d406c410 tx=0x7fa8cc009000 comp rx=0 tx=0).stop 2024-04-25T13:16:41.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.289+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d406ec30 msgr2=0x7fa8d4156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.289+0000 7fa8d9649640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d406ec30 0x7fa8d4156d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400b750 tx=0x7fa8c400bc10 comp rx=0 tx=0).stop 2024-04-25T13:16:41.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.289+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 shutdown_connections 2024-04-25T13:16:41.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.289+0000 7fa8d9649640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa8c006c9c0 0x7fa8c006ee80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.289+0000 7fa8d9649640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8d4159920 0x7fa8d414b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.289+0000 7fa8d9649640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d406ec30 0x7fa8d4156d80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.289+0000 7fa8d9649640 1 --2- 172.21.15.52:0/3334921156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8d406e850 0x7fa8d40cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.289+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 >> 172.21.15.52:0/3334921156 conn(0x7fa8d40c8f00 msgr2=0x7fa8d40c4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.289+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 shutdown_connections 2024-04-25T13:16:41.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.289+0000 7fa8d9649640 1 -- 172.21.15.52:0/3334921156 wait complete. 2024-04-25T13:16:41.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.296+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1a0404e590 con 0x7f1a0404b8d0 2024-04-25T13:16:41.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.296+0000 7f1a02ffd640 1 -- 172.21.15.52:0/3712703853 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a0c0e91c0 con 0x7f1a0404b8d0 2024-04-25T13:16:41.296 INFO:teuthology.orchestra.run.smithi052.stdout:55834574859 2024-04-25T13:16:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.298+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f19f006c920 msgr2=0x7f19f006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.298+0000 7f1a13459640 1 --2- 172.21.15.52:0/3712703853 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f19f006c920 0x7f19f006ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a080099f0 tx=0x7f1a080090e0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.298+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a0404b8d0 msgr2=0x7f1a040c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.298+0000 7f1a13459640 1 --2- 172.21.15.52:0/3712703853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a0404b8d0 0x7f1a040c4570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c06a140 tx=0x7f1a0c0ab000 comp rx=0 tx=0).stop 2024-04-25T13:16:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.298+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 shutdown_connections 2024-04-25T13:16:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.298+0000 7f1a13459640 1 --2- 172.21.15.52:0/3712703853 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f19f006c920 0x7f19f006ede0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.298+0000 7f1a13459640 1 --2- 172.21.15.52:0/3712703853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a0404b8d0 0x7f1a040c4570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.298+0000 7f1a13459640 1 --2- 172.21.15.52:0/3712703853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a0404b4f0 0x7f1a040d5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.298+0000 7f1a13459640 1 --2- 172.21.15.52:0/3712703853 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1a040063c0 0x7f1a0419b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.298+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 >> 172.21.15.52:0/3712703853 conn(0x7f1a04050170 msgr2=0x7f1a0404d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.298+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 shutdown_connections 2024-04-25T13:16:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.298+0000 7f1a13459640 1 -- 172.21.15.52:0/3712703853 wait complete. 2024-04-25T13:16:41.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-04-25T13:16:41.305 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:41.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-04-25T13:16:41.310 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:41.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.326+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7feb20005580 con 0x7feb380cc3b0 2024-04-25T13:16:41.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.326+0000 7feb2effd640 1 -- 172.21.15.52:0/272983993 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb2805cd10 con 0x7feb380cc3b0 2024-04-25T13:16:41.327 INFO:teuthology.orchestra.run.smithi052.stdout:55834574859 2024-04-25T13:16:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.328+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7feb1c06c940 msgr2=0x7feb1c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.328+0000 7feb40423640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7feb1c06c940 0x7feb1c06ee00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb34009630 tx=0x7feb3402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.328+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb380cc3b0 msgr2=0x7feb38158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.328+0000 7feb40423640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb380cc3b0 0x7feb38158cb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feb2800c7b0 tx=0x7feb2800cc70 comp rx=0 tx=0).stop 2024-04-25T13:16:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.328+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 shutdown_connections 2024-04-25T13:16:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.328+0000 7feb40423640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7feb1c06c940 0x7feb1c06ee00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.328+0000 7feb40423640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb381551b0 0x7feb381591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.328+0000 7feb40423640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb380cc3b0 0x7feb38158cb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.328+0000 7feb40423640 1 --2- 172.21.15.52:0/272983993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3806d480 0x7feb381597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.328+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 >> 172.21.15.52:0/272983993 conn(0x7feb38073300 msgr2=0x7feb380c6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.329+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 shutdown_connections 2024-04-25T13:16:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.329+0000 7feb40423640 1 -- 172.21.15.52:0/272983993 wait complete. 2024-04-25T13:16:41.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-04-25T13:16:41.340 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:41.340 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T13:16:41.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:16:41.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.480+0000 7fdea4336640 1 Processor -- start 2024-04-25T13:16:41.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.480+0000 7fdea4336640 1 -- start start 2024-04-25T13:16:41.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.481+0000 7fdea4336640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde9c06bb90 0x7fde9c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.481+0000 7fdea4336640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde9c06bf70 0x7fde9c15ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.481+0000 7fdea4336640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fde9c0c99f0 0x7fde9c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.481+0000 7fdea4336640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fde9c15bef0 con 0x7fde9c06bf70 2024-04-25T13:16:41.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.481+0000 7fdea4336640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fde9c15b650 con 0x7fde9c0c99f0 2024-04-25T13:16:41.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.481+0000 7fdea4336640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fde9c15b930 con 0x7fde9c06bb90 2024-04-25T13:16:41.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.481+0000 7fdea18d1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde9c06bf70 0x7fde9c15ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.481+0000 7fdea18d1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde9c06bf70 0x7fde9c15ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55296/0 (socket says 172.21.15.52:55296) 2024-04-25T13:16:41.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.481+0000 7fdea18d1640 1 -- 172.21.15.52:0/641576883 learned_addr learned my addr 172.21.15.52:0/641576883 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:41.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.482+0000 7fdea28d3640 1 --2- 172.21.15.52:0/641576883 >> v2:172.21.15.102:3300/0 conn(0x7fde9c0c99f0 0x7fde9c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.482+0000 7fdea20d2640 1 --2- 172.21.15.52:0/641576883 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde9c06bb90 0x7fde9c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.482+0000 7fdea18d1640 1 -- 172.21.15.52:0/641576883 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde9c06bb90 msgr2=0x7fde9c15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:41.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.482+0000 7fdea18d1640 1 --2- 172.21.15.52:0/641576883 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde9c06bb90 0x7fde9c15af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.482+0000 7fdea18d1640 1 -- 172.21.15.52:0/641576883 >> v2:172.21.15.102:3300/0 conn(0x7fde9c0c99f0 msgr2=0x7fde9c0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:41.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.482+0000 7fdea18d1640 1 --2- 172.21.15.52:0/641576883 >> v2:172.21.15.102:3300/0 conn(0x7fde9c0c99f0 0x7fde9c0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.482+0000 7fdea18d1640 1 -- 172.21.15.52:0/641576883 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c15bc10 con 0x7fde9c06bf70 2024-04-25T13:16:41.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.482+0000 7fdea18d1640 1 --2- 172.21.15.52:0/641576883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c06bf70 0x7fde9c15ee00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0cc240 tx=0x7fde9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5cde8d24be2de1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:41.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.483+0000 7fdea10d0640 1 -- 172.21.15.52:0/641576883 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98037070 con 0x7fde9c06bf70 2024-04-25T13:16:41.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.483+0000 7fdea10d0640 1 -- 172.21.15.52:0/641576883 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde98032440 con 0x7fde9c06bf70 2024-04-25T13:16:41.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.483+0000 7fdea10d0640 1 -- 172.21.15.52:0/641576883 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98032810 con 0x7fde9c06bf70 2024-04-25T13:16:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.483+0000 7fdea4336640 1 -- 172.21.15.52:0/641576883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c06bf70 msgr2=0x7fde9c15ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.483+0000 7fdea4336640 1 --2- 172.21.15.52:0/641576883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c06bf70 0x7fde9c15ee00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0cc240 tx=0x7fde9802a270 comp rx=0 tx=0).stop 2024-04-25T13:16:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.483+0000 7fdea4336640 1 -- 172.21.15.52:0/641576883 shutdown_connections 2024-04-25T13:16:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.483+0000 7fdea4336640 1 --2- 172.21.15.52:0/641576883 >> v2:172.21.15.102:3300/0 conn(0x7fde9c0c99f0 0x7fde9c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.483+0000 7fdea4336640 1 --2- 172.21.15.52:0/641576883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c06bf70 0x7fde9c15ee00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.483+0000 7fdea4336640 1 --2- 172.21.15.52:0/641576883 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde9c06bb90 0x7fde9c15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.483+0000 7fdea4336640 1 -- 172.21.15.52:0/641576883 >> 172.21.15.52:0/641576883 conn(0x7fde9c074d50 msgr2=0x7fde9c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.483+0000 7fdea4336640 1 -- 172.21.15.52:0/641576883 shutdown_connections 2024-04-25T13:16:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.483+0000 7fdea4336640 1 -- 172.21.15.52:0/641576883 wait complete. 2024-04-25T13:16:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.484+0000 7fdea4336640 1 Processor -- start 2024-04-25T13:16:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.484+0000 7fdea4336640 1 -- start start 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.485+0000 7fdea4336640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde9c06bb90 0x7fde9c1f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.485+0000 7fdea4336640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde9c06bf70 0x7fde9c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.485+0000 7fdea4336640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0c99f0 0x7fde9c1f0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.485+0000 7fdea4336640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c074560 con 0x7fde9c0c99f0 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.485+0000 7fdea4336640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c15e8e0 con 0x7fde9c06bf70 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.485+0000 7fdea4336640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fde9c15f340 con 0x7fde9c06bb90 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.485+0000 7fdea28d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0c99f0 0x7fde9c1f0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.485+0000 7fdea28d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0c99f0 0x7fde9c1f0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55302/0 (socket says 172.21.15.52:55302) 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.485+0000 7fdea28d3640 1 -- 172.21.15.52:0/1891695792 learned_addr learned my addr 172.21.15.52:0/1891695792 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.485+0000 7fdea20d2640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde9c06bb90 0x7fde9c1f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.485+0000 7fdea18d1640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde9c06bf70 0x7fde9c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.486+0000 7fdea28d3640 1 -- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde9c06bb90 msgr2=0x7fde9c1f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.486+0000 7fdea28d3640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde9c06bb90 0x7fde9c1f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.486+0000 7fdea28d3640 1 -- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde9c06bf70 msgr2=0x7fde9c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.486+0000 7fdea28d3640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde9c06bf70 0x7fde9c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.486+0000 7fdea28d3640 1 -- 172.21.15.52:0/1891695792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c0cd6d0 con 0x7fde9c0c99f0 2024-04-25T13:16:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.486+0000 7fdea28d3640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0c99f0 0x7fde9c1f0dd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fde94007e70 tx=0x7fde9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.486+0000 7fde92ffd640 1 -- 172.21.15.52:0/1891695792 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94014620 con 0x7fde9c0c99f0 2024-04-25T13:16:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.486+0000 7fde92ffd640 1 -- 172.21.15.52:0/1891695792 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde94019070 con 0x7fde9c0c99f0 2024-04-25T13:16:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.486+0000 7fde92ffd640 1 -- 172.21.15.52:0/1891695792 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94014a20 con 0x7fde9c0c99f0 2024-04-25T13:16:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.486+0000 7fdea4336640 1 -- 172.21.15.52:0/1891695792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9c0cf180 con 0x7fde9c0c99f0 2024-04-25T13:16:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.486+0000 7fdea4336640 1 -- 172.21.15.52:0/1891695792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde9c0ce8e0 con 0x7fde9c0c99f0 2024-04-25T13:16:41.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.487+0000 7fdea4336640 1 -- 172.21.15.52:0/1891695792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde9c068e40 con 0x7fde9c0c99f0 2024-04-25T13:16:41.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.488+0000 7fde92ffd640 1 -- 172.21.15.52:0/1891695792 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde94014bc0 con 0x7fde9c0c99f0 2024-04-25T13:16:41.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.488+0000 7fde92ffd640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fde8006c920 0x7fde8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.488+0000 7fde92ffd640 1 -- 172.21.15.52:0/1891695792 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fde9408c5c0 con 0x7fde9c0c99f0 2024-04-25T13:16:41.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.489+0000 7fdea20d2640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fde8006c920 0x7fde8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.489+0000 7fdea20d2640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fde8006c920 0x7fde8006ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0079a0 tx=0x7fde8c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:41.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.493+0000 7fde92ffd640 1 -- 172.21.15.52:0/1891695792 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde9c0cd6d0 con 0x7fde9c0c99f0 2024-04-25T13:16:41.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.678+0000 7fdea4336640 1 -- 172.21.15.52:0/1891695792 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde9c14b960 con 0x7fde8006c920 2024-04-25T13:16:41.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.687+0000 7fde92ffd640 1 -- 172.21.15.52:0/1891695792 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7fde9c14b960 con 0x7fde8006c920 2024-04-25T13:16:41.690 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:41.692 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T13:16:41.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.690+0000 7fdea4336640 1 -- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fde8006c920 msgr2=0x7fde8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.690+0000 7fdea4336640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fde8006c920 0x7fde8006ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0079a0 tx=0x7fde8c008040 comp rx=0 tx=0).stop 2024-04-25T13:16:41.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.690+0000 7fdea4336640 1 -- 172.21.15.52:0/1891695792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0c99f0 msgr2=0x7fde9c1f0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.690+0000 7fdea4336640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0c99f0 0x7fde9c1f0dd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fde94007e70 tx=0x7fde9400e4b0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.690+0000 7fdea4336640 1 -- 172.21.15.52:0/1891695792 shutdown_connections 2024-04-25T13:16:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.690+0000 7fdea4336640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fde8006c920 0x7fde8006ede0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.690+0000 7fdea4336640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0c99f0 0x7fde9c1f0dd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.690+0000 7fdea4336640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde9c06bf70 0x7fde9c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.690+0000 7fdea4336640 1 --2- 172.21.15.52:0/1891695792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde9c06bb90 0x7fde9c1f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.690+0000 7fdea4336640 1 -- 172.21.15.52:0/1891695792 >> 172.21.15.52:0/1891695792 conn(0x7fde9c074d50 msgr2=0x7fde9c153570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.690+0000 7fdea4336640 1 -- 172.21.15.52:0/1891695792 shutdown_connections 2024-04-25T13:16:41.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.690+0000 7fdea4336640 1 -- 172.21.15.52:0/1891695792 wait complete. 2024-04-25T13:16:41.701 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-25T13:16:39.826401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236124,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738596,"statfs":{"total":773094113280,"available":772852322304,"internally_reserved":0,"allocated":3383296,"data_stored":2049160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003052"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090521+0000","last_change":"2024-04-25T13:16:07.001071+0000","last_active":"2024-04-25T13:16:14.090521+0000","last_peered":"2024-04-25T13:16:14.090521+0000","last_clean":"2024-04-25T13:16:14.090521+0000","last_became_active":"2024-04-25T13:16:07.000746+0000","last_became_peered":"2024-04-25T13:16:07.000746+0000","last_unstale":"2024-04-25T13:16:14.090521+0000","last_undegraded":"2024-04-25T13:16:14.090521+0000","last_fullsized":"2024-04-25T13:16:14.090521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:36.289103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025658+0000","last_change":"2024-04-25T13:16:08.012928+0000","last_active":"2024-04-25T13:16:14.025658+0000","last_peered":"2024-04-25T13:16:14.025658+0000","last_clean":"2024-04-25T13:16:14.025658+0000","last_became_active":"2024-04-25T13:16:08.012114+0000","last_became_peered":"2024-04-25T13:16:08.012114+0000","last_unstale":"2024-04-25T13:16:14.025658+0000","last_undegraded":"2024-04-25T13:16:14.025658+0000","last_fullsized":"2024-04-25T13:16:14.025658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:01.077922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025013+0000","last_change":"2024-04-25T13:16:12.734829+0000","last_active":"2024-04-25T13:16:14.025013+0000","last_peered":"2024-04-25T13:16:14.025013+0000","last_clean":"2024-04-25T13:16:14.025013+0000","last_became_active":"2024-04-25T13:16:12.734390+0000","last_became_peered":"2024-04-25T13:16:12.734390+0000","last_unstale":"2024-04-25T13:16:14.025013+0000","last_undegraded":"2024-04-25T13:16:14.025013+0000","last_fullsized":"2024-04-25T13:16:14.025013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:33.941883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025802+0000","last_change":"2024-04-25T13:16:06.999440+0000","last_active":"2024-04-25T13:16:14.025802+0000","last_peered":"2024-04-25T13:16:14.025802+0000","last_clean":"2024-04-25T13:16:14.025802+0000","last_became_active":"2024-04-25T13:16:06.999078+0000","last_became_peered":"2024-04-25T13:16:06.999078+0000","last_unstale":"2024-04-25T13:16:14.025802+0000","last_undegraded":"2024-04-25T13:16:14.025802+0000","last_fullsized":"2024-04-25T13:16:14.025802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.819349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090243+0000","last_change":"2024-04-25T13:16:08.012743+0000","last_active":"2024-04-25T13:16:14.090243+0000","last_peered":"2024-04-25T13:16:14.090243+0000","last_clean":"2024-04-25T13:16:14.090243+0000","last_became_active":"2024-04-25T13:16:08.012036+0000","last_became_peered":"2024-04-25T13:16:08.012036+0000","last_unstale":"2024-04-25T13:16:14.090243+0000","last_undegraded":"2024-04-25T13:16:14.090243+0000","last_fullsized":"2024-04-25T13:16:14.090243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.959146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091482+0000","last_change":"2024-04-25T13:16:12.038266+0000","last_active":"2024-04-25T13:16:14.091482+0000","last_peered":"2024-04-25T13:16:14.091482+0000","last_clean":"2024-04-25T13:16:14.091482+0000","last_became_active":"2024-04-25T13:16:12.037796+0000","last_became_peered":"2024-04-25T13:16:12.037796+0000","last_unstale":"2024-04-25T13:16:14.091482+0000","last_undegraded":"2024-04-25T13:16:14.091482+0000","last_fullsized":"2024-04-25T13:16:14.091482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:44.953964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092596+0000","last_change":"2024-04-25T13:16:07.001022+0000","last_active":"2024-04-25T13:16:14.092596+0000","last_peered":"2024-04-25T13:16:14.092596+0000","last_clean":"2024-04-25T13:16:14.092596+0000","last_became_active":"2024-04-25T13:16:07.000751+0000","last_became_peered":"2024-04-25T13:16:07.000751+0000","last_unstale":"2024-04-25T13:16:14.092596+0000","last_undegraded":"2024-04-25T13:16:14.092596+0000","last_fullsized":"2024-04-25T13:16:14.092596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:11.597397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025512+0000","last_change":"2024-04-25T13:16:08.011361+0000","last_active":"2024-04-25T13:16:14.025512+0000","last_peered":"2024-04-25T13:16:14.025512+0000","last_clean":"2024-04-25T13:16:14.025512+0000","last_became_active":"2024-04-25T13:16:08.011073+0000","last_became_peered":"2024-04-25T13:16:08.011073+0000","last_unstale":"2024-04-25T13:16:14.025512+0000","last_undegraded":"2024-04-25T13:16:14.025512+0000","last_fullsized":"2024-04-25T13:16:14.025512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:00.471410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091957+0000","last_change":"2024-04-25T13:16:12.043732+0000","last_active":"2024-04-25T13:16:14.091957+0000","last_peered":"2024-04-25T13:16:14.091957+0000","last_clean":"2024-04-25T13:16:14.091957+0000","last_became_active":"2024-04-25T13:16:12.043264+0000","last_became_peered":"2024-04-25T13:16:12.043264+0000","last_unstale":"2024-04-25T13:16:14.091957+0000","last_undegraded":"2024-04-25T13:16:14.091957+0000","last_fullsized":"2024-04-25T13:16:14.091957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:39.974518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092358+0000","last_change":"2024-04-25T13:16:07.003774+0000","last_active":"2024-04-25T13:16:14.092358+0000","last_peered":"2024-04-25T13:16:14.092358+0000","last_clean":"2024-04-25T13:16:14.092358+0000","last_became_active":"2024-04-25T13:16:07.003493+0000","last_became_peered":"2024-04-25T13:16:07.003493+0000","last_unstale":"2024-04-25T13:16:14.092358+0000","last_undegraded":"2024-04-25T13:16:14.092358+0000","last_fullsized":"2024-04-25T13:16:14.092358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:12.940812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025735+0000","last_change":"2024-04-25T13:16:08.012084+0000","last_active":"2024-04-25T13:16:14.025735+0000","last_peered":"2024-04-25T13:16:14.025735+0000","last_clean":"2024-04-25T13:16:14.025735+0000","last_became_active":"2024-04-25T13:16:08.011634+0000","last_became_peered":"2024-04-25T13:16:08.011634+0000","last_unstale":"2024-04-25T13:16:14.025735+0000","last_undegraded":"2024-04-25T13:16:14.025735+0000","last_fullsized":"2024-04-25T13:16:14.025735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:26.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091223+0000","last_change":"2024-04-25T13:16:12.039238+0000","last_active":"2024-04-25T13:16:14.091223+0000","last_peered":"2024-04-25T13:16:14.091223+0000","last_clean":"2024-04-25T13:16:14.091223+0000","last_became_active":"2024-04-25T13:16:12.038508+0000","last_became_peered":"2024-04-25T13:16:12.038508+0000","last_unstale":"2024-04-25T13:16:14.091223+0000","last_undegraded":"2024-04-25T13:16:14.091223+0000","last_fullsized":"2024-04-25T13:16:14.091223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:22.183373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090787+0000","last_change":"2024-04-25T13:16:08.007741+0000","last_active":"2024-04-25T13:16:14.090787+0000","last_peered":"2024-04-25T13:16:14.090787+0000","last_clean":"2024-04-25T13:16:14.090787+0000","last_became_active":"2024-04-25T13:16:08.007478+0000","last_became_peered":"2024-04-25T13:16:08.007478+0000","last_unstale":"2024-04-25T13:16:14.090787+0000","last_undegraded":"2024-04-25T13:16:14.090787+0000","last_fullsized":"2024-04-25T13:16:14.090787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:49.162203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091567+0000","last_change":"2024-04-25T13:16:07.001183+0000","last_active":"2024-04-25T13:16:14.091567+0000","last_peered":"2024-04-25T13:16:14.091567+0000","last_clean":"2024-04-25T13:16:14.091567+0000","last_became_active":"2024-04-25T13:16:07.000880+0000","last_became_peered":"2024-04-25T13:16:07.000880+0000","last_unstale":"2024-04-25T13:16:14.091567+0000","last_undegraded":"2024-04-25T13:16:14.091567+0000","last_fullsized":"2024-04-25T13:16:14.091567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.250349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091408+0000","last_change":"2024-04-25T13:16:12.037074+0000","last_active":"2024-04-25T13:16:14.091408+0000","last_peered":"2024-04-25T13:16:14.091408+0000","last_clean":"2024-04-25T13:16:14.091408+0000","last_became_active":"2024-04-25T13:16:12.036508+0000","last_became_peered":"2024-04-25T13:16:12.036508+0000","last_unstale":"2024-04-25T13:16:14.091408+0000","last_undegraded":"2024-04-25T13:16:14.091408+0000","last_fullsized":"2024-04-25T13:16:14.091408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:01.380469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025437+0000","last_change":"2024-04-25T13:16:08.013538+0000","last_active":"2024-04-25T13:16:14.025437+0000","last_peered":"2024-04-25T13:16:14.025437+0000","last_clean":"2024-04-25T13:16:14.025437+0000","last_became_active":"2024-04-25T13:16:08.013269+0000","last_became_peered":"2024-04-25T13:16:08.013269+0000","last_unstale":"2024-04-25T13:16:14.025437+0000","last_undegraded":"2024-04-25T13:16:14.025437+0000","last_fullsized":"2024-04-25T13:16:14.025437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:05.313768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022116+0000","last_change":"2024-04-25T13:16:06.994106+0000","last_active":"2024-04-25T13:16:14.022116+0000","last_peered":"2024-04-25T13:16:14.022116+0000","last_clean":"2024-04-25T13:16:14.022116+0000","last_became_active":"2024-04-25T13:16:06.993807+0000","last_became_peered":"2024-04-25T13:16:06.993807+0000","last_unstale":"2024-04-25T13:16:14.022116+0000","last_undegraded":"2024-04-25T13:16:14.022116+0000","last_fullsized":"2024-04-25T13:16:14.022116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:53.706175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091111+0000","last_change":"2024-04-25T13:16:12.039421+0000","last_active":"2024-04-25T13:16:14.091111+0000","last_peered":"2024-04-25T13:16:14.091111+0000","last_clean":"2024-04-25T13:16:14.091111+0000","last_became_active":"2024-04-25T13:16:12.038953+0000","last_became_peered":"2024-04-25T13:16:12.038953+0000","last_unstale":"2024-04-25T13:16:14.091111+0000","last_undegraded":"2024-04-25T13:16:14.091111+0000","last_fullsized":"2024-04-25T13:16:14.091111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:26.714224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025194+0000","last_change":"2024-04-25T13:16:08.008978+0000","last_active":"2024-04-25T13:16:14.025194+0000","last_peered":"2024-04-25T13:16:14.025194+0000","last_clean":"2024-04-25T13:16:14.025194+0000","last_became_active":"2024-04-25T13:16:08.008446+0000","last_became_peered":"2024-04-25T13:16:08.008446+0000","last_unstale":"2024-04-25T13:16:14.025194+0000","last_undegraded":"2024-04-25T13:16:14.025194+0000","last_fullsized":"2024-04-25T13:16:14.025194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:34.604344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021762+0000","last_change":"2024-04-25T13:16:06.992902+0000","last_active":"2024-04-25T13:16:14.021762+0000","last_peered":"2024-04-25T13:16:14.021762+0000","last_clean":"2024-04-25T13:16:14.021762+0000","last_became_active":"2024-04-25T13:16:06.992593+0000","last_became_peered":"2024-04-25T13:16:06.992593+0000","last_unstale":"2024-04-25T13:16:14.021762+0000","last_undegraded":"2024-04-25T13:16:14.021762+0000","last_fullsized":"2024-04-25T13:16:14.021762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:57.665455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022580+0000","last_change":"2024-04-25T13:16:12.735412+0000","last_active":"2024-04-25T13:16:14.022580+0000","last_peered":"2024-04-25T13:16:14.022580+0000","last_clean":"2024-04-25T13:16:14.022580+0000","last_became_active":"2024-04-25T13:16:12.733485+0000","last_became_peered":"2024-04-25T13:16:12.733485+0000","last_unstale":"2024-04-25T13:16:14.022580+0000","last_undegraded":"2024-04-25T13:16:14.022580+0000","last_fullsized":"2024-04-25T13:16:14.022580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:25.265696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092136+0000","last_change":"2024-04-25T13:16:07.998941+0000","last_active":"2024-04-25T13:16:14.092136+0000","last_peered":"2024-04-25T13:16:14.092136+0000","last_clean":"2024-04-25T13:16:14.092136+0000","last_became_active":"2024-04-25T13:16:07.998658+0000","last_became_peered":"2024-04-25T13:16:07.998658+0000","last_unstale":"2024-04-25T13:16:14.092136+0000","last_undegraded":"2024-04-25T13:16:14.092136+0000","last_fullsized":"2024-04-25T13:16:14.092136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:45.473269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090361+0000","last_change":"2024-04-25T13:16:07.001542+0000","last_active":"2024-04-25T13:16:14.090361+0000","last_peered":"2024-04-25T13:16:14.090361+0000","last_clean":"2024-04-25T13:16:14.090361+0000","last_became_active":"2024-04-25T13:16:07.000846+0000","last_became_peered":"2024-04-25T13:16:07.000846+0000","last_unstale":"2024-04-25T13:16:14.090361+0000","last_undegraded":"2024-04-25T13:16:14.090361+0000","last_fullsized":"2024-04-25T13:16:14.090361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:41.121978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091648+0000","last_change":"2024-04-25T13:16:12.038493+0000","last_active":"2024-04-25T13:16:14.091648+0000","last_peered":"2024-04-25T13:16:14.091648+0000","last_clean":"2024-04-25T13:16:14.091648+0000","last_became_active":"2024-04-25T13:16:12.038032+0000","last_became_peered":"2024-04-25T13:16:12.038032+0000","last_unstale":"2024-04-25T13:16:14.091648+0000","last_undegraded":"2024-04-25T13:16:14.091648+0000","last_fullsized":"2024-04-25T13:16:14.091648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:40.222480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090898+0000","last_change":"2024-04-25T13:16:07.998444+0000","last_active":"2024-04-25T13:16:14.090898+0000","last_peered":"2024-04-25T13:16:14.090898+0000","last_clean":"2024-04-25T13:16:14.090898+0000","last_became_active":"2024-04-25T13:16:07.998037+0000","last_became_peered":"2024-04-25T13:16:07.998037+0000","last_unstale":"2024-04-25T13:16:14.090898+0000","last_undegraded":"2024-04-25T13:16:14.090898+0000","last_fullsized":"2024-04-25T13:16:14.090898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:35.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091994+0000","last_change":"2024-04-25T13:16:06.995706+0000","last_active":"2024-04-25T13:16:14.091994+0000","last_peered":"2024-04-25T13:16:14.091994+0000","last_clean":"2024-04-25T13:16:14.091994+0000","last_became_active":"2024-04-25T13:16:06.995420+0000","last_became_peered":"2024-04-25T13:16:06.995420+0000","last_unstale":"2024-04-25T13:16:14.091994+0000","last_undegraded":"2024-04-25T13:16:14.091994+0000","last_fullsized":"2024-04-25T13:16:14.091994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:08.672949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091752+0000","last_change":"2024-04-25T13:16:12.734165+0000","last_active":"2024-04-25T13:16:14.091752+0000","last_peered":"2024-04-25T13:16:14.091752+0000","last_clean":"2024-04-25T13:16:14.091752+0000","last_became_active":"2024-04-25T13:16:12.733772+0000","last_became_peered":"2024-04-25T13:16:12.733772+0000","last_unstale":"2024-04-25T13:16:14.091752+0000","last_undegraded":"2024-04-25T13:16:14.091752+0000","last_fullsized":"2024-04-25T13:16:14.091752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:35.716517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025960+0000","last_change":"2024-04-25T13:16:08.017429+0000","last_active":"2024-04-25T13:16:14.025960+0000","last_peered":"2024-04-25T13:16:14.025960+0000","last_clean":"2024-04-25T13:16:14.025960+0000","last_became_active":"2024-04-25T13:16:08.017205+0000","last_became_peered":"2024-04-25T13:16:08.017205+0000","last_unstale":"2024-04-25T13:16:14.025960+0000","last_undegraded":"2024-04-25T13:16:14.025960+0000","last_fullsized":"2024-04-25T13:16:14.025960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.383669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022539+0000","last_change":"2024-04-25T13:16:06.992063+0000","last_active":"2024-04-25T13:16:14.022539+0000","last_peered":"2024-04-25T13:16:14.022539+0000","last_clean":"2024-04-25T13:16:14.022539+0000","last_became_active":"2024-04-25T13:16:06.991766+0000","last_became_peered":"2024-04-25T13:16:06.991766+0000","last_unstale":"2024-04-25T13:16:14.022539+0000","last_undegraded":"2024-04-25T13:16:14.022539+0000","last_fullsized":"2024-04-25T13:16:14.022539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:25.728063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.024950+0000","last_change":"2024-04-25T13:16:12.734837+0000","last_active":"2024-04-25T13:16:14.024950+0000","last_peered":"2024-04-25T13:16:14.024950+0000","last_clean":"2024-04-25T13:16:14.024950+0000","last_became_active":"2024-04-25T13:16:12.734394+0000","last_became_peered":"2024-04-25T13:16:12.734394+0000","last_unstale":"2024-04-25T13:16:14.024950+0000","last_undegraded":"2024-04-25T13:16:14.024950+0000","last_fullsized":"2024-04-25T13:16:14.024950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:24.740929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022045+0000","last_change":"2024-04-25T13:16:08.000277+0000","last_active":"2024-04-25T13:16:14.022045+0000","last_peered":"2024-04-25T13:16:14.022045+0000","last_clean":"2024-04-25T13:16:14.022045+0000","last_became_active":"2024-04-25T13:16:07.999797+0000","last_became_peered":"2024-04-25T13:16:07.999797+0000","last_unstale":"2024-04-25T13:16:14.022045+0000","last_undegraded":"2024-04-25T13:16:14.022045+0000","last_fullsized":"2024-04-25T13:16:14.022045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:08.860755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092740+0000","last_change":"2024-04-25T13:16:07.002146+0000","last_active":"2024-04-25T13:16:14.092740+0000","last_peered":"2024-04-25T13:16:14.092740+0000","last_clean":"2024-04-25T13:16:14.092740+0000","last_became_active":"2024-04-25T13:16:07.001918+0000","last_became_peered":"2024-04-25T13:16:07.001918+0000","last_unstale":"2024-04-25T13:16:14.092740+0000","last_undegraded":"2024-04-25T13:16:14.092740+0000","last_fullsized":"2024-04-25T13:16:14.092740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:38.326719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090806+0000","last_change":"2024-04-25T13:16:12.733744+0000","last_active":"2024-04-25T13:16:14.090806+0000","last_peered":"2024-04-25T13:16:14.090806+0000","last_clean":"2024-04-25T13:16:14.090806+0000","last_became_active":"2024-04-25T13:16:12.733361+0000","last_became_peered":"2024-04-25T13:16:12.733361+0000","last_unstale":"2024-04-25T13:16:14.090806+0000","last_undegraded":"2024-04-25T13:16:14.090806+0000","last_fullsized":"2024-04-25T13:16:14.090806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:39.178837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025844+0000","last_change":"2024-04-25T13:16:08.016667+0000","last_active":"2024-04-25T13:16:14.025844+0000","last_peered":"2024-04-25T13:16:14.025844+0000","last_clean":"2024-04-25T13:16:14.025844+0000","last_became_active":"2024-04-25T13:16:08.015172+0000","last_became_peered":"2024-04-25T13:16:08.015172+0000","last_unstale":"2024-04-25T13:16:14.025844+0000","last_undegraded":"2024-04-25T13:16:14.025844+0000","last_fullsized":"2024-04-25T13:16:14.025844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:40.786954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022161+0000","last_change":"2024-04-25T13:16:06.996301+0000","last_active":"2024-04-25T13:16:14.022161+0000","last_peered":"2024-04-25T13:16:14.022161+0000","last_clean":"2024-04-25T13:16:14.022161+0000","last_became_active":"2024-04-25T13:16:06.995957+0000","last_became_peered":"2024-04-25T13:16:06.995957+0000","last_unstale":"2024-04-25T13:16:14.022161+0000","last_undegraded":"2024-04-25T13:16:14.022161+0000","last_fullsized":"2024-04-25T13:16:14.022161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:16.802775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021893+0000","last_change":"2024-04-25T13:16:12.040987+0000","last_active":"2024-04-25T13:16:14.021893+0000","last_peered":"2024-04-25T13:16:14.021893+0000","last_clean":"2024-04-25T13:16:14.021893+0000","last_became_active":"2024-04-25T13:16:12.039987+0000","last_became_peered":"2024-04-25T13:16:12.039987+0000","last_unstale":"2024-04-25T13:16:14.021893+0000","last_undegraded":"2024-04-25T13:16:14.021893+0000","last_fullsized":"2024-04-25T13:16:14.021893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:40.366718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092137+0000","last_change":"2024-04-25T13:16:08.002876+0000","last_active":"2024-04-25T13:16:14.092137+0000","last_peered":"2024-04-25T13:16:14.092137+0000","last_clean":"2024-04-25T13:16:14.092137+0000","last_became_active":"2024-04-25T13:16:08.002131+0000","last_became_peered":"2024-04-25T13:16:08.002131+0000","last_unstale":"2024-04-25T13:16:14.092137+0000","last_undegraded":"2024-04-25T13:16:14.092137+0000","last_fullsized":"2024-04-25T13:16:14.092137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:09.646849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.026081+0000","last_change":"2024-04-25T13:16:06.990075+0000","last_active":"2024-04-25T13:16:14.026081+0000","last_peered":"2024-04-25T13:16:14.026081+0000","last_clean":"2024-04-25T13:16:14.026081+0000","last_became_active":"2024-04-25T13:16:06.989652+0000","last_became_peered":"2024-04-25T13:16:06.989652+0000","last_unstale":"2024-04-25T13:16:14.026081+0000","last_undegraded":"2024-04-25T13:16:14.026081+0000","last_fullsized":"2024-04-25T13:16:14.026081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:29.378995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022100+0000","last_change":"2024-04-25T13:16:12.032906+0000","last_active":"2024-04-25T13:16:14.022100+0000","last_peered":"2024-04-25T13:16:14.022100+0000","last_clean":"2024-04-25T13:16:14.022100+0000","last_became_active":"2024-04-25T13:16:12.032184+0000","last_became_peered":"2024-04-25T13:16:12.032184+0000","last_unstale":"2024-04-25T13:16:14.022100+0000","last_undegraded":"2024-04-25T13:16:14.022100+0000","last_fullsized":"2024-04-25T13:16:14.022100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.724927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021878+0000","last_change":"2024-04-25T13:16:07.997173+0000","last_active":"2024-04-25T13:16:14.021878+0000","last_peered":"2024-04-25T13:16:14.021878+0000","last_clean":"2024-04-25T13:16:14.021878+0000","last_became_active":"2024-04-25T13:16:07.996545+0000","last_became_peered":"2024-04-25T13:16:07.996545+0000","last_unstale":"2024-04-25T13:16:14.021878+0000","last_undegraded":"2024-04-25T13:16:14.021878+0000","last_fullsized":"2024-04-25T13:16:14.021878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:28.902563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089861+0000","last_change":"2024-04-25T13:16:06.993674+0000","last_active":"2024-04-25T13:16:14.089861+0000","last_peered":"2024-04-25T13:16:14.089861+0000","last_clean":"2024-04-25T13:16:14.089861+0000","last_became_active":"2024-04-25T13:16:06.993387+0000","last_became_peered":"2024-04-25T13:16:06.993387+0000","last_unstale":"2024-04-25T13:16:14.089861+0000","last_undegraded":"2024-04-25T13:16:14.089861+0000","last_fullsized":"2024-04-25T13:16:14.089861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:13.104822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022616+0000","last_change":"2024-04-25T13:16:12.037015+0000","last_active":"2024-04-25T13:16:14.022616+0000","last_peered":"2024-04-25T13:16:14.022616+0000","last_clean":"2024-04-25T13:16:14.022616+0000","last_became_active":"2024-04-25T13:16:12.036634+0000","last_became_peered":"2024-04-25T13:16:12.036634+0000","last_unstale":"2024-04-25T13:16:14.022616+0000","last_undegraded":"2024-04-25T13:16:14.022616+0000","last_fullsized":"2024-04-25T13:16:14.022616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:12.986396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090465+0000","last_change":"2024-04-25T13:16:08.004209+0000","last_active":"2024-04-25T13:16:14.090465+0000","last_peered":"2024-04-25T13:16:14.090465+0000","last_clean":"2024-04-25T13:16:14.090465+0000","last_became_active":"2024-04-25T13:16:08.003908+0000","last_became_peered":"2024-04-25T13:16:08.003908+0000","last_unstale":"2024-04-25T13:16:14.090465+0000","last_undegraded":"2024-04-25T13:16:14.090465+0000","last_fullsized":"2024-04-25T13:16:14.090465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:17.027888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090460+0000","last_change":"2024-04-25T13:16:06.999384+0000","last_active":"2024-04-25T13:16:14.090460+0000","last_peered":"2024-04-25T13:16:14.090460+0000","last_clean":"2024-04-25T13:16:14.090460+0000","last_became_active":"2024-04-25T13:16:06.999126+0000","last_became_peered":"2024-04-25T13:16:06.999126+0000","last_unstale":"2024-04-25T13:16:14.090460+0000","last_undegraded":"2024-04-25T13:16:14.090460+0000","last_fullsized":"2024-04-25T13:16:14.090460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:50.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090826+0000","last_change":"2024-04-25T13:16:12.733992+0000","last_active":"2024-04-25T13:16:14.090826+0000","last_peered":"2024-04-25T13:16:14.090826+0000","last_clean":"2024-04-25T13:16:14.090826+0000","last_became_active":"2024-04-25T13:16:12.733316+0000","last_became_peered":"2024-04-25T13:16:12.733316+0000","last_unstale":"2024-04-25T13:16:14.090826+0000","last_undegraded":"2024-04-25T13:16:14.090826+0000","last_fullsized":"2024-04-25T13:16:14.090826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:54.246728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025262+0000","last_change":"2024-04-25T13:16:08.021617+0000","last_active":"2024-04-25T13:16:14.025262+0000","last_peered":"2024-04-25T13:16:14.025262+0000","last_clean":"2024-04-25T13:16:14.025262+0000","last_became_active":"2024-04-25T13:16:08.021346+0000","last_became_peered":"2024-04-25T13:16:08.021346+0000","last_unstale":"2024-04-25T13:16:14.025262+0000","last_undegraded":"2024-04-25T13:16:14.025262+0000","last_fullsized":"2024-04-25T13:16:14.025262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:10.013805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025437+0000","last_change":"2024-04-25T13:16:06.990638+0000","last_active":"2024-04-25T13:16:14.025437+0000","last_peered":"2024-04-25T13:16:14.025437+0000","last_clean":"2024-04-25T13:16:14.025437+0000","last_became_active":"2024-04-25T13:16:06.990379+0000","last_became_peered":"2024-04-25T13:16:06.990379+0000","last_unstale":"2024-04-25T13:16:14.025437+0000","last_undegraded":"2024-04-25T13:16:14.025437+0000","last_fullsized":"2024-04-25T13:16:14.025437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:39.385990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090466+0000","last_change":"2024-04-25T13:15:57.168598+0000","last_active":"2024-04-25T13:16:14.090466+0000","last_peered":"2024-04-25T13:16:14.090466+0000","last_clean":"2024-04-25T13:16:14.090466+0000","last_became_active":"2024-04-25T13:15:57.167692+0000","last_became_peered":"2024-04-25T13:15:57.167692+0000","last_unstale":"2024-04-25T13:16:14.090466+0000","last_undegraded":"2024-04-25T13:16:14.090466+0000","last_fullsized":"2024-04-25T13:16:14.090466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_clean_scrub_stamp":"2024-04-25T13:15:55.844647+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:29.123100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091126+0000","last_change":"2024-04-25T13:16:12.734712+0000","last_active":"2024-04-25T13:16:14.091126+0000","last_peered":"2024-04-25T13:16:14.091126+0000","last_clean":"2024-04-25T13:16:14.091126+0000","last_became_active":"2024-04-25T13:16:12.734288+0000","last_became_peered":"2024-04-25T13:16:12.734288+0000","last_unstale":"2024-04-25T13:16:14.091126+0000","last_undegraded":"2024-04-25T13:16:14.091126+0000","last_fullsized":"2024-04-25T13:16:14.091126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:45.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092489+0000","last_change":"2024-04-25T13:16:08.014279+0000","last_active":"2024-04-25T13:16:14.092489+0000","last_peered":"2024-04-25T13:16:14.092489+0000","last_clean":"2024-04-25T13:16:14.092489+0000","last_became_active":"2024-04-25T13:16:08.013989+0000","last_became_peered":"2024-04-25T13:16:08.013989+0000","last_unstale":"2024-04-25T13:16:14.092489+0000","last_undegraded":"2024-04-25T13:16:14.092489+0000","last_fullsized":"2024-04-25T13:16:14.092489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:54.411981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090165+0000","last_change":"2024-04-25T13:16:06.996774+0000","last_active":"2024-04-25T13:16:14.090165+0000","last_peered":"2024-04-25T13:16:14.090165+0000","last_clean":"2024-04-25T13:16:14.090165+0000","last_became_active":"2024-04-25T13:16:06.996251+0000","last_became_peered":"2024-04-25T13:16:06.996251+0000","last_unstale":"2024-04-25T13:16:14.090165+0000","last_undegraded":"2024-04-25T13:16:14.090165+0000","last_fullsized":"2024-04-25T13:16:14.090165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:01.815602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090885+0000","last_change":"2024-04-25T13:16:12.733562+0000","last_active":"2024-04-25T13:16:14.090885+0000","last_peered":"2024-04-25T13:16:14.090885+0000","last_clean":"2024-04-25T13:16:14.090885+0000","last_became_active":"2024-04-25T13:16:12.733114+0000","last_became_peered":"2024-04-25T13:16:12.733114+0000","last_unstale":"2024-04-25T13:16:14.090885+0000","last_undegraded":"2024-04-25T13:16:14.090885+0000","last_fullsized":"2024-04-25T13:16:14.090885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:20.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025577+0000","last_change":"2024-04-25T13:16:08.011389+0000","last_active":"2024-04-25T13:16:14.025577+0000","last_peered":"2024-04-25T13:16:14.025577+0000","last_clean":"2024-04-25T13:16:14.025577+0000","last_became_active":"2024-04-25T13:16:08.011113+0000","last_became_peered":"2024-04-25T13:16:08.011113+0000","last_unstale":"2024-04-25T13:16:14.025577+0000","last_undegraded":"2024-04-25T13:16:14.025577+0000","last_fullsized":"2024-04-25T13:16:14.025577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:12.339487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022376+0000","last_change":"2024-04-25T13:16:06.988988+0000","last_active":"2024-04-25T13:16:14.022376+0000","last_peered":"2024-04-25T13:16:14.022376+0000","last_clean":"2024-04-25T13:16:14.022376+0000","last_became_active":"2024-04-25T13:16:06.988631+0000","last_became_peered":"2024-04-25T13:16:06.988631+0000","last_unstale":"2024-04-25T13:16:14.022376+0000","last_undegraded":"2024-04-25T13:16:14.022376+0000","last_fullsized":"2024-04-25T13:16:14.022376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:47.056977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090922+0000","last_change":"2024-04-25T13:16:12.047194+0000","last_active":"2024-04-25T13:16:14.090922+0000","last_peered":"2024-04-25T13:16:14.090922+0000","last_clean":"2024-04-25T13:16:14.090922+0000","last_became_active":"2024-04-25T13:16:12.046780+0000","last_became_peered":"2024-04-25T13:16:12.046780+0000","last_unstale":"2024-04-25T13:16:14.090922+0000","last_undegraded":"2024-04-25T13:16:14.090922+0000","last_fullsized":"2024-04-25T13:16:14.090922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:41.664409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092850+0000","last_change":"2024-04-25T13:16:08.007925+0000","last_active":"2024-04-25T13:16:14.092850+0000","last_peered":"2024-04-25T13:16:14.092850+0000","last_clean":"2024-04-25T13:16:14.092850+0000","last_became_active":"2024-04-25T13:16:08.007681+0000","last_became_peered":"2024-04-25T13:16:08.007681+0000","last_unstale":"2024-04-25T13:16:14.092850+0000","last_undegraded":"2024-04-25T13:16:14.092850+0000","last_fullsized":"2024-04-25T13:16:14.092850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:29.601564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090519+0000","last_change":"2024-04-25T13:16:06.991912+0000","last_active":"2024-04-25T13:16:14.090519+0000","last_peered":"2024-04-25T13:16:14.090519+0000","last_clean":"2024-04-25T13:16:14.090519+0000","last_became_active":"2024-04-25T13:16:06.991578+0000","last_became_peered":"2024-04-25T13:16:06.991578+0000","last_unstale":"2024-04-25T13:16:14.090519+0000","last_undegraded":"2024-04-25T13:16:14.090519+0000","last_fullsized":"2024-04-25T13:16:14.090519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:59.364396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025152+0000","last_change":"2024-04-25T13:16:12.733567+0000","last_active":"2024-04-25T13:16:14.025152+0000","last_peered":"2024-04-25T13:16:14.025152+0000","last_clean":"2024-04-25T13:16:14.025152+0000","last_became_active":"2024-04-25T13:16:12.733136+0000","last_became_peered":"2024-04-25T13:16:12.733136+0000","last_unstale":"2024-04-25T13:16:14.025152+0000","last_undegraded":"2024-04-25T13:16:14.025152+0000","last_fullsized":"2024-04-25T13:16:14.025152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:29.125928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092741+0000","last_change":"2024-04-25T13:16:08.004897+0000","last_active":"2024-04-25T13:16:14.092741+0000","last_peered":"2024-04-25T13:16:14.092741+0000","last_clean":"2024-04-25T13:16:14.092741+0000","last_became_active":"2024-04-25T13:16:08.004180+0000","last_became_peered":"2024-04-25T13:16:08.004180+0000","last_unstale":"2024-04-25T13:16:14.092741+0000","last_undegraded":"2024-04-25T13:16:14.092741+0000","last_fullsized":"2024-04-25T13:16:14.092741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:12.011447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090973+0000","last_change":"2024-04-25T13:16:06.994487+0000","last_active":"2024-04-25T13:16:14.090973+0000","last_peered":"2024-04-25T13:16:14.090973+0000","last_clean":"2024-04-25T13:16:14.090973+0000","last_became_active":"2024-04-25T13:16:06.994235+0000","last_became_peered":"2024-04-25T13:16:06.994235+0000","last_unstale":"2024-04-25T13:16:14.090973+0000","last_undegraded":"2024-04-25T13:16:14.090973+0000","last_fullsized":"2024-04-25T13:16:14.090973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091573+0000","last_change":"2024-04-25T13:16:12.039277+0000","last_active":"2024-04-25T13:16:14.091573+0000","last_peered":"2024-04-25T13:16:14.091573+0000","last_clean":"2024-04-25T13:16:14.091573+0000","last_became_active":"2024-04-25T13:16:12.038534+0000","last_became_peered":"2024-04-25T13:16:12.038534+0000","last_unstale":"2024-04-25T13:16:14.091573+0000","last_undegraded":"2024-04-25T13:16:14.091573+0000","last_fullsized":"2024-04-25T13:16:14.091573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:59.495976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090745+0000","last_change":"2024-04-25T13:16:08.007302+0000","last_active":"2024-04-25T13:16:14.090745+0000","last_peered":"2024-04-25T13:16:14.090745+0000","last_clean":"2024-04-25T13:16:14.090745+0000","last_became_active":"2024-04-25T13:16:08.007050+0000","last_became_peered":"2024-04-25T13:16:08.007050+0000","last_unstale":"2024-04-25T13:16:14.090745+0000","last_undegraded":"2024-04-25T13:16:14.090745+0000","last_fullsized":"2024-04-25T13:16:14.090745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:35.369188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089708+0000","last_change":"2024-04-25T13:16:06.982609+0000","last_active":"2024-04-25T13:16:14.089708+0000","last_peered":"2024-04-25T13:16:14.089708+0000","last_clean":"2024-04-25T13:16:14.089708+0000","last_became_active":"2024-04-25T13:16:06.982320+0000","last_became_peered":"2024-04-25T13:16:06.982320+0000","last_unstale":"2024-04-25T13:16:14.089708+0000","last_undegraded":"2024-04-25T13:16:14.089708+0000","last_fullsized":"2024-04-25T13:16:14.089708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:55.372968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090845+0000","last_change":"2024-04-25T13:16:12.043657+0000","last_active":"2024-04-25T13:16:14.090845+0000","last_peered":"2024-04-25T13:16:14.090845+0000","last_clean":"2024-04-25T13:16:14.090845+0000","last_became_active":"2024-04-25T13:16:12.042902+0000","last_became_peered":"2024-04-25T13:16:12.042902+0000","last_unstale":"2024-04-25T13:16:14.090845+0000","last_undegraded":"2024-04-25T13:16:14.090845+0000","last_fullsized":"2024-04-25T13:16:14.090845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:46.721199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090854+0000","last_change":"2024-04-25T13:16:08.008534+0000","last_active":"2024-04-25T13:16:14.090854+0000","last_peered":"2024-04-25T13:16:14.090854+0000","last_clean":"2024-04-25T13:16:14.090854+0000","last_became_active":"2024-04-25T13:16:08.008102+0000","last_became_peered":"2024-04-25T13:16:08.008102+0000","last_unstale":"2024-04-25T13:16:14.090854+0000","last_undegraded":"2024-04-25T13:16:14.090854+0000","last_fullsized":"2024-04-25T13:16:14.090854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:48.331724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091187+0000","last_change":"2024-04-25T13:16:06.993292+0000","last_active":"2024-04-25T13:16:14.091187+0000","last_peered":"2024-04-25T13:16:14.091187+0000","last_clean":"2024-04-25T13:16:14.091187+0000","last_became_active":"2024-04-25T13:16:06.993008+0000","last_became_peered":"2024-04-25T13:16:06.993008+0000","last_unstale":"2024-04-25T13:16:14.091187+0000","last_undegraded":"2024-04-25T13:16:14.091187+0000","last_fullsized":"2024-04-25T13:16:14.091187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025971+0000","last_change":"2024-04-25T13:16:12.733945+0000","last_active":"2024-04-25T13:16:14.025971+0000","last_peered":"2024-04-25T13:16:14.025971+0000","last_clean":"2024-04-25T13:16:14.025971+0000","last_became_active":"2024-04-25T13:16:12.733359+0000","last_became_peered":"2024-04-25T13:16:12.733359+0000","last_unstale":"2024-04-25T13:16:14.025971+0000","last_undegraded":"2024-04-25T13:16:14.025971+0000","last_fullsized":"2024-04-25T13:16:14.025971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:27.352613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091472+0000","last_change":"2024-04-25T13:16:08.008034+0000","last_active":"2024-04-25T13:16:14.091472+0000","last_peered":"2024-04-25T13:16:14.091472+0000","last_clean":"2024-04-25T13:16:14.091472+0000","last_became_active":"2024-04-25T13:16:08.007790+0000","last_became_peered":"2024-04-25T13:16:08.007790+0000","last_unstale":"2024-04-25T13:16:14.091472+0000","last_undegraded":"2024-04-25T13:16:14.091472+0000","last_fullsized":"2024-04-25T13:16:14.091472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:35.903237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.026057+0000","last_change":"2024-04-25T13:16:06.996737+0000","last_active":"2024-04-25T13:16:14.026057+0000","last_peered":"2024-04-25T13:16:14.026057+0000","last_clean":"2024-04-25T13:16:14.026057+0000","last_became_active":"2024-04-25T13:16:06.996439+0000","last_became_peered":"2024-04-25T13:16:06.996439+0000","last_unstale":"2024-04-25T13:16:14.026057+0000","last_undegraded":"2024-04-25T13:16:14.026057+0000","last_fullsized":"2024-04-25T13:16:14.026057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:36.400030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025695+0000","last_change":"2024-04-25T13:16:12.734393+0000","last_active":"2024-04-25T13:16:14.025695+0000","last_peered":"2024-04-25T13:16:14.025695+0000","last_clean":"2024-04-25T13:16:14.025695+0000","last_became_active":"2024-04-25T13:16:12.733328+0000","last_became_peered":"2024-04-25T13:16:12.733328+0000","last_unstale":"2024-04-25T13:16:14.025695+0000","last_undegraded":"2024-04-25T13:16:14.025695+0000","last_fullsized":"2024-04-25T13:16:14.025695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.254012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090600+0000","last_change":"2024-04-25T13:16:08.000836+0000","last_active":"2024-04-25T13:16:14.090600+0000","last_peered":"2024-04-25T13:16:14.090600+0000","last_clean":"2024-04-25T13:16:14.090600+0000","last_became_active":"2024-04-25T13:16:08.000538+0000","last_became_peered":"2024-04-25T13:16:08.000538+0000","last_unstale":"2024-04-25T13:16:14.090600+0000","last_undegraded":"2024-04-25T13:16:14.090600+0000","last_fullsized":"2024-04-25T13:16:14.090600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:08.742353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090969+0000","last_change":"2024-04-25T13:16:07.000559+0000","last_active":"2024-04-25T13:16:14.090969+0000","last_peered":"2024-04-25T13:16:14.090969+0000","last_clean":"2024-04-25T13:16:14.090969+0000","last_became_active":"2024-04-25T13:16:07.000243+0000","last_became_peered":"2024-04-25T13:16:07.000243+0000","last_unstale":"2024-04-25T13:16:14.090969+0000","last_undegraded":"2024-04-25T13:16:14.090969+0000","last_fullsized":"2024-04-25T13:16:14.090969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:01.672221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025845+0000","last_change":"2024-04-25T13:16:12.733681+0000","last_active":"2024-04-25T13:16:14.025845+0000","last_peered":"2024-04-25T13:16:14.025845+0000","last_clean":"2024-04-25T13:16:14.025845+0000","last_became_active":"2024-04-25T13:16:12.733245+0000","last_became_peered":"2024-04-25T13:16:12.733245+0000","last_unstale":"2024-04-25T13:16:14.025845+0000","last_undegraded":"2024-04-25T13:16:14.025845+0000","last_fullsized":"2024-04-25T13:16:14.025845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.028858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092399+0000","last_change":"2024-04-25T13:16:08.008790+0000","last_active":"2024-04-25T13:16:14.092399+0000","last_peered":"2024-04-25T13:16:14.092399+0000","last_clean":"2024-04-25T13:16:14.092399+0000","last_became_active":"2024-04-25T13:16:08.008530+0000","last_became_peered":"2024-04-25T13:16:08.008530+0000","last_unstale":"2024-04-25T13:16:14.092399+0000","last_undegraded":"2024-04-25T13:16:14.092399+0000","last_fullsized":"2024-04-25T13:16:14.092399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:44.215930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:21.051524+0000","last_change":"2024-04-25T13:16:06.997575+0000","last_active":"2024-04-25T13:16:21.051524+0000","last_peered":"2024-04-25T13:16:21.051524+0000","last_clean":"2024-04-25T13:16:21.051524+0000","last_became_active":"2024-04-25T13:16:06.997289+0000","last_became_peered":"2024-04-25T13:16:06.997289+0000","last_unstale":"2024-04-25T13:16:21.051524+0000","last_undegraded":"2024-04-25T13:16:21.051524+0000","last_fullsized":"2024-04-25T13:16:21.051524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:54.096662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021968+0000","last_change":"2024-04-25T13:16:12.040456+0000","last_active":"2024-04-25T13:16:14.021968+0000","last_peered":"2024-04-25T13:16:14.021968+0000","last_clean":"2024-04-25T13:16:14.021968+0000","last_became_active":"2024-04-25T13:16:12.039443+0000","last_became_peered":"2024-04-25T13:16:12.039443+0000","last_unstale":"2024-04-25T13:16:14.021968+0000","last_undegraded":"2024-04-25T13:16:14.021968+0000","last_fullsized":"2024-04-25T13:16:14.021968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:23.192500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091569+0000","last_change":"2024-04-25T13:16:08.004618+0000","last_active":"2024-04-25T13:16:14.091569+0000","last_peered":"2024-04-25T13:16:14.091569+0000","last_clean":"2024-04-25T13:16:14.091569+0000","last_became_active":"2024-04-25T13:16:08.002583+0000","last_became_peered":"2024-04-25T13:16:08.002583+0000","last_unstale":"2024-04-25T13:16:14.091569+0000","last_undegraded":"2024-04-25T13:16:14.091569+0000","last_fullsized":"2024-04-25T13:16:14.091569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:25.609409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022349+0000","last_change":"2024-04-25T13:16:06.996610+0000","last_active":"2024-04-25T13:16:14.022349+0000","last_peered":"2024-04-25T13:16:14.022349+0000","last_clean":"2024-04-25T13:16:14.022349+0000","last_became_active":"2024-04-25T13:16:06.995616+0000","last_became_peered":"2024-04-25T13:16:06.995616+0000","last_unstale":"2024-04-25T13:16:14.022349+0000","last_undegraded":"2024-04-25T13:16:14.022349+0000","last_fullsized":"2024-04-25T13:16:14.022349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:21.135053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092179+0000","last_change":"2024-04-25T13:16:12.043744+0000","last_active":"2024-04-25T13:16:14.092179+0000","last_peered":"2024-04-25T13:16:14.092179+0000","last_clean":"2024-04-25T13:16:14.092179+0000","last_became_active":"2024-04-25T13:16:12.043267+0000","last_became_peered":"2024-04-25T13:16:12.043267+0000","last_unstale":"2024-04-25T13:16:14.092179+0000","last_undegraded":"2024-04-25T13:16:14.092179+0000","last_fullsized":"2024-04-25T13:16:14.092179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:52.316751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090426+0000","last_change":"2024-04-25T13:16:08.012359+0000","last_active":"2024-04-25T13:16:14.090426+0000","last_peered":"2024-04-25T13:16:14.090426+0000","last_clean":"2024-04-25T13:16:14.090426+0000","last_became_active":"2024-04-25T13:16:08.011295+0000","last_became_peered":"2024-04-25T13:16:08.011295+0000","last_unstale":"2024-04-25T13:16:14.090426+0000","last_undegraded":"2024-04-25T13:16:14.090426+0000","last_fullsized":"2024-04-25T13:16:14.090426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:19.939444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025352+0000","last_change":"2024-04-25T13:16:06.997061+0000","last_active":"2024-04-25T13:16:14.025352+0000","last_peered":"2024-04-25T13:16:14.025352+0000","last_clean":"2024-04-25T13:16:14.025352+0000","last_became_active":"2024-04-25T13:16:06.996418+0000","last_became_peered":"2024-04-25T13:16:06.996418+0000","last_unstale":"2024-04-25T13:16:14.025352+0000","last_undegraded":"2024-04-25T13:16:14.025352+0000","last_fullsized":"2024-04-25T13:16:14.025352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:34.878260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025141+0000","last_change":"2024-04-25T13:16:12.042796+0000","last_active":"2024-04-25T13:16:14.025141+0000","last_peered":"2024-04-25T13:16:14.025141+0000","last_clean":"2024-04-25T13:16:14.025141+0000","last_became_active":"2024-04-25T13:16:12.042252+0000","last_became_peered":"2024-04-25T13:16:12.042252+0000","last_unstale":"2024-04-25T13:16:14.025141+0000","last_undegraded":"2024-04-25T13:16:14.025141+0000","last_fullsized":"2024-04-25T13:16:14.025141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:51.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025295+0000","last_change":"2024-04-25T13:16:08.016203+0000","last_active":"2024-04-25T13:16:14.025295+0000","last_peered":"2024-04-25T13:16:14.025295+0000","last_clean":"2024-04-25T13:16:14.025295+0000","last_became_active":"2024-04-25T13:16:08.015820+0000","last_became_peered":"2024-04-25T13:16:08.015820+0000","last_unstale":"2024-04-25T13:16:14.025295+0000","last_undegraded":"2024-04-25T13:16:14.025295+0000","last_fullsized":"2024-04-25T13:16:14.025295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091794+0000","last_change":"2024-04-25T13:16:06.996624+0000","last_active":"2024-04-25T13:16:14.091794+0000","last_peered":"2024-04-25T13:16:14.091794+0000","last_clean":"2024-04-25T13:16:14.091794+0000","last_became_active":"2024-04-25T13:16:06.996373+0000","last_became_peered":"2024-04-25T13:16:06.996373+0000","last_unstale":"2024-04-25T13:16:14.091794+0000","last_undegraded":"2024-04-25T13:16:14.091794+0000","last_fullsized":"2024-04-25T13:16:14.091794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:29.929030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025097+0000","last_change":"2024-04-25T13:16:12.733792+0000","last_active":"2024-04-25T13:16:14.025097+0000","last_peered":"2024-04-25T13:16:14.025097+0000","last_clean":"2024-04-25T13:16:14.025097+0000","last_became_active":"2024-04-25T13:16:12.733314+0000","last_became_peered":"2024-04-25T13:16:12.733314+0000","last_unstale":"2024-04-25T13:16:14.025097+0000","last_undegraded":"2024-04-25T13:16:14.025097+0000","last_fullsized":"2024-04-25T13:16:14.025097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.836368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090737+0000","last_change":"2024-04-25T13:16:12.734573+0000","last_active":"2024-04-25T13:16:14.090737+0000","last_peered":"2024-04-25T13:16:14.090737+0000","last_clean":"2024-04-25T13:16:14.090737+0000","last_became_active":"2024-04-25T13:16:12.733908+0000","last_became_peered":"2024-04-25T13:16:12.733908+0000","last_unstale":"2024-04-25T13:16:14.090737+0000","last_undegraded":"2024-04-25T13:16:14.090737+0000","last_fullsized":"2024-04-25T13:16:14.090737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:59.673528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021648+0000","last_change":"2024-04-25T13:16:08.008915+0000","last_active":"2024-04-25T13:16:14.021648+0000","last_peered":"2024-04-25T13:16:14.021648+0000","last_clean":"2024-04-25T13:16:14.021648+0000","last_became_active":"2024-04-25T13:16:08.008586+0000","last_became_peered":"2024-04-25T13:16:08.008586+0000","last_unstale":"2024-04-25T13:16:14.021648+0000","last_undegraded":"2024-04-25T13:16:14.021648+0000","last_fullsized":"2024-04-25T13:16:14.021648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:46.905065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025297+0000","last_change":"2024-04-25T13:16:06.994489+0000","last_active":"2024-04-25T13:16:14.025297+0000","last_peered":"2024-04-25T13:16:14.025297+0000","last_clean":"2024-04-25T13:16:14.025297+0000","last_became_active":"2024-04-25T13:16:06.994005+0000","last_became_peered":"2024-04-25T13:16:06.994005+0000","last_unstale":"2024-04-25T13:16:14.025297+0000","last_undegraded":"2024-04-25T13:16:14.025297+0000","last_fullsized":"2024-04-25T13:16:14.025297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:43.921452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091678+0000","last_change":"2024-04-25T13:16:12.037008+0000","last_active":"2024-04-25T13:16:14.091678+0000","last_peered":"2024-04-25T13:16:14.091678+0000","last_clean":"2024-04-25T13:16:14.091678+0000","last_became_active":"2024-04-25T13:16:12.036569+0000","last_became_peered":"2024-04-25T13:16:12.036569+0000","last_unstale":"2024-04-25T13:16:14.091678+0000","last_undegraded":"2024-04-25T13:16:14.091678+0000","last_fullsized":"2024-04-25T13:16:14.091678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:48.224913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025108+0000","last_change":"2024-04-25T13:16:08.008747+0000","last_active":"2024-04-25T13:16:14.025108+0000","last_peered":"2024-04-25T13:16:14.025108+0000","last_clean":"2024-04-25T13:16:14.025108+0000","last_became_active":"2024-04-25T13:16:08.008078+0000","last_became_peered":"2024-04-25T13:16:08.008078+0000","last_unstale":"2024-04-25T13:16:14.025108+0000","last_undegraded":"2024-04-25T13:16:14.025108+0000","last_fullsized":"2024-04-25T13:16:14.025108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:19.590099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025230+0000","last_change":"2024-04-25T13:16:06.997642+0000","last_active":"2024-04-25T13:16:14.025230+0000","last_peered":"2024-04-25T13:16:14.025230+0000","last_clean":"2024-04-25T13:16:14.025230+0000","last_became_active":"2024-04-25T13:16:06.996985+0000","last_became_peered":"2024-04-25T13:16:06.996985+0000","last_unstale":"2024-04-25T13:16:14.025230+0000","last_undegraded":"2024-04-25T13:16:14.025230+0000","last_fullsized":"2024-04-25T13:16:14.025230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:49.853125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091049+0000","last_change":"2024-04-25T13:16:06.992687+0000","last_active":"2024-04-25T13:16:14.091049+0000","last_peered":"2024-04-25T13:16:14.091049+0000","last_clean":"2024-04-25T13:16:14.091049+0000","last_became_active":"2024-04-25T13:16:06.992407+0000","last_became_peered":"2024-04-25T13:16:06.992407+0000","last_unstale":"2024-04-25T13:16:14.091049+0000","last_undegraded":"2024-04-25T13:16:14.091049+0000","last_fullsized":"2024-04-25T13:16:14.091049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:37.658458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090948+0000","last_change":"2024-04-25T13:16:08.004510+0000","last_active":"2024-04-25T13:16:14.090948+0000","last_peered":"2024-04-25T13:16:14.090948+0000","last_clean":"2024-04-25T13:16:14.090948+0000","last_became_active":"2024-04-25T13:16:08.003959+0000","last_became_peered":"2024-04-25T13:16:08.003959+0000","last_unstale":"2024-04-25T13:16:14.090948+0000","last_undegraded":"2024-04-25T13:16:14.090948+0000","last_fullsized":"2024-04-25T13:16:14.090948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:45.142873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089967+0000","last_change":"2024-04-25T13:16:12.037097+0000","last_active":"2024-04-25T13:16:14.089967+0000","last_peered":"2024-04-25T13:16:14.089967+0000","last_clean":"2024-04-25T13:16:14.089967+0000","last_became_active":"2024-04-25T13:16:12.036651+0000","last_became_peered":"2024-04-25T13:16:12.036651+0000","last_unstale":"2024-04-25T13:16:14.089967+0000","last_undegraded":"2024-04-25T13:16:14.089967+0000","last_fullsized":"2024-04-25T13:16:14.089967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:34.443514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025481+0000","last_change":"2024-04-25T13:16:06.996311+0000","last_active":"2024-04-25T13:16:14.025481+0000","last_peered":"2024-04-25T13:16:14.025481+0000","last_clean":"2024-04-25T13:16:14.025481+0000","last_became_active":"2024-04-25T13:16:06.996010+0000","last_became_peered":"2024-04-25T13:16:06.996010+0000","last_unstale":"2024-04-25T13:16:14.025481+0000","last_undegraded":"2024-04-25T13:16:14.025481+0000","last_fullsized":"2024-04-25T13:16:14.025481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:08.835482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091724+0000","last_change":"2024-04-25T13:16:08.002159+0000","last_active":"2024-04-25T13:16:14.091724+0000","last_peered":"2024-04-25T13:16:14.091724+0000","last_clean":"2024-04-25T13:16:14.091724+0000","last_became_active":"2024-04-25T13:16:08.001833+0000","last_became_peered":"2024-04-25T13:16:08.001833+0000","last_unstale":"2024-04-25T13:16:14.091724+0000","last_undegraded":"2024-04-25T13:16:14.091724+0000","last_fullsized":"2024-04-25T13:16:14.091724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:25.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025768+0000","last_change":"2024-04-25T13:16:12.042721+0000","last_active":"2024-04-25T13:16:14.025768+0000","last_peered":"2024-04-25T13:16:14.025768+0000","last_clean":"2024-04-25T13:16:14.025768+0000","last_became_active":"2024-04-25T13:16:12.042000+0000","last_became_peered":"2024-04-25T13:16:12.042000+0000","last_unstale":"2024-04-25T13:16:14.025768+0000","last_undegraded":"2024-04-25T13:16:14.025768+0000","last_fullsized":"2024-04-25T13:16:14.025768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:18.702032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090639+0000","last_change":"2024-04-25T13:16:08.008364+0000","last_active":"2024-04-25T13:16:14.090639+0000","last_peered":"2024-04-25T13:16:14.090639+0000","last_clean":"2024-04-25T13:16:14.090639+0000","last_became_active":"2024-04-25T13:16:08.007728+0000","last_became_peered":"2024-04-25T13:16:08.007728+0000","last_unstale":"2024-04-25T13:16:14.090639+0000","last_undegraded":"2024-04-25T13:16:14.090639+0000","last_fullsized":"2024-04-25T13:16:14.090639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:08.731178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089766+0000","last_change":"2024-04-25T13:16:08.011273+0000","last_active":"2024-04-25T13:16:14.089766+0000","last_peered":"2024-04-25T13:16:14.089766+0000","last_clean":"2024-04-25T13:16:14.089766+0000","last_became_active":"2024-04-25T13:16:08.010981+0000","last_became_peered":"2024-04-25T13:16:08.010981+0000","last_unstale":"2024-04-25T13:16:14.089766+0000","last_undegraded":"2024-04-25T13:16:14.089766+0000","last_fullsized":"2024-04-25T13:16:14.089766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:03.835422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025994+0000","last_change":"2024-04-25T13:16:08.016413+0000","last_active":"2024-04-25T13:16:14.025994+0000","last_peered":"2024-04-25T13:16:14.025994+0000","last_clean":"2024-04-25T13:16:14.025994+0000","last_became_active":"2024-04-25T13:16:08.016084+0000","last_became_peered":"2024-04-25T13:16:08.016084+0000","last_unstale":"2024-04-25T13:16:14.025994+0000","last_undegraded":"2024-04-25T13:16:14.025994+0000","last_fullsized":"2024-04-25T13:16:14.025994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:41.014999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090856+0000","last_change":"2024-04-25T13:16:08.008543+0000","last_active":"2024-04-25T13:16:14.090856+0000","last_peered":"2024-04-25T13:16:14.090856+0000","last_clean":"2024-04-25T13:16:14.090856+0000","last_became_active":"2024-04-25T13:16:08.008255+0000","last_became_peered":"2024-04-25T13:16:08.008255+0000","last_unstale":"2024-04-25T13:16:14.090856+0000","last_undegraded":"2024-04-25T13:16:14.090856+0000","last_fullsized":"2024-04-25T13:16:14.090856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:47.981446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025776+0000","last_change":"2024-04-25T13:16:08.012814+0000","last_active":"2024-04-25T13:16:14.025776+0000","last_peered":"2024-04-25T13:16:14.025776+0000","last_clean":"2024-04-25T13:16:14.025776+0000","last_became_active":"2024-04-25T13:16:08.012481+0000","last_became_peered":"2024-04-25T13:16:08.012481+0000","last_unstale":"2024-04-25T13:16:14.025776+0000","last_undegraded":"2024-04-25T13:16:14.025776+0000","last_fullsized":"2024-04-25T13:16:14.025776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:05.409701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021983+0000","last_change":"2024-04-25T13:16:08.008843+0000","last_active":"2024-04-25T13:16:14.021983+0000","last_peered":"2024-04-25T13:16:14.021983+0000","last_clean":"2024-04-25T13:16:14.021983+0000","last_became_active":"2024-04-25T13:16:08.008489+0000","last_became_peered":"2024-04-25T13:16:08.008489+0000","last_unstale":"2024-04-25T13:16:14.021983+0000","last_undegraded":"2024-04-25T13:16:14.021983+0000","last_fullsized":"2024-04-25T13:16:14.021983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:35.740816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092076+0000","last_change":"2024-04-25T13:16:08.008121+0000","last_active":"2024-04-25T13:16:14.092076+0000","last_peered":"2024-04-25T13:16:14.092076+0000","last_clean":"2024-04-25T13:16:14.092076+0000","last_became_active":"2024-04-25T13:16:08.007727+0000","last_became_peered":"2024-04-25T13:16:08.007727+0000","last_unstale":"2024-04-25T13:16:14.092076+0000","last_undegraded":"2024-04-25T13:16:14.092076+0000","last_fullsized":"2024-04-25T13:16:14.092076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:11.193610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025864+0000","last_change":"2024-04-25T13:16:08.014997+0000","last_active":"2024-04-25T13:16:14.025864+0000","last_peered":"2024-04-25T13:16:14.025864+0000","last_clean":"2024-04-25T13:16:14.025864+0000","last_became_active":"2024-04-25T13:16:08.014579+0000","last_became_peered":"2024-04-25T13:16:08.014579+0000","last_unstale":"2024-04-25T13:16:14.025864+0000","last_undegraded":"2024-04-25T13:16:14.025864+0000","last_fullsized":"2024-04-25T13:16:14.025864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:07.884249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025224+0000","last_change":"2024-04-25T13:16:08.015379+0000","last_active":"2024-04-25T13:16:14.025224+0000","last_peered":"2024-04-25T13:16:14.025224+0000","last_clean":"2024-04-25T13:16:14.025224+0000","last_became_active":"2024-04-25T13:16:08.014693+0000","last_became_peered":"2024-04-25T13:16:08.014693+0000","last_unstale":"2024-04-25T13:16:14.025224+0000","last_undegraded":"2024-04-25T13:16:14.025224+0000","last_fullsized":"2024-04-25T13:16:14.025224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:41.305358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025156+0000","last_change":"2024-04-25T13:16:08.014873+0000","last_active":"2024-04-25T13:16:14.025156+0000","last_peered":"2024-04-25T13:16:14.025156+0000","last_clean":"2024-04-25T13:16:14.025156+0000","last_became_active":"2024-04-25T13:16:08.014575+0000","last_became_peered":"2024-04-25T13:16:08.014575+0000","last_unstale":"2024-04-25T13:16:14.025156+0000","last_undegraded":"2024-04-25T13:16:14.025156+0000","last_fullsized":"2024-04-25T13:16:14.025156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:41.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025900+0000","last_change":"2024-04-25T13:16:08.016992+0000","last_active":"2024-04-25T13:16:14.025900+0000","last_peered":"2024-04-25T13:16:14.025900+0000","last_clean":"2024-04-25T13:16:14.025900+0000","last_became_active":"2024-04-25T13:16:08.016499+0000","last_became_peered":"2024-04-25T13:16:08.016499+0000","last_unstale":"2024-04-25T13:16:14.025900+0000","last_undegraded":"2024-04-25T13:16:14.025900+0000","last_fullsized":"2024-04-25T13:16:14.025900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:47.275363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090726+0000","last_change":"2024-04-25T13:16:08.000447+0000","last_active":"2024-04-25T13:16:14.090726+0000","last_peered":"2024-04-25T13:16:14.090726+0000","last_clean":"2024-04-25T13:16:14.090726+0000","last_became_active":"2024-04-25T13:16:08.000102+0000","last_became_peered":"2024-04-25T13:16:08.000102+0000","last_unstale":"2024-04-25T13:16:14.090726+0000","last_undegraded":"2024-04-25T13:16:14.090726+0000","last_fullsized":"2024-04-25T13:16:14.090726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:30.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092034+0000","last_change":"2024-04-25T13:16:08.008437+0000","last_active":"2024-04-25T13:16:14.092034+0000","last_peered":"2024-04-25T13:16:14.092034+0000","last_clean":"2024-04-25T13:16:14.092034+0000","last_became_active":"2024-04-25T13:16:08.008173+0000","last_became_peered":"2024-04-25T13:16:08.008173+0000","last_unstale":"2024-04-25T13:16:14.092034+0000","last_undegraded":"2024-04-25T13:16:14.092034+0000","last_fullsized":"2024-04-25T13:16:14.092034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:54.362757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092640+0000","last_change":"2024-04-25T13:16:08.004689+0000","last_active":"2024-04-25T13:16:14.092640+0000","last_peered":"2024-04-25T13:16:14.092640+0000","last_clean":"2024-04-25T13:16:14.092640+0000","last_became_active":"2024-04-25T13:16:08.004340+0000","last_became_peered":"2024-04-25T13:16:08.004340+0000","last_unstale":"2024-04-25T13:16:14.092640+0000","last_undegraded":"2024-04-25T13:16:14.092640+0000","last_fullsized":"2024-04-25T13:16:14.092640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:18.870731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090426+0000","last_change":"2024-04-25T13:16:08.005344+0000","last_active":"2024-04-25T13:16:14.090426+0000","last_peered":"2024-04-25T13:16:14.090426+0000","last_clean":"2024-04-25T13:16:14.090426+0000","last_became_active":"2024-04-25T13:16:08.005041+0000","last_became_peered":"2024-04-25T13:16:08.005041+0000","last_unstale":"2024-04-25T13:16:14.090426+0000","last_undegraded":"2024-04-25T13:16:14.090426+0000","last_fullsized":"2024-04-25T13:16:14.090426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.389800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025849+0000","last_change":"2024-04-25T13:16:08.010203+0000","last_active":"2024-04-25T13:16:14.025849+0000","last_peered":"2024-04-25T13:16:14.025849+0000","last_clean":"2024-04-25T13:16:14.025849+0000","last_became_active":"2024-04-25T13:16:08.009922+0000","last_became_peered":"2024-04-25T13:16:08.009922+0000","last_unstale":"2024-04-25T13:16:14.025849+0000","last_undegraded":"2024-04-25T13:16:14.025849+0000","last_fullsized":"2024-04-25T13:16:14.025849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:06.831797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025079+0000","last_change":"2024-04-25T13:16:08.012737+0000","last_active":"2024-04-25T13:16:14.025079+0000","last_peered":"2024-04-25T13:16:14.025079+0000","last_clean":"2024-04-25T13:16:14.025079+0000","last_became_active":"2024-04-25T13:16:08.012472+0000","last_became_peered":"2024-04-25T13:16:08.012472+0000","last_unstale":"2024-04-25T13:16:14.025079+0000","last_undegraded":"2024-04-25T13:16:14.025079+0000","last_fullsized":"2024-04-25T13:16:14.025079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:36.880757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021729+0000","last_change":"2024-04-25T13:16:08.007177+0000","last_active":"2024-04-25T13:16:14.021729+0000","last_peered":"2024-04-25T13:16:14.021729+0000","last_clean":"2024-04-25T13:16:14.021729+0000","last_became_active":"2024-04-25T13:16:08.006866+0000","last_became_peered":"2024-04-25T13:16:08.006866+0000","last_unstale":"2024-04-25T13:16:14.021729+0000","last_undegraded":"2024-04-25T13:16:14.021729+0000","last_fullsized":"2024-04-25T13:16:14.021729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:16.707771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090599+0000","last_change":"2024-04-25T13:16:07.999761+0000","last_active":"2024-04-25T13:16:14.090599+0000","last_peered":"2024-04-25T13:16:14.090599+0000","last_clean":"2024-04-25T13:16:14.090599+0000","last_became_active":"2024-04-25T13:16:07.999033+0000","last_became_peered":"2024-04-25T13:16:07.999033+0000","last_unstale":"2024-04-25T13:16:14.090599+0000","last_undegraded":"2024-04-25T13:16:14.090599+0000","last_fullsized":"2024-04-25T13:16:14.090599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:40.420290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025389+0000","last_change":"2024-04-25T13:16:08.016370+0000","last_active":"2024-04-25T13:16:14.025389+0000","last_peered":"2024-04-25T13:16:14.025389+0000","last_clean":"2024-04-25T13:16:14.025389+0000","last_became_active":"2024-04-25T13:16:08.016068+0000","last_became_peered":"2024-04-25T13:16:08.016068+0000","last_unstale":"2024-04-25T13:16:14.025389+0000","last_undegraded":"2024-04-25T13:16:14.025389+0000","last_fullsized":"2024-04-25T13:16:14.025389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:11.475920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091465+0000","last_change":"2024-04-25T13:16:08.005195+0000","last_active":"2024-04-25T13:16:14.091465+0000","last_peered":"2024-04-25T13:16:14.091465+0000","last_clean":"2024-04-25T13:16:14.091465+0000","last_became_active":"2024-04-25T13:16:08.004655+0000","last_became_peered":"2024-04-25T13:16:08.004655+0000","last_unstale":"2024-04-25T13:16:14.091465+0000","last_undegraded":"2024-04-25T13:16:14.091465+0000","last_fullsized":"2024-04-25T13:16:14.091465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:28.249616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091464+0000","last_change":"2024-04-25T13:16:08.011310+0000","last_active":"2024-04-25T13:16:14.091464+0000","last_peered":"2024-04-25T13:16:14.091464+0000","last_clean":"2024-04-25T13:16:14.091464+0000","last_became_active":"2024-04-25T13:16:08.011047+0000","last_became_peered":"2024-04-25T13:16:08.011047+0000","last_unstale":"2024-04-25T13:16:14.091464+0000","last_undegraded":"2024-04-25T13:16:14.091464+0000","last_fullsized":"2024-04-25T13:16:14.091464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:55.447995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091964+0000","last_change":"2024-04-25T13:16:08.012191+0000","last_active":"2024-04-25T13:16:14.091964+0000","last_peered":"2024-04-25T13:16:14.091964+0000","last_clean":"2024-04-25T13:16:14.091964+0000","last_became_active":"2024-04-25T13:16:08.011916+0000","last_became_peered":"2024-04-25T13:16:08.011916+0000","last_unstale":"2024-04-25T13:16:14.091964+0000","last_undegraded":"2024-04-25T13:16:14.091964+0000","last_fullsized":"2024-04-25T13:16:14.091964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:33.520554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092843+0000","last_change":"2024-04-25T13:16:08.012349+0000","last_active":"2024-04-25T13:16:14.092843+0000","last_peered":"2024-04-25T13:16:14.092843+0000","last_clean":"2024-04-25T13:16:14.092843+0000","last_became_active":"2024-04-25T13:16:08.011893+0000","last_became_peered":"2024-04-25T13:16:08.011893+0000","last_unstale":"2024-04-25T13:16:14.092843+0000","last_undegraded":"2024-04-25T13:16:14.092843+0000","last_fullsized":"2024-04-25T13:16:14.092843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:11.901170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.024985+0000","last_change":"2024-04-25T13:16:08.015681+0000","last_active":"2024-04-25T13:16:14.024985+0000","last_peered":"2024-04-25T13:16:14.024985+0000","last_clean":"2024-04-25T13:16:14.024985+0000","last_became_active":"2024-04-25T13:16:08.015405+0000","last_became_peered":"2024-04-25T13:16:08.015405+0000","last_unstale":"2024-04-25T13:16:14.024985+0000","last_undegraded":"2024-04-25T13:16:14.024985+0000","last_fullsized":"2024-04-25T13:16:14.024985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:00.932243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090639+0000","last_change":"2024-04-25T13:16:08.000456+0000","last_active":"2024-04-25T13:16:14.090639+0000","last_peered":"2024-04-25T13:16:14.090639+0000","last_clean":"2024-04-25T13:16:14.090639+0000","last_became_active":"2024-04-25T13:16:08.000193+0000","last_became_peered":"2024-04-25T13:16:08.000193+0000","last_unstale":"2024-04-25T13:16:14.090639+0000","last_undegraded":"2024-04-25T13:16:14.090639+0000","last_fullsized":"2024-04-25T13:16:14.090639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:15.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025845+0000","last_change":"2024-04-25T13:16:08.016060+0000","last_active":"2024-04-25T13:16:14.025845+0000","last_peered":"2024-04-25T13:16:14.025845+0000","last_clean":"2024-04-25T13:16:14.025845+0000","last_became_active":"2024-04-25T13:16:08.014300+0000","last_became_peered":"2024-04-25T13:16:08.014300+0000","last_unstale":"2024-04-25T13:16:14.025845+0000","last_undegraded":"2024-04-25T13:16:14.025845+0000","last_fullsized":"2024-04-25T13:16:14.025845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:37.644887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091282+0000","last_change":"2024-04-25T13:16:08.004946+0000","last_active":"2024-04-25T13:16:14.091282+0000","last_peered":"2024-04-25T13:16:14.091282+0000","last_clean":"2024-04-25T13:16:14.091282+0000","last_became_active":"2024-04-25T13:16:08.004673+0000","last_became_peered":"2024-04-25T13:16:08.004673+0000","last_unstale":"2024-04-25T13:16:14.091282+0000","last_undegraded":"2024-04-25T13:16:14.091282+0000","last_fullsized":"2024-04-25T13:16:14.091282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:18.616424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025492+0000","last_change":"2024-04-25T13:16:08.015676+0000","last_active":"2024-04-25T13:16:14.025492+0000","last_peered":"2024-04-25T13:16:14.025492+0000","last_clean":"2024-04-25T13:16:14.025492+0000","last_became_active":"2024-04-25T13:16:08.014719+0000","last_became_peered":"2024-04-25T13:16:08.014719+0000","last_unstale":"2024-04-25T13:16:14.025492+0000","last_undegraded":"2024-04-25T13:16:14.025492+0000","last_fullsized":"2024-04-25T13:16:14.025492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:04.274611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090172+0000","last_change":"2024-04-25T13:16:07.997665+0000","last_active":"2024-04-25T13:16:14.090172+0000","last_peered":"2024-04-25T13:16:14.090172+0000","last_clean":"2024-04-25T13:16:14.090172+0000","last_became_active":"2024-04-25T13:16:07.996792+0000","last_became_peered":"2024-04-25T13:16:07.996792+0000","last_unstale":"2024-04-25T13:16:14.090172+0000","last_undegraded":"2024-04-25T13:16:14.090172+0000","last_fullsized":"2024-04-25T13:16:14.090172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:39.367026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022259+0000","last_change":"2024-04-25T13:16:08.001495+0000","last_active":"2024-04-25T13:16:14.022259+0000","last_peered":"2024-04-25T13:16:14.022259+0000","last_clean":"2024-04-25T13:16:14.022259+0000","last_became_active":"2024-04-25T13:16:08.001182+0000","last_became_peered":"2024-04-25T13:16:08.001182+0000","last_unstale":"2024-04-25T13:16:14.022259+0000","last_undegraded":"2024-04-25T13:16:14.022259+0000","last_fullsized":"2024-04-25T13:16:14.022259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:48.417192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092786+0000","last_change":"2024-04-25T13:16:08.006262+0000","last_active":"2024-04-25T13:16:14.092786+0000","last_peered":"2024-04-25T13:16:14.092786+0000","last_clean":"2024-04-25T13:16:14.092786+0000","last_became_active":"2024-04-25T13:16:08.005976+0000","last_became_peered":"2024-04-25T13:16:08.005976+0000","last_unstale":"2024-04-25T13:16:14.092786+0000","last_undegraded":"2024-04-25T13:16:14.092786+0000","last_fullsized":"2024-04-25T13:16:14.092786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:22.965387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:16:41.706 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:16:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.841+0000 7f5d342fa640 1 Processor -- start 2024-04-25T13:16:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.841+0000 7f5d342fa640 1 -- start start 2024-04-25T13:16:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d342fa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d2c1554e0 0x7f5d2c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d342fa640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2c1558c0 con 0x7f5d2c0b3c00 2024-04-25T13:16:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d342fa640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2c15f630 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d342fa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2c0b4a80 con 0x7f5d2c1554e0 2024-04-25T13:16:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d31895640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5d2c0b3c00 0x7f5d2c0b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43266/0 (socket says 172.21.15.52:43266) 2024-04-25T13:16:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d31895640 1 -- 172.21.15.52:0/2889595809 learned_addr learned my addr 172.21.15.52:0/2889595809 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d32096640 1 --2- 172.21.15.52:0/2889595809 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d2c1554e0 0x7f5d2c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d31094640 1 -- 172.21.15.52:0/2889595809 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369827687 0 0) 0x7f5d28001110 con 0x7f5d2c0b3c00 2024-04-25T13:16:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d31094640 1 -- 172.21.15.52:0/2889595809 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d18003520 con 0x7f5d2c0b3c00 2024-04-25T13:16:41.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d31094640 1 -- 172.21.15.52:0/2889595809 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4097765551 0 0) 0x7f5d2c15f630 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d31094640 1 -- 172.21.15.52:0/2889595809 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d28001110 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d32096640 1 -- 172.21.15.52:0/2889595809 >> v1:172.21.15.102:6789/0 conn(0x7f5d2c0d08a0 legacy=0x7f5d2c165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.842+0000 7f5d32096640 1 -- 172.21.15.52:0/2889595809 >> v1:172.21.15.52:6789/0 conn(0x7f5d2c0b3c00 legacy=0x7f5d2c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.843+0000 7f5d32096640 1 -- 172.21.15.52:0/2889595809 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c0cb8c0 con 0x7f5d2c1554e0 2024-04-25T13:16:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.843+0000 7f5d32096640 1 --2- 172.21.15.52:0/2889595809 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d2c1554e0 0x7f5d2c15f0f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0097d0 tx=0x7f5d1c02a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a586bc64cb5c9987 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.844+0000 7f5d31094640 1 -- 172.21.15.52:0/2889595809 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c037070 con 0x7f5d2c1554e0 2024-04-25T13:16:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.844+0000 7f5d31094640 1 -- 172.21.15.52:0/2889595809 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d1c032440 con 0x7f5d2c1554e0 2024-04-25T13:16:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.844+0000 7f5d31094640 1 -- 172.21.15.52:0/2889595809 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0327f0 con 0x7f5d2c1554e0 2024-04-25T13:16:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.844+0000 7f5d342fa640 1 -- 172.21.15.52:0/2889595809 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d2c1554e0 msgr2=0x7f5d2c15f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.844+0000 7f5d342fa640 1 --2- 172.21.15.52:0/2889595809 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d2c1554e0 0x7f5d2c15f0f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0097d0 tx=0x7f5d1c02a290 comp rx=0 tx=0).stop 2024-04-25T13:16:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.844+0000 7f5d342fa640 1 -- 172.21.15.52:0/2889595809 shutdown_connections 2024-04-25T13:16:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.844+0000 7f5d342fa640 1 --2- 172.21.15.52:0/2889595809 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d2c1554e0 0x7f5d2c15f0f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.844+0000 7f5d342fa640 1 -- 172.21.15.52:0/2889595809 >> 172.21.15.52:0/2889595809 conn(0x7f5d2c074d50 msgr2=0x7f5d2c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:41.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.844+0000 7f5d342fa640 1 -- 172.21.15.52:0/2889595809 shutdown_connections 2024-04-25T13:16:41.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.844+0000 7f5d342fa640 1 -- 172.21.15.52:0/2889595809 wait complete. 2024-04-25T13:16:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.845+0000 7f5d342fa640 1 Processor -- start 2024-04-25T13:16:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.846+0000 7f5d342fa640 1 -- start start 2024-04-25T13:16:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.846+0000 7f5d342fa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d2c0b3c00 0x7f5d2c158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.846+0000 7f5d342fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c0d08a0 0x7f5d2c1e7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.846+0000 7f5d342fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d2c1554e0 0x7f5d2c1f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.846+0000 7f5d342fa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c0b4430 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.846+0000 7f5d342fa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c0b4150 con 0x7f5d2c1554e0 2024-04-25T13:16:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.846+0000 7f5d342fa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2c0b4710 con 0x7f5d2c0b3c00 2024-04-25T13:16:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.846+0000 7f5d31895640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c0d08a0 0x7f5d2c1e7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.846+0000 7f5d31895640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c0d08a0 0x7f5d2c1e7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55318/0 (socket says 172.21.15.52:55318) 2024-04-25T13:16:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.846+0000 7f5d31895640 1 -- 172.21.15.52:0/3638670919 learned_addr learned my addr 172.21.15.52:0/3638670919 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.846+0000 7f5d32096640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d2c0b3c00 0x7f5d2c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.846+0000 7f5d32897640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d2c1554e0 0x7f5d2c1f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.847+0000 7f5d31895640 1 -- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d2c0b3c00 msgr2=0x7f5d2c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.847+0000 7f5d31895640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d2c0b3c00 0x7f5d2c158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.847+0000 7f5d31895640 1 -- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d2c1554e0 msgr2=0x7f5d2c1f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.847+0000 7f5d31895640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d2c1554e0 0x7f5d2c1f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.847+0000 7f5d31895640 1 -- 172.21.15.52:0/3638670919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c154670 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.847+0000 7f5d31895640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c0d08a0 0x7f5d2c1e7d60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c730 tx=0x7f5d2800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.847+0000 7f5d22ffd640 1 -- 172.21.15.52:0/3638670919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28017070 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.847+0000 7f5d22ffd640 1 -- 172.21.15.52:0/3638670919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d28005ab0 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.847+0000 7f5d22ffd640 1 -- 172.21.15.52:0/3638670919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28007070 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.847+0000 7f5d342fa640 1 -- 172.21.15.52:0/3638670919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2c158a00 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.847+0000 7f5d342fa640 1 -- 172.21.15.52:0/3638670919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d2c15e980 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.848+0000 7f5d342fa640 1 -- 172.21.15.52:0/3638670919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d2c0b4ca0 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.849+0000 7f5d22ffd640 1 -- 172.21.15.52:0/3638670919 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5d2801a070 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.849+0000 7f5d22ffd640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5d1006c8f0 0x7f5d1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.849+0000 7f5d22ffd640 1 -- 172.21.15.52:0/3638670919 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5d2808b380 con 0x7f5d2c0d08a0 2024-04-25T13:16:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.849+0000 7f5d32096640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5d1006c8f0 0x7f5d1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.850+0000 7f5d32096640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5d1006c8f0 0x7f5d1006edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c034000 tx=0x7f5d1c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:41.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:41.853+0000 7f5d22ffd640 1 -- 172.21.15.52:0/3638670919 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5d2c0b4ca0 con 0x7f5d2c0d08a0 2024-04-25T13:16:42.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.034+0000 7f5d342fa640 1 -- 172.21.15.52:0/3638670919 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d2c069e50 con 0x7f5d1006c8f0 2024-04-25T13:16:42.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.042+0000 7f5d22ffd640 1 -- 172.21.15.52:0/3638670919 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332684 (secure 0 0 0) 0x7f5d2c069e50 con 0x7f5d1006c8f0 2024-04-25T13:16:42.046 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:42.048 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T13:16:42.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.046+0000 7f5d342fa640 1 -- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5d1006c8f0 msgr2=0x7f5d1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.046+0000 7f5d342fa640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5d1006c8f0 0x7f5d1006edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c034000 tx=0x7f5d1c02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:42.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.046+0000 7f5d342fa640 1 -- 172.21.15.52:0/3638670919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c0d08a0 msgr2=0x7f5d2c1e7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.046+0000 7f5d342fa640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c0d08a0 0x7f5d2c1e7d60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c730 tx=0x7f5d2800cbf0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.046+0000 7f5d342fa640 1 -- 172.21.15.52:0/3638670919 shutdown_connections 2024-04-25T13:16:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.046+0000 7f5d342fa640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5d1006c8f0 0x7f5d1006edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.046+0000 7f5d342fa640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d2c1554e0 0x7f5d2c1f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.046+0000 7f5d342fa640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c0d08a0 0x7f5d2c1e7d60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.046+0000 7f5d342fa640 1 --2- 172.21.15.52:0/3638670919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d2c0b3c00 0x7f5d2c158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.046+0000 7f5d342fa640 1 -- 172.21.15.52:0/3638670919 >> 172.21.15.52:0/3638670919 conn(0x7f5d2c074d50 msgr2=0x7f5d2c153720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.046+0000 7f5d342fa640 1 -- 172.21.15.52:0/3638670919 shutdown_connections 2024-04-25T13:16:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.046+0000 7f5d342fa640 1 -- 172.21.15.52:0/3638670919 wait complete. 2024-04-25T13:16:42.057 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-04-25T13:16:41.826972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":246,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236124,"kb_used_data":3332,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738596,"statfs":{"total":773094113280,"available":772852322304,"internally_reserved":0,"allocated":3411968,"data_stored":2050538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1547,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003247"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090521+0000","last_change":"2024-04-25T13:16:07.001071+0000","last_active":"2024-04-25T13:16:14.090521+0000","last_peered":"2024-04-25T13:16:14.090521+0000","last_clean":"2024-04-25T13:16:14.090521+0000","last_became_active":"2024-04-25T13:16:07.000746+0000","last_became_peered":"2024-04-25T13:16:07.000746+0000","last_unstale":"2024-04-25T13:16:14.090521+0000","last_undegraded":"2024-04-25T13:16:14.090521+0000","last_fullsized":"2024-04-25T13:16:14.090521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:36.289103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025658+0000","last_change":"2024-04-25T13:16:08.012928+0000","last_active":"2024-04-25T13:16:14.025658+0000","last_peered":"2024-04-25T13:16:14.025658+0000","last_clean":"2024-04-25T13:16:14.025658+0000","last_became_active":"2024-04-25T13:16:08.012114+0000","last_became_peered":"2024-04-25T13:16:08.012114+0000","last_unstale":"2024-04-25T13:16:14.025658+0000","last_undegraded":"2024-04-25T13:16:14.025658+0000","last_fullsized":"2024-04-25T13:16:14.025658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:01.077922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025013+0000","last_change":"2024-04-25T13:16:12.734829+0000","last_active":"2024-04-25T13:16:14.025013+0000","last_peered":"2024-04-25T13:16:14.025013+0000","last_clean":"2024-04-25T13:16:14.025013+0000","last_became_active":"2024-04-25T13:16:12.734390+0000","last_became_peered":"2024-04-25T13:16:12.734390+0000","last_unstale":"2024-04-25T13:16:14.025013+0000","last_undegraded":"2024-04-25T13:16:14.025013+0000","last_fullsized":"2024-04-25T13:16:14.025013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:33.941883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025802+0000","last_change":"2024-04-25T13:16:06.999440+0000","last_active":"2024-04-25T13:16:14.025802+0000","last_peered":"2024-04-25T13:16:14.025802+0000","last_clean":"2024-04-25T13:16:14.025802+0000","last_became_active":"2024-04-25T13:16:06.999078+0000","last_became_peered":"2024-04-25T13:16:06.999078+0000","last_unstale":"2024-04-25T13:16:14.025802+0000","last_undegraded":"2024-04-25T13:16:14.025802+0000","last_fullsized":"2024-04-25T13:16:14.025802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.819349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090243+0000","last_change":"2024-04-25T13:16:08.012743+0000","last_active":"2024-04-25T13:16:14.090243+0000","last_peered":"2024-04-25T13:16:14.090243+0000","last_clean":"2024-04-25T13:16:14.090243+0000","last_became_active":"2024-04-25T13:16:08.012036+0000","last_became_peered":"2024-04-25T13:16:08.012036+0000","last_unstale":"2024-04-25T13:16:14.090243+0000","last_undegraded":"2024-04-25T13:16:14.090243+0000","last_fullsized":"2024-04-25T13:16:14.090243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.959146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091482+0000","last_change":"2024-04-25T13:16:12.038266+0000","last_active":"2024-04-25T13:16:14.091482+0000","last_peered":"2024-04-25T13:16:14.091482+0000","last_clean":"2024-04-25T13:16:14.091482+0000","last_became_active":"2024-04-25T13:16:12.037796+0000","last_became_peered":"2024-04-25T13:16:12.037796+0000","last_unstale":"2024-04-25T13:16:14.091482+0000","last_undegraded":"2024-04-25T13:16:14.091482+0000","last_fullsized":"2024-04-25T13:16:14.091482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:44.953964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092596+0000","last_change":"2024-04-25T13:16:07.001022+0000","last_active":"2024-04-25T13:16:14.092596+0000","last_peered":"2024-04-25T13:16:14.092596+0000","last_clean":"2024-04-25T13:16:14.092596+0000","last_became_active":"2024-04-25T13:16:07.000751+0000","last_became_peered":"2024-04-25T13:16:07.000751+0000","last_unstale":"2024-04-25T13:16:14.092596+0000","last_undegraded":"2024-04-25T13:16:14.092596+0000","last_fullsized":"2024-04-25T13:16:14.092596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:11.597397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025512+0000","last_change":"2024-04-25T13:16:08.011361+0000","last_active":"2024-04-25T13:16:14.025512+0000","last_peered":"2024-04-25T13:16:14.025512+0000","last_clean":"2024-04-25T13:16:14.025512+0000","last_became_active":"2024-04-25T13:16:08.011073+0000","last_became_peered":"2024-04-25T13:16:08.011073+0000","last_unstale":"2024-04-25T13:16:14.025512+0000","last_undegraded":"2024-04-25T13:16:14.025512+0000","last_fullsized":"2024-04-25T13:16:14.025512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:00.471410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091957+0000","last_change":"2024-04-25T13:16:12.043732+0000","last_active":"2024-04-25T13:16:14.091957+0000","last_peered":"2024-04-25T13:16:14.091957+0000","last_clean":"2024-04-25T13:16:14.091957+0000","last_became_active":"2024-04-25T13:16:12.043264+0000","last_became_peered":"2024-04-25T13:16:12.043264+0000","last_unstale":"2024-04-25T13:16:14.091957+0000","last_undegraded":"2024-04-25T13:16:14.091957+0000","last_fullsized":"2024-04-25T13:16:14.091957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:39.974518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092358+0000","last_change":"2024-04-25T13:16:07.003774+0000","last_active":"2024-04-25T13:16:14.092358+0000","last_peered":"2024-04-25T13:16:14.092358+0000","last_clean":"2024-04-25T13:16:14.092358+0000","last_became_active":"2024-04-25T13:16:07.003493+0000","last_became_peered":"2024-04-25T13:16:07.003493+0000","last_unstale":"2024-04-25T13:16:14.092358+0000","last_undegraded":"2024-04-25T13:16:14.092358+0000","last_fullsized":"2024-04-25T13:16:14.092358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:12.940812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025735+0000","last_change":"2024-04-25T13:16:08.012084+0000","last_active":"2024-04-25T13:16:14.025735+0000","last_peered":"2024-04-25T13:16:14.025735+0000","last_clean":"2024-04-25T13:16:14.025735+0000","last_became_active":"2024-04-25T13:16:08.011634+0000","last_became_peered":"2024-04-25T13:16:08.011634+0000","last_unstale":"2024-04-25T13:16:14.025735+0000","last_undegraded":"2024-04-25T13:16:14.025735+0000","last_fullsized":"2024-04-25T13:16:14.025735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:26.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091223+0000","last_change":"2024-04-25T13:16:12.039238+0000","last_active":"2024-04-25T13:16:14.091223+0000","last_peered":"2024-04-25T13:16:14.091223+0000","last_clean":"2024-04-25T13:16:14.091223+0000","last_became_active":"2024-04-25T13:16:12.038508+0000","last_became_peered":"2024-04-25T13:16:12.038508+0000","last_unstale":"2024-04-25T13:16:14.091223+0000","last_undegraded":"2024-04-25T13:16:14.091223+0000","last_fullsized":"2024-04-25T13:16:14.091223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:22.183373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090787+0000","last_change":"2024-04-25T13:16:08.007741+0000","last_active":"2024-04-25T13:16:14.090787+0000","last_peered":"2024-04-25T13:16:14.090787+0000","last_clean":"2024-04-25T13:16:14.090787+0000","last_became_active":"2024-04-25T13:16:08.007478+0000","last_became_peered":"2024-04-25T13:16:08.007478+0000","last_unstale":"2024-04-25T13:16:14.090787+0000","last_undegraded":"2024-04-25T13:16:14.090787+0000","last_fullsized":"2024-04-25T13:16:14.090787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:49.162203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:39.087981+0000","last_change":"2024-04-25T13:16:07.001183+0000","last_active":"2024-04-25T13:16:39.087981+0000","last_peered":"2024-04-25T13:16:39.087981+0000","last_clean":"2024-04-25T13:16:39.087981+0000","last_became_active":"2024-04-25T13:16:07.000880+0000","last_became_peered":"2024-04-25T13:16:07.000880+0000","last_unstale":"2024-04-25T13:16:39.087981+0000","last_undegraded":"2024-04-25T13:16:39.087981+0000","last_fullsized":"2024-04-25T13:16:39.087981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.250349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091408+0000","last_change":"2024-04-25T13:16:12.037074+0000","last_active":"2024-04-25T13:16:14.091408+0000","last_peered":"2024-04-25T13:16:14.091408+0000","last_clean":"2024-04-25T13:16:14.091408+0000","last_became_active":"2024-04-25T13:16:12.036508+0000","last_became_peered":"2024-04-25T13:16:12.036508+0000","last_unstale":"2024-04-25T13:16:14.091408+0000","last_undegraded":"2024-04-25T13:16:14.091408+0000","last_fullsized":"2024-04-25T13:16:14.091408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:01.380469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025437+0000","last_change":"2024-04-25T13:16:08.013538+0000","last_active":"2024-04-25T13:16:14.025437+0000","last_peered":"2024-04-25T13:16:14.025437+0000","last_clean":"2024-04-25T13:16:14.025437+0000","last_became_active":"2024-04-25T13:16:08.013269+0000","last_became_peered":"2024-04-25T13:16:08.013269+0000","last_unstale":"2024-04-25T13:16:14.025437+0000","last_undegraded":"2024-04-25T13:16:14.025437+0000","last_fullsized":"2024-04-25T13:16:14.025437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:05.313768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022116+0000","last_change":"2024-04-25T13:16:06.994106+0000","last_active":"2024-04-25T13:16:14.022116+0000","last_peered":"2024-04-25T13:16:14.022116+0000","last_clean":"2024-04-25T13:16:14.022116+0000","last_became_active":"2024-04-25T13:16:06.993807+0000","last_became_peered":"2024-04-25T13:16:06.993807+0000","last_unstale":"2024-04-25T13:16:14.022116+0000","last_undegraded":"2024-04-25T13:16:14.022116+0000","last_fullsized":"2024-04-25T13:16:14.022116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:53.706175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091111+0000","last_change":"2024-04-25T13:16:12.039421+0000","last_active":"2024-04-25T13:16:14.091111+0000","last_peered":"2024-04-25T13:16:14.091111+0000","last_clean":"2024-04-25T13:16:14.091111+0000","last_became_active":"2024-04-25T13:16:12.038953+0000","last_became_peered":"2024-04-25T13:16:12.038953+0000","last_unstale":"2024-04-25T13:16:14.091111+0000","last_undegraded":"2024-04-25T13:16:14.091111+0000","last_fullsized":"2024-04-25T13:16:14.091111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:26.714224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025194+0000","last_change":"2024-04-25T13:16:08.008978+0000","last_active":"2024-04-25T13:16:14.025194+0000","last_peered":"2024-04-25T13:16:14.025194+0000","last_clean":"2024-04-25T13:16:14.025194+0000","last_became_active":"2024-04-25T13:16:08.008446+0000","last_became_peered":"2024-04-25T13:16:08.008446+0000","last_unstale":"2024-04-25T13:16:14.025194+0000","last_undegraded":"2024-04-25T13:16:14.025194+0000","last_fullsized":"2024-04-25T13:16:14.025194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:34.604344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:39.100684+0000","last_change":"2024-04-25T13:16:06.992902+0000","last_active":"2024-04-25T13:16:39.100684+0000","last_peered":"2024-04-25T13:16:39.100684+0000","last_clean":"2024-04-25T13:16:39.100684+0000","last_became_active":"2024-04-25T13:16:06.992593+0000","last_became_peered":"2024-04-25T13:16:06.992593+0000","last_unstale":"2024-04-25T13:16:39.100684+0000","last_undegraded":"2024-04-25T13:16:39.100684+0000","last_fullsized":"2024-04-25T13:16:39.100684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:57.665455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022580+0000","last_change":"2024-04-25T13:16:12.735412+0000","last_active":"2024-04-25T13:16:14.022580+0000","last_peered":"2024-04-25T13:16:14.022580+0000","last_clean":"2024-04-25T13:16:14.022580+0000","last_became_active":"2024-04-25T13:16:12.733485+0000","last_became_peered":"2024-04-25T13:16:12.733485+0000","last_unstale":"2024-04-25T13:16:14.022580+0000","last_undegraded":"2024-04-25T13:16:14.022580+0000","last_fullsized":"2024-04-25T13:16:14.022580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:25.265696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092136+0000","last_change":"2024-04-25T13:16:07.998941+0000","last_active":"2024-04-25T13:16:14.092136+0000","last_peered":"2024-04-25T13:16:14.092136+0000","last_clean":"2024-04-25T13:16:14.092136+0000","last_became_active":"2024-04-25T13:16:07.998658+0000","last_became_peered":"2024-04-25T13:16:07.998658+0000","last_unstale":"2024-04-25T13:16:14.092136+0000","last_undegraded":"2024-04-25T13:16:14.092136+0000","last_fullsized":"2024-04-25T13:16:14.092136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:45.473269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:39.095127+0000","last_change":"2024-04-25T13:16:07.001542+0000","last_active":"2024-04-25T13:16:39.095127+0000","last_peered":"2024-04-25T13:16:39.095127+0000","last_clean":"2024-04-25T13:16:39.095127+0000","last_became_active":"2024-04-25T13:16:07.000846+0000","last_became_peered":"2024-04-25T13:16:07.000846+0000","last_unstale":"2024-04-25T13:16:39.095127+0000","last_undegraded":"2024-04-25T13:16:39.095127+0000","last_fullsized":"2024-04-25T13:16:39.095127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:41.121978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091648+0000","last_change":"2024-04-25T13:16:12.038493+0000","last_active":"2024-04-25T13:16:14.091648+0000","last_peered":"2024-04-25T13:16:14.091648+0000","last_clean":"2024-04-25T13:16:14.091648+0000","last_became_active":"2024-04-25T13:16:12.038032+0000","last_became_peered":"2024-04-25T13:16:12.038032+0000","last_unstale":"2024-04-25T13:16:14.091648+0000","last_undegraded":"2024-04-25T13:16:14.091648+0000","last_fullsized":"2024-04-25T13:16:14.091648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:40.222480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090898+0000","last_change":"2024-04-25T13:16:07.998444+0000","last_active":"2024-04-25T13:16:14.090898+0000","last_peered":"2024-04-25T13:16:14.090898+0000","last_clean":"2024-04-25T13:16:14.090898+0000","last_became_active":"2024-04-25T13:16:07.998037+0000","last_became_peered":"2024-04-25T13:16:07.998037+0000","last_unstale":"2024-04-25T13:16:14.090898+0000","last_undegraded":"2024-04-25T13:16:14.090898+0000","last_fullsized":"2024-04-25T13:16:14.090898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:35.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:39.091785+0000","last_change":"2024-04-25T13:16:06.995706+0000","last_active":"2024-04-25T13:16:39.091785+0000","last_peered":"2024-04-25T13:16:39.091785+0000","last_clean":"2024-04-25T13:16:39.091785+0000","last_became_active":"2024-04-25T13:16:06.995420+0000","last_became_peered":"2024-04-25T13:16:06.995420+0000","last_unstale":"2024-04-25T13:16:39.091785+0000","last_undegraded":"2024-04-25T13:16:39.091785+0000","last_fullsized":"2024-04-25T13:16:39.091785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:08.672949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091752+0000","last_change":"2024-04-25T13:16:12.734165+0000","last_active":"2024-04-25T13:16:14.091752+0000","last_peered":"2024-04-25T13:16:14.091752+0000","last_clean":"2024-04-25T13:16:14.091752+0000","last_became_active":"2024-04-25T13:16:12.733772+0000","last_became_peered":"2024-04-25T13:16:12.733772+0000","last_unstale":"2024-04-25T13:16:14.091752+0000","last_undegraded":"2024-04-25T13:16:14.091752+0000","last_fullsized":"2024-04-25T13:16:14.091752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:35.716517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025960+0000","last_change":"2024-04-25T13:16:08.017429+0000","last_active":"2024-04-25T13:16:14.025960+0000","last_peered":"2024-04-25T13:16:14.025960+0000","last_clean":"2024-04-25T13:16:14.025960+0000","last_became_active":"2024-04-25T13:16:08.017205+0000","last_became_peered":"2024-04-25T13:16:08.017205+0000","last_unstale":"2024-04-25T13:16:14.025960+0000","last_undegraded":"2024-04-25T13:16:14.025960+0000","last_fullsized":"2024-04-25T13:16:14.025960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.383669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022539+0000","last_change":"2024-04-25T13:16:06.992063+0000","last_active":"2024-04-25T13:16:14.022539+0000","last_peered":"2024-04-25T13:16:14.022539+0000","last_clean":"2024-04-25T13:16:14.022539+0000","last_became_active":"2024-04-25T13:16:06.991766+0000","last_became_peered":"2024-04-25T13:16:06.991766+0000","last_unstale":"2024-04-25T13:16:14.022539+0000","last_undegraded":"2024-04-25T13:16:14.022539+0000","last_fullsized":"2024-04-25T13:16:14.022539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:25.728063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.024950+0000","last_change":"2024-04-25T13:16:12.734837+0000","last_active":"2024-04-25T13:16:14.024950+0000","last_peered":"2024-04-25T13:16:14.024950+0000","last_clean":"2024-04-25T13:16:14.024950+0000","last_became_active":"2024-04-25T13:16:12.734394+0000","last_became_peered":"2024-04-25T13:16:12.734394+0000","last_unstale":"2024-04-25T13:16:14.024950+0000","last_undegraded":"2024-04-25T13:16:14.024950+0000","last_fullsized":"2024-04-25T13:16:14.024950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:24.740929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022045+0000","last_change":"2024-04-25T13:16:08.000277+0000","last_active":"2024-04-25T13:16:14.022045+0000","last_peered":"2024-04-25T13:16:14.022045+0000","last_clean":"2024-04-25T13:16:14.022045+0000","last_became_active":"2024-04-25T13:16:07.999797+0000","last_became_peered":"2024-04-25T13:16:07.999797+0000","last_unstale":"2024-04-25T13:16:14.022045+0000","last_undegraded":"2024-04-25T13:16:14.022045+0000","last_fullsized":"2024-04-25T13:16:14.022045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:08.860755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092766+0000","last_change":"2024-04-25T13:16:07.002146+0000","last_active":"2024-04-25T13:16:14.092766+0000","last_peered":"2024-04-25T13:16:14.092766+0000","last_clean":"2024-04-25T13:16:14.092766+0000","last_became_active":"2024-04-25T13:16:07.001918+0000","last_became_peered":"2024-04-25T13:16:07.001918+0000","last_unstale":"2024-04-25T13:16:14.092766+0000","last_undegraded":"2024-04-25T13:16:14.092766+0000","last_fullsized":"2024-04-25T13:16:14.092766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:38.326719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090806+0000","last_change":"2024-04-25T13:16:12.733744+0000","last_active":"2024-04-25T13:16:14.090806+0000","last_peered":"2024-04-25T13:16:14.090806+0000","last_clean":"2024-04-25T13:16:14.090806+0000","last_became_active":"2024-04-25T13:16:12.733361+0000","last_became_peered":"2024-04-25T13:16:12.733361+0000","last_unstale":"2024-04-25T13:16:14.090806+0000","last_undegraded":"2024-04-25T13:16:14.090806+0000","last_fullsized":"2024-04-25T13:16:14.090806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:39.178837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025844+0000","last_change":"2024-04-25T13:16:08.016667+0000","last_active":"2024-04-25T13:16:14.025844+0000","last_peered":"2024-04-25T13:16:14.025844+0000","last_clean":"2024-04-25T13:16:14.025844+0000","last_became_active":"2024-04-25T13:16:08.015172+0000","last_became_peered":"2024-04-25T13:16:08.015172+0000","last_unstale":"2024-04-25T13:16:14.025844+0000","last_undegraded":"2024-04-25T13:16:14.025844+0000","last_fullsized":"2024-04-25T13:16:14.025844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:40.786954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022161+0000","last_change":"2024-04-25T13:16:06.996301+0000","last_active":"2024-04-25T13:16:14.022161+0000","last_peered":"2024-04-25T13:16:14.022161+0000","last_clean":"2024-04-25T13:16:14.022161+0000","last_became_active":"2024-04-25T13:16:06.995957+0000","last_became_peered":"2024-04-25T13:16:06.995957+0000","last_unstale":"2024-04-25T13:16:14.022161+0000","last_undegraded":"2024-04-25T13:16:14.022161+0000","last_fullsized":"2024-04-25T13:16:14.022161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:16.802775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021893+0000","last_change":"2024-04-25T13:16:12.040987+0000","last_active":"2024-04-25T13:16:14.021893+0000","last_peered":"2024-04-25T13:16:14.021893+0000","last_clean":"2024-04-25T13:16:14.021893+0000","last_became_active":"2024-04-25T13:16:12.039987+0000","last_became_peered":"2024-04-25T13:16:12.039987+0000","last_unstale":"2024-04-25T13:16:14.021893+0000","last_undegraded":"2024-04-25T13:16:14.021893+0000","last_fullsized":"2024-04-25T13:16:14.021893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:40.366718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092137+0000","last_change":"2024-04-25T13:16:08.002876+0000","last_active":"2024-04-25T13:16:14.092137+0000","last_peered":"2024-04-25T13:16:14.092137+0000","last_clean":"2024-04-25T13:16:14.092137+0000","last_became_active":"2024-04-25T13:16:08.002131+0000","last_became_peered":"2024-04-25T13:16:08.002131+0000","last_unstale":"2024-04-25T13:16:14.092137+0000","last_undegraded":"2024-04-25T13:16:14.092137+0000","last_fullsized":"2024-04-25T13:16:14.092137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:09.646849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.026081+0000","last_change":"2024-04-25T13:16:06.990075+0000","last_active":"2024-04-25T13:16:14.026081+0000","last_peered":"2024-04-25T13:16:14.026081+0000","last_clean":"2024-04-25T13:16:14.026081+0000","last_became_active":"2024-04-25T13:16:06.989652+0000","last_became_peered":"2024-04-25T13:16:06.989652+0000","last_unstale":"2024-04-25T13:16:14.026081+0000","last_undegraded":"2024-04-25T13:16:14.026081+0000","last_fullsized":"2024-04-25T13:16:14.026081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:29.378995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022100+0000","last_change":"2024-04-25T13:16:12.032906+0000","last_active":"2024-04-25T13:16:14.022100+0000","last_peered":"2024-04-25T13:16:14.022100+0000","last_clean":"2024-04-25T13:16:14.022100+0000","last_became_active":"2024-04-25T13:16:12.032184+0000","last_became_peered":"2024-04-25T13:16:12.032184+0000","last_unstale":"2024-04-25T13:16:14.022100+0000","last_undegraded":"2024-04-25T13:16:14.022100+0000","last_fullsized":"2024-04-25T13:16:14.022100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.724927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021878+0000","last_change":"2024-04-25T13:16:07.997173+0000","last_active":"2024-04-25T13:16:14.021878+0000","last_peered":"2024-04-25T13:16:14.021878+0000","last_clean":"2024-04-25T13:16:14.021878+0000","last_became_active":"2024-04-25T13:16:07.996545+0000","last_became_peered":"2024-04-25T13:16:07.996545+0000","last_unstale":"2024-04-25T13:16:14.021878+0000","last_undegraded":"2024-04-25T13:16:14.021878+0000","last_fullsized":"2024-04-25T13:16:14.021878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:28.902563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089903+0000","last_change":"2024-04-25T13:16:06.993674+0000","last_active":"2024-04-25T13:16:14.089903+0000","last_peered":"2024-04-25T13:16:14.089903+0000","last_clean":"2024-04-25T13:16:14.089903+0000","last_became_active":"2024-04-25T13:16:06.993387+0000","last_became_peered":"2024-04-25T13:16:06.993387+0000","last_unstale":"2024-04-25T13:16:14.089903+0000","last_undegraded":"2024-04-25T13:16:14.089903+0000","last_fullsized":"2024-04-25T13:16:14.089903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:13.104822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022616+0000","last_change":"2024-04-25T13:16:12.037015+0000","last_active":"2024-04-25T13:16:14.022616+0000","last_peered":"2024-04-25T13:16:14.022616+0000","last_clean":"2024-04-25T13:16:14.022616+0000","last_became_active":"2024-04-25T13:16:12.036634+0000","last_became_peered":"2024-04-25T13:16:12.036634+0000","last_unstale":"2024-04-25T13:16:14.022616+0000","last_undegraded":"2024-04-25T13:16:14.022616+0000","last_fullsized":"2024-04-25T13:16:14.022616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:12.986396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090465+0000","last_change":"2024-04-25T13:16:08.004209+0000","last_active":"2024-04-25T13:16:14.090465+0000","last_peered":"2024-04-25T13:16:14.090465+0000","last_clean":"2024-04-25T13:16:14.090465+0000","last_became_active":"2024-04-25T13:16:08.003908+0000","last_became_peered":"2024-04-25T13:16:08.003908+0000","last_unstale":"2024-04-25T13:16:14.090465+0000","last_undegraded":"2024-04-25T13:16:14.090465+0000","last_fullsized":"2024-04-25T13:16:14.090465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:17.027888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090514+0000","last_change":"2024-04-25T13:16:06.999384+0000","last_active":"2024-04-25T13:16:14.090514+0000","last_peered":"2024-04-25T13:16:14.090514+0000","last_clean":"2024-04-25T13:16:14.090514+0000","last_became_active":"2024-04-25T13:16:06.999126+0000","last_became_peered":"2024-04-25T13:16:06.999126+0000","last_unstale":"2024-04-25T13:16:14.090514+0000","last_undegraded":"2024-04-25T13:16:14.090514+0000","last_fullsized":"2024-04-25T13:16:14.090514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:50.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090826+0000","last_change":"2024-04-25T13:16:12.733992+0000","last_active":"2024-04-25T13:16:14.090826+0000","last_peered":"2024-04-25T13:16:14.090826+0000","last_clean":"2024-04-25T13:16:14.090826+0000","last_became_active":"2024-04-25T13:16:12.733316+0000","last_became_peered":"2024-04-25T13:16:12.733316+0000","last_unstale":"2024-04-25T13:16:14.090826+0000","last_undegraded":"2024-04-25T13:16:14.090826+0000","last_fullsized":"2024-04-25T13:16:14.090826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:54.246728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025262+0000","last_change":"2024-04-25T13:16:08.021617+0000","last_active":"2024-04-25T13:16:14.025262+0000","last_peered":"2024-04-25T13:16:14.025262+0000","last_clean":"2024-04-25T13:16:14.025262+0000","last_became_active":"2024-04-25T13:16:08.021346+0000","last_became_peered":"2024-04-25T13:16:08.021346+0000","last_unstale":"2024-04-25T13:16:14.025262+0000","last_undegraded":"2024-04-25T13:16:14.025262+0000","last_fullsized":"2024-04-25T13:16:14.025262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:10.013805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:39.095906+0000","last_change":"2024-04-25T13:16:06.990638+0000","last_active":"2024-04-25T13:16:39.095906+0000","last_peered":"2024-04-25T13:16:39.095906+0000","last_clean":"2024-04-25T13:16:39.095906+0000","last_became_active":"2024-04-25T13:16:06.990379+0000","last_became_peered":"2024-04-25T13:16:06.990379+0000","last_unstale":"2024-04-25T13:16:39.095906+0000","last_undegraded":"2024-04-25T13:16:39.095906+0000","last_fullsized":"2024-04-25T13:16:39.095906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:39.385990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090466+0000","last_change":"2024-04-25T13:15:57.168598+0000","last_active":"2024-04-25T13:16:14.090466+0000","last_peered":"2024-04-25T13:16:14.090466+0000","last_clean":"2024-04-25T13:16:14.090466+0000","last_became_active":"2024-04-25T13:15:57.167692+0000","last_became_peered":"2024-04-25T13:15:57.167692+0000","last_unstale":"2024-04-25T13:16:14.090466+0000","last_undegraded":"2024-04-25T13:16:14.090466+0000","last_fullsized":"2024-04-25T13:16:14.090466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_clean_scrub_stamp":"2024-04-25T13:15:55.844647+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:29.123100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091126+0000","last_change":"2024-04-25T13:16:12.734712+0000","last_active":"2024-04-25T13:16:14.091126+0000","last_peered":"2024-04-25T13:16:14.091126+0000","last_clean":"2024-04-25T13:16:14.091126+0000","last_became_active":"2024-04-25T13:16:12.734288+0000","last_became_peered":"2024-04-25T13:16:12.734288+0000","last_unstale":"2024-04-25T13:16:14.091126+0000","last_undegraded":"2024-04-25T13:16:14.091126+0000","last_fullsized":"2024-04-25T13:16:14.091126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:45.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092489+0000","last_change":"2024-04-25T13:16:08.014279+0000","last_active":"2024-04-25T13:16:14.092489+0000","last_peered":"2024-04-25T13:16:14.092489+0000","last_clean":"2024-04-25T13:16:14.092489+0000","last_became_active":"2024-04-25T13:16:08.013989+0000","last_became_peered":"2024-04-25T13:16:08.013989+0000","last_unstale":"2024-04-25T13:16:14.092489+0000","last_undegraded":"2024-04-25T13:16:14.092489+0000","last_fullsized":"2024-04-25T13:16:14.092489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:54.411981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090165+0000","last_change":"2024-04-25T13:16:06.996774+0000","last_active":"2024-04-25T13:16:14.090165+0000","last_peered":"2024-04-25T13:16:14.090165+0000","last_clean":"2024-04-25T13:16:14.090165+0000","last_became_active":"2024-04-25T13:16:06.996251+0000","last_became_peered":"2024-04-25T13:16:06.996251+0000","last_unstale":"2024-04-25T13:16:14.090165+0000","last_undegraded":"2024-04-25T13:16:14.090165+0000","last_fullsized":"2024-04-25T13:16:14.090165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:01.815602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090885+0000","last_change":"2024-04-25T13:16:12.733562+0000","last_active":"2024-04-25T13:16:14.090885+0000","last_peered":"2024-04-25T13:16:14.090885+0000","last_clean":"2024-04-25T13:16:14.090885+0000","last_became_active":"2024-04-25T13:16:12.733114+0000","last_became_peered":"2024-04-25T13:16:12.733114+0000","last_unstale":"2024-04-25T13:16:14.090885+0000","last_undegraded":"2024-04-25T13:16:14.090885+0000","last_fullsized":"2024-04-25T13:16:14.090885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:20.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025577+0000","last_change":"2024-04-25T13:16:08.011389+0000","last_active":"2024-04-25T13:16:14.025577+0000","last_peered":"2024-04-25T13:16:14.025577+0000","last_clean":"2024-04-25T13:16:14.025577+0000","last_became_active":"2024-04-25T13:16:08.011113+0000","last_became_peered":"2024-04-25T13:16:08.011113+0000","last_unstale":"2024-04-25T13:16:14.025577+0000","last_undegraded":"2024-04-25T13:16:14.025577+0000","last_fullsized":"2024-04-25T13:16:14.025577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:12.339487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022376+0000","last_change":"2024-04-25T13:16:06.988988+0000","last_active":"2024-04-25T13:16:14.022376+0000","last_peered":"2024-04-25T13:16:14.022376+0000","last_clean":"2024-04-25T13:16:14.022376+0000","last_became_active":"2024-04-25T13:16:06.988631+0000","last_became_peered":"2024-04-25T13:16:06.988631+0000","last_unstale":"2024-04-25T13:16:14.022376+0000","last_undegraded":"2024-04-25T13:16:14.022376+0000","last_fullsized":"2024-04-25T13:16:14.022376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:47.056977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090922+0000","last_change":"2024-04-25T13:16:12.047194+0000","last_active":"2024-04-25T13:16:14.090922+0000","last_peered":"2024-04-25T13:16:14.090922+0000","last_clean":"2024-04-25T13:16:14.090922+0000","last_became_active":"2024-04-25T13:16:12.046780+0000","last_became_peered":"2024-04-25T13:16:12.046780+0000","last_unstale":"2024-04-25T13:16:14.090922+0000","last_undegraded":"2024-04-25T13:16:14.090922+0000","last_fullsized":"2024-04-25T13:16:14.090922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:41.664409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092850+0000","last_change":"2024-04-25T13:16:08.007925+0000","last_active":"2024-04-25T13:16:14.092850+0000","last_peered":"2024-04-25T13:16:14.092850+0000","last_clean":"2024-04-25T13:16:14.092850+0000","last_became_active":"2024-04-25T13:16:08.007681+0000","last_became_peered":"2024-04-25T13:16:08.007681+0000","last_unstale":"2024-04-25T13:16:14.092850+0000","last_undegraded":"2024-04-25T13:16:14.092850+0000","last_fullsized":"2024-04-25T13:16:14.092850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:29.601564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090519+0000","last_change":"2024-04-25T13:16:06.991912+0000","last_active":"2024-04-25T13:16:14.090519+0000","last_peered":"2024-04-25T13:16:14.090519+0000","last_clean":"2024-04-25T13:16:14.090519+0000","last_became_active":"2024-04-25T13:16:06.991578+0000","last_became_peered":"2024-04-25T13:16:06.991578+0000","last_unstale":"2024-04-25T13:16:14.090519+0000","last_undegraded":"2024-04-25T13:16:14.090519+0000","last_fullsized":"2024-04-25T13:16:14.090519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:59.364396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025152+0000","last_change":"2024-04-25T13:16:12.733567+0000","last_active":"2024-04-25T13:16:14.025152+0000","last_peered":"2024-04-25T13:16:14.025152+0000","last_clean":"2024-04-25T13:16:14.025152+0000","last_became_active":"2024-04-25T13:16:12.733136+0000","last_became_peered":"2024-04-25T13:16:12.733136+0000","last_unstale":"2024-04-25T13:16:14.025152+0000","last_undegraded":"2024-04-25T13:16:14.025152+0000","last_fullsized":"2024-04-25T13:16:14.025152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:29.125928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092741+0000","last_change":"2024-04-25T13:16:08.004897+0000","last_active":"2024-04-25T13:16:14.092741+0000","last_peered":"2024-04-25T13:16:14.092741+0000","last_clean":"2024-04-25T13:16:14.092741+0000","last_became_active":"2024-04-25T13:16:08.004180+0000","last_became_peered":"2024-04-25T13:16:08.004180+0000","last_unstale":"2024-04-25T13:16:14.092741+0000","last_undegraded":"2024-04-25T13:16:14.092741+0000","last_fullsized":"2024-04-25T13:16:14.092741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:12.011447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090973+0000","last_change":"2024-04-25T13:16:06.994487+0000","last_active":"2024-04-25T13:16:14.090973+0000","last_peered":"2024-04-25T13:16:14.090973+0000","last_clean":"2024-04-25T13:16:14.090973+0000","last_became_active":"2024-04-25T13:16:06.994235+0000","last_became_peered":"2024-04-25T13:16:06.994235+0000","last_unstale":"2024-04-25T13:16:14.090973+0000","last_undegraded":"2024-04-25T13:16:14.090973+0000","last_fullsized":"2024-04-25T13:16:14.090973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091573+0000","last_change":"2024-04-25T13:16:12.039277+0000","last_active":"2024-04-25T13:16:14.091573+0000","last_peered":"2024-04-25T13:16:14.091573+0000","last_clean":"2024-04-25T13:16:14.091573+0000","last_became_active":"2024-04-25T13:16:12.038534+0000","last_became_peered":"2024-04-25T13:16:12.038534+0000","last_unstale":"2024-04-25T13:16:14.091573+0000","last_undegraded":"2024-04-25T13:16:14.091573+0000","last_fullsized":"2024-04-25T13:16:14.091573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:59.495976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090745+0000","last_change":"2024-04-25T13:16:08.007302+0000","last_active":"2024-04-25T13:16:14.090745+0000","last_peered":"2024-04-25T13:16:14.090745+0000","last_clean":"2024-04-25T13:16:14.090745+0000","last_became_active":"2024-04-25T13:16:08.007050+0000","last_became_peered":"2024-04-25T13:16:08.007050+0000","last_unstale":"2024-04-25T13:16:14.090745+0000","last_undegraded":"2024-04-25T13:16:14.090745+0000","last_fullsized":"2024-04-25T13:16:14.090745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:35.369188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:39.093893+0000","last_change":"2024-04-25T13:16:06.982609+0000","last_active":"2024-04-25T13:16:39.093893+0000","last_peered":"2024-04-25T13:16:39.093893+0000","last_clean":"2024-04-25T13:16:39.093893+0000","last_became_active":"2024-04-25T13:16:06.982320+0000","last_became_peered":"2024-04-25T13:16:06.982320+0000","last_unstale":"2024-04-25T13:16:39.093893+0000","last_undegraded":"2024-04-25T13:16:39.093893+0000","last_fullsized":"2024-04-25T13:16:39.093893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:55.372968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090845+0000","last_change":"2024-04-25T13:16:12.043657+0000","last_active":"2024-04-25T13:16:14.090845+0000","last_peered":"2024-04-25T13:16:14.090845+0000","last_clean":"2024-04-25T13:16:14.090845+0000","last_became_active":"2024-04-25T13:16:12.042902+0000","last_became_peered":"2024-04-25T13:16:12.042902+0000","last_unstale":"2024-04-25T13:16:14.090845+0000","last_undegraded":"2024-04-25T13:16:14.090845+0000","last_fullsized":"2024-04-25T13:16:14.090845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:46.721199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090854+0000","last_change":"2024-04-25T13:16:08.008534+0000","last_active":"2024-04-25T13:16:14.090854+0000","last_peered":"2024-04-25T13:16:14.090854+0000","last_clean":"2024-04-25T13:16:14.090854+0000","last_became_active":"2024-04-25T13:16:08.008102+0000","last_became_peered":"2024-04-25T13:16:08.008102+0000","last_unstale":"2024-04-25T13:16:14.090854+0000","last_undegraded":"2024-04-25T13:16:14.090854+0000","last_fullsized":"2024-04-25T13:16:14.090854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:48.331724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091187+0000","last_change":"2024-04-25T13:16:06.993292+0000","last_active":"2024-04-25T13:16:14.091187+0000","last_peered":"2024-04-25T13:16:14.091187+0000","last_clean":"2024-04-25T13:16:14.091187+0000","last_became_active":"2024-04-25T13:16:06.993008+0000","last_became_peered":"2024-04-25T13:16:06.993008+0000","last_unstale":"2024-04-25T13:16:14.091187+0000","last_undegraded":"2024-04-25T13:16:14.091187+0000","last_fullsized":"2024-04-25T13:16:14.091187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025971+0000","last_change":"2024-04-25T13:16:12.733945+0000","last_active":"2024-04-25T13:16:14.025971+0000","last_peered":"2024-04-25T13:16:14.025971+0000","last_clean":"2024-04-25T13:16:14.025971+0000","last_became_active":"2024-04-25T13:16:12.733359+0000","last_became_peered":"2024-04-25T13:16:12.733359+0000","last_unstale":"2024-04-25T13:16:14.025971+0000","last_undegraded":"2024-04-25T13:16:14.025971+0000","last_fullsized":"2024-04-25T13:16:14.025971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:27.352613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091472+0000","last_change":"2024-04-25T13:16:08.008034+0000","last_active":"2024-04-25T13:16:14.091472+0000","last_peered":"2024-04-25T13:16:14.091472+0000","last_clean":"2024-04-25T13:16:14.091472+0000","last_became_active":"2024-04-25T13:16:08.007790+0000","last_became_peered":"2024-04-25T13:16:08.007790+0000","last_unstale":"2024-04-25T13:16:14.091472+0000","last_undegraded":"2024-04-25T13:16:14.091472+0000","last_fullsized":"2024-04-25T13:16:14.091472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:35.903237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:39.094724+0000","last_change":"2024-04-25T13:16:06.996737+0000","last_active":"2024-04-25T13:16:39.094724+0000","last_peered":"2024-04-25T13:16:39.094724+0000","last_clean":"2024-04-25T13:16:39.094724+0000","last_became_active":"2024-04-25T13:16:06.996439+0000","last_became_peered":"2024-04-25T13:16:06.996439+0000","last_unstale":"2024-04-25T13:16:39.094724+0000","last_undegraded":"2024-04-25T13:16:39.094724+0000","last_fullsized":"2024-04-25T13:16:39.094724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:36.400030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025695+0000","last_change":"2024-04-25T13:16:12.734393+0000","last_active":"2024-04-25T13:16:14.025695+0000","last_peered":"2024-04-25T13:16:14.025695+0000","last_clean":"2024-04-25T13:16:14.025695+0000","last_became_active":"2024-04-25T13:16:12.733328+0000","last_became_peered":"2024-04-25T13:16:12.733328+0000","last_unstale":"2024-04-25T13:16:14.025695+0000","last_undegraded":"2024-04-25T13:16:14.025695+0000","last_fullsized":"2024-04-25T13:16:14.025695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.254012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090600+0000","last_change":"2024-04-25T13:16:08.000836+0000","last_active":"2024-04-25T13:16:14.090600+0000","last_peered":"2024-04-25T13:16:14.090600+0000","last_clean":"2024-04-25T13:16:14.090600+0000","last_became_active":"2024-04-25T13:16:08.000538+0000","last_became_peered":"2024-04-25T13:16:08.000538+0000","last_unstale":"2024-04-25T13:16:14.090600+0000","last_undegraded":"2024-04-25T13:16:14.090600+0000","last_fullsized":"2024-04-25T13:16:14.090600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:08.742353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:39.094597+0000","last_change":"2024-04-25T13:16:07.000559+0000","last_active":"2024-04-25T13:16:39.094597+0000","last_peered":"2024-04-25T13:16:39.094597+0000","last_clean":"2024-04-25T13:16:39.094597+0000","last_became_active":"2024-04-25T13:16:07.000243+0000","last_became_peered":"2024-04-25T13:16:07.000243+0000","last_unstale":"2024-04-25T13:16:39.094597+0000","last_undegraded":"2024-04-25T13:16:39.094597+0000","last_fullsized":"2024-04-25T13:16:39.094597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:01.672221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025845+0000","last_change":"2024-04-25T13:16:12.733681+0000","last_active":"2024-04-25T13:16:14.025845+0000","last_peered":"2024-04-25T13:16:14.025845+0000","last_clean":"2024-04-25T13:16:14.025845+0000","last_became_active":"2024-04-25T13:16:12.733245+0000","last_became_peered":"2024-04-25T13:16:12.733245+0000","last_unstale":"2024-04-25T13:16:14.025845+0000","last_undegraded":"2024-04-25T13:16:14.025845+0000","last_fullsized":"2024-04-25T13:16:14.025845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.028858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092399+0000","last_change":"2024-04-25T13:16:08.008790+0000","last_active":"2024-04-25T13:16:14.092399+0000","last_peered":"2024-04-25T13:16:14.092399+0000","last_clean":"2024-04-25T13:16:14.092399+0000","last_became_active":"2024-04-25T13:16:08.008530+0000","last_became_peered":"2024-04-25T13:16:08.008530+0000","last_unstale":"2024-04-25T13:16:14.092399+0000","last_undegraded":"2024-04-25T13:16:14.092399+0000","last_fullsized":"2024-04-25T13:16:14.092399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:44.215930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:39.090351+0000","last_change":"2024-04-25T13:16:06.997575+0000","last_active":"2024-04-25T13:16:39.090351+0000","last_peered":"2024-04-25T13:16:39.090351+0000","last_clean":"2024-04-25T13:16:39.090351+0000","last_became_active":"2024-04-25T13:16:06.997289+0000","last_became_peered":"2024-04-25T13:16:06.997289+0000","last_unstale":"2024-04-25T13:16:39.090351+0000","last_undegraded":"2024-04-25T13:16:39.090351+0000","last_fullsized":"2024-04-25T13:16:39.090351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:54.096662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021968+0000","last_change":"2024-04-25T13:16:12.040456+0000","last_active":"2024-04-25T13:16:14.021968+0000","last_peered":"2024-04-25T13:16:14.021968+0000","last_clean":"2024-04-25T13:16:14.021968+0000","last_became_active":"2024-04-25T13:16:12.039443+0000","last_became_peered":"2024-04-25T13:16:12.039443+0000","last_unstale":"2024-04-25T13:16:14.021968+0000","last_undegraded":"2024-04-25T13:16:14.021968+0000","last_fullsized":"2024-04-25T13:16:14.021968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:23.192500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091569+0000","last_change":"2024-04-25T13:16:08.004618+0000","last_active":"2024-04-25T13:16:14.091569+0000","last_peered":"2024-04-25T13:16:14.091569+0000","last_clean":"2024-04-25T13:16:14.091569+0000","last_became_active":"2024-04-25T13:16:08.002583+0000","last_became_peered":"2024-04-25T13:16:08.002583+0000","last_unstale":"2024-04-25T13:16:14.091569+0000","last_undegraded":"2024-04-25T13:16:14.091569+0000","last_fullsized":"2024-04-25T13:16:14.091569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:25.609409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022399+0000","last_change":"2024-04-25T13:16:06.996610+0000","last_active":"2024-04-25T13:16:14.022399+0000","last_peered":"2024-04-25T13:16:14.022399+0000","last_clean":"2024-04-25T13:16:14.022399+0000","last_became_active":"2024-04-25T13:16:06.995616+0000","last_became_peered":"2024-04-25T13:16:06.995616+0000","last_unstale":"2024-04-25T13:16:14.022399+0000","last_undegraded":"2024-04-25T13:16:14.022399+0000","last_fullsized":"2024-04-25T13:16:14.022399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:21.135053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092179+0000","last_change":"2024-04-25T13:16:12.043744+0000","last_active":"2024-04-25T13:16:14.092179+0000","last_peered":"2024-04-25T13:16:14.092179+0000","last_clean":"2024-04-25T13:16:14.092179+0000","last_became_active":"2024-04-25T13:16:12.043267+0000","last_became_peered":"2024-04-25T13:16:12.043267+0000","last_unstale":"2024-04-25T13:16:14.092179+0000","last_undegraded":"2024-04-25T13:16:14.092179+0000","last_fullsized":"2024-04-25T13:16:14.092179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:52.316751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090426+0000","last_change":"2024-04-25T13:16:08.012359+0000","last_active":"2024-04-25T13:16:14.090426+0000","last_peered":"2024-04-25T13:16:14.090426+0000","last_clean":"2024-04-25T13:16:14.090426+0000","last_became_active":"2024-04-25T13:16:08.011295+0000","last_became_peered":"2024-04-25T13:16:08.011295+0000","last_unstale":"2024-04-25T13:16:14.090426+0000","last_undegraded":"2024-04-25T13:16:14.090426+0000","last_fullsized":"2024-04-25T13:16:14.090426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:19.939444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:39.094916+0000","last_change":"2024-04-25T13:16:06.997061+0000","last_active":"2024-04-25T13:16:39.094916+0000","last_peered":"2024-04-25T13:16:39.094916+0000","last_clean":"2024-04-25T13:16:39.094916+0000","last_became_active":"2024-04-25T13:16:06.996418+0000","last_became_peered":"2024-04-25T13:16:06.996418+0000","last_unstale":"2024-04-25T13:16:39.094916+0000","last_undegraded":"2024-04-25T13:16:39.094916+0000","last_fullsized":"2024-04-25T13:16:39.094916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:34.878260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025141+0000","last_change":"2024-04-25T13:16:12.042796+0000","last_active":"2024-04-25T13:16:14.025141+0000","last_peered":"2024-04-25T13:16:14.025141+0000","last_clean":"2024-04-25T13:16:14.025141+0000","last_became_active":"2024-04-25T13:16:12.042252+0000","last_became_peered":"2024-04-25T13:16:12.042252+0000","last_unstale":"2024-04-25T13:16:14.025141+0000","last_undegraded":"2024-04-25T13:16:14.025141+0000","last_fullsized":"2024-04-25T13:16:14.025141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:51.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025295+0000","last_change":"2024-04-25T13:16:08.016203+0000","last_active":"2024-04-25T13:16:14.025295+0000","last_peered":"2024-04-25T13:16:14.025295+0000","last_clean":"2024-04-25T13:16:14.025295+0000","last_became_active":"2024-04-25T13:16:08.015820+0000","last_became_peered":"2024-04-25T13:16:08.015820+0000","last_unstale":"2024-04-25T13:16:14.025295+0000","last_undegraded":"2024-04-25T13:16:14.025295+0000","last_fullsized":"2024-04-25T13:16:14.025295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:39.089837+0000","last_change":"2024-04-25T13:16:06.996624+0000","last_active":"2024-04-25T13:16:39.089837+0000","last_peered":"2024-04-25T13:16:39.089837+0000","last_clean":"2024-04-25T13:16:39.089837+0000","last_became_active":"2024-04-25T13:16:06.996373+0000","last_became_peered":"2024-04-25T13:16:06.996373+0000","last_unstale":"2024-04-25T13:16:39.089837+0000","last_undegraded":"2024-04-25T13:16:39.089837+0000","last_fullsized":"2024-04-25T13:16:39.089837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:29.929030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025097+0000","last_change":"2024-04-25T13:16:12.733792+0000","last_active":"2024-04-25T13:16:14.025097+0000","last_peered":"2024-04-25T13:16:14.025097+0000","last_clean":"2024-04-25T13:16:14.025097+0000","last_became_active":"2024-04-25T13:16:12.733314+0000","last_became_peered":"2024-04-25T13:16:12.733314+0000","last_unstale":"2024-04-25T13:16:14.025097+0000","last_undegraded":"2024-04-25T13:16:14.025097+0000","last_fullsized":"2024-04-25T13:16:14.025097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.836368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090737+0000","last_change":"2024-04-25T13:16:12.734573+0000","last_active":"2024-04-25T13:16:14.090737+0000","last_peered":"2024-04-25T13:16:14.090737+0000","last_clean":"2024-04-25T13:16:14.090737+0000","last_became_active":"2024-04-25T13:16:12.733908+0000","last_became_peered":"2024-04-25T13:16:12.733908+0000","last_unstale":"2024-04-25T13:16:14.090737+0000","last_undegraded":"2024-04-25T13:16:14.090737+0000","last_fullsized":"2024-04-25T13:16:14.090737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:59.673528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021648+0000","last_change":"2024-04-25T13:16:08.008915+0000","last_active":"2024-04-25T13:16:14.021648+0000","last_peered":"2024-04-25T13:16:14.021648+0000","last_clean":"2024-04-25T13:16:14.021648+0000","last_became_active":"2024-04-25T13:16:08.008586+0000","last_became_peered":"2024-04-25T13:16:08.008586+0000","last_unstale":"2024-04-25T13:16:14.021648+0000","last_undegraded":"2024-04-25T13:16:14.021648+0000","last_fullsized":"2024-04-25T13:16:14.021648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:46.905065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025393+0000","last_change":"2024-04-25T13:16:06.994489+0000","last_active":"2024-04-25T13:16:14.025393+0000","last_peered":"2024-04-25T13:16:14.025393+0000","last_clean":"2024-04-25T13:16:14.025393+0000","last_became_active":"2024-04-25T13:16:06.994005+0000","last_became_peered":"2024-04-25T13:16:06.994005+0000","last_unstale":"2024-04-25T13:16:14.025393+0000","last_undegraded":"2024-04-25T13:16:14.025393+0000","last_fullsized":"2024-04-25T13:16:14.025393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:43.921452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091678+0000","last_change":"2024-04-25T13:16:12.037008+0000","last_active":"2024-04-25T13:16:14.091678+0000","last_peered":"2024-04-25T13:16:14.091678+0000","last_clean":"2024-04-25T13:16:14.091678+0000","last_became_active":"2024-04-25T13:16:12.036569+0000","last_became_peered":"2024-04-25T13:16:12.036569+0000","last_unstale":"2024-04-25T13:16:14.091678+0000","last_undegraded":"2024-04-25T13:16:14.091678+0000","last_fullsized":"2024-04-25T13:16:14.091678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:48.224913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025108+0000","last_change":"2024-04-25T13:16:08.008747+0000","last_active":"2024-04-25T13:16:14.025108+0000","last_peered":"2024-04-25T13:16:14.025108+0000","last_clean":"2024-04-25T13:16:14.025108+0000","last_became_active":"2024-04-25T13:16:08.008078+0000","last_became_peered":"2024-04-25T13:16:08.008078+0000","last_unstale":"2024-04-25T13:16:14.025108+0000","last_undegraded":"2024-04-25T13:16:14.025108+0000","last_fullsized":"2024-04-25T13:16:14.025108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:19.590099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025230+0000","last_change":"2024-04-25T13:16:06.997642+0000","last_active":"2024-04-25T13:16:14.025230+0000","last_peered":"2024-04-25T13:16:14.025230+0000","last_clean":"2024-04-25T13:16:14.025230+0000","last_became_active":"2024-04-25T13:16:06.996985+0000","last_became_peered":"2024-04-25T13:16:06.996985+0000","last_unstale":"2024-04-25T13:16:14.025230+0000","last_undegraded":"2024-04-25T13:16:14.025230+0000","last_fullsized":"2024-04-25T13:16:14.025230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:49.853125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091049+0000","last_change":"2024-04-25T13:16:06.992687+0000","last_active":"2024-04-25T13:16:14.091049+0000","last_peered":"2024-04-25T13:16:14.091049+0000","last_clean":"2024-04-25T13:16:14.091049+0000","last_became_active":"2024-04-25T13:16:06.992407+0000","last_became_peered":"2024-04-25T13:16:06.992407+0000","last_unstale":"2024-04-25T13:16:14.091049+0000","last_undegraded":"2024-04-25T13:16:14.091049+0000","last_fullsized":"2024-04-25T13:16:14.091049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:37.658458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090948+0000","last_change":"2024-04-25T13:16:08.004510+0000","last_active":"2024-04-25T13:16:14.090948+0000","last_peered":"2024-04-25T13:16:14.090948+0000","last_clean":"2024-04-25T13:16:14.090948+0000","last_became_active":"2024-04-25T13:16:08.003959+0000","last_became_peered":"2024-04-25T13:16:08.003959+0000","last_unstale":"2024-04-25T13:16:14.090948+0000","last_undegraded":"2024-04-25T13:16:14.090948+0000","last_fullsized":"2024-04-25T13:16:14.090948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:45.142873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089967+0000","last_change":"2024-04-25T13:16:12.037097+0000","last_active":"2024-04-25T13:16:14.089967+0000","last_peered":"2024-04-25T13:16:14.089967+0000","last_clean":"2024-04-25T13:16:14.089967+0000","last_became_active":"2024-04-25T13:16:12.036651+0000","last_became_peered":"2024-04-25T13:16:12.036651+0000","last_unstale":"2024-04-25T13:16:14.089967+0000","last_undegraded":"2024-04-25T13:16:14.089967+0000","last_fullsized":"2024-04-25T13:16:14.089967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:34.443514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:39.100281+0000","last_change":"2024-04-25T13:16:06.996311+0000","last_active":"2024-04-25T13:16:39.100281+0000","last_peered":"2024-04-25T13:16:39.100281+0000","last_clean":"2024-04-25T13:16:39.100281+0000","last_became_active":"2024-04-25T13:16:06.996010+0000","last_became_peered":"2024-04-25T13:16:06.996010+0000","last_unstale":"2024-04-25T13:16:39.100281+0000","last_undegraded":"2024-04-25T13:16:39.100281+0000","last_fullsized":"2024-04-25T13:16:39.100281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:08.835482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091724+0000","last_change":"2024-04-25T13:16:08.002159+0000","last_active":"2024-04-25T13:16:14.091724+0000","last_peered":"2024-04-25T13:16:14.091724+0000","last_clean":"2024-04-25T13:16:14.091724+0000","last_became_active":"2024-04-25T13:16:08.001833+0000","last_became_peered":"2024-04-25T13:16:08.001833+0000","last_unstale":"2024-04-25T13:16:14.091724+0000","last_undegraded":"2024-04-25T13:16:14.091724+0000","last_fullsized":"2024-04-25T13:16:14.091724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:25.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025768+0000","last_change":"2024-04-25T13:16:12.042721+0000","last_active":"2024-04-25T13:16:14.025768+0000","last_peered":"2024-04-25T13:16:14.025768+0000","last_clean":"2024-04-25T13:16:14.025768+0000","last_became_active":"2024-04-25T13:16:12.042000+0000","last_became_peered":"2024-04-25T13:16:12.042000+0000","last_unstale":"2024-04-25T13:16:14.025768+0000","last_undegraded":"2024-04-25T13:16:14.025768+0000","last_fullsized":"2024-04-25T13:16:14.025768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:18.702032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090639+0000","last_change":"2024-04-25T13:16:08.008364+0000","last_active":"2024-04-25T13:16:14.090639+0000","last_peered":"2024-04-25T13:16:14.090639+0000","last_clean":"2024-04-25T13:16:14.090639+0000","last_became_active":"2024-04-25T13:16:08.007728+0000","last_became_peered":"2024-04-25T13:16:08.007728+0000","last_unstale":"2024-04-25T13:16:14.090639+0000","last_undegraded":"2024-04-25T13:16:14.090639+0000","last_fullsized":"2024-04-25T13:16:14.090639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:08.731178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.089766+0000","last_change":"2024-04-25T13:16:08.011273+0000","last_active":"2024-04-25T13:16:14.089766+0000","last_peered":"2024-04-25T13:16:14.089766+0000","last_clean":"2024-04-25T13:16:14.089766+0000","last_became_active":"2024-04-25T13:16:08.010981+0000","last_became_peered":"2024-04-25T13:16:08.010981+0000","last_unstale":"2024-04-25T13:16:14.089766+0000","last_undegraded":"2024-04-25T13:16:14.089766+0000","last_fullsized":"2024-04-25T13:16:14.089766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:03.835422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025994+0000","last_change":"2024-04-25T13:16:08.016413+0000","last_active":"2024-04-25T13:16:14.025994+0000","last_peered":"2024-04-25T13:16:14.025994+0000","last_clean":"2024-04-25T13:16:14.025994+0000","last_became_active":"2024-04-25T13:16:08.016084+0000","last_became_peered":"2024-04-25T13:16:08.016084+0000","last_unstale":"2024-04-25T13:16:14.025994+0000","last_undegraded":"2024-04-25T13:16:14.025994+0000","last_fullsized":"2024-04-25T13:16:14.025994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:41.014999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090856+0000","last_change":"2024-04-25T13:16:08.008543+0000","last_active":"2024-04-25T13:16:14.090856+0000","last_peered":"2024-04-25T13:16:14.090856+0000","last_clean":"2024-04-25T13:16:14.090856+0000","last_became_active":"2024-04-25T13:16:08.008255+0000","last_became_peered":"2024-04-25T13:16:08.008255+0000","last_unstale":"2024-04-25T13:16:14.090856+0000","last_undegraded":"2024-04-25T13:16:14.090856+0000","last_fullsized":"2024-04-25T13:16:14.090856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:47.981446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025776+0000","last_change":"2024-04-25T13:16:08.012814+0000","last_active":"2024-04-25T13:16:14.025776+0000","last_peered":"2024-04-25T13:16:14.025776+0000","last_clean":"2024-04-25T13:16:14.025776+0000","last_became_active":"2024-04-25T13:16:08.012481+0000","last_became_peered":"2024-04-25T13:16:08.012481+0000","last_unstale":"2024-04-25T13:16:14.025776+0000","last_undegraded":"2024-04-25T13:16:14.025776+0000","last_fullsized":"2024-04-25T13:16:14.025776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:05.409701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021983+0000","last_change":"2024-04-25T13:16:08.008843+0000","last_active":"2024-04-25T13:16:14.021983+0000","last_peered":"2024-04-25T13:16:14.021983+0000","last_clean":"2024-04-25T13:16:14.021983+0000","last_became_active":"2024-04-25T13:16:08.008489+0000","last_became_peered":"2024-04-25T13:16:08.008489+0000","last_unstale":"2024-04-25T13:16:14.021983+0000","last_undegraded":"2024-04-25T13:16:14.021983+0000","last_fullsized":"2024-04-25T13:16:14.021983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:35.740816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092076+0000","last_change":"2024-04-25T13:16:08.008121+0000","last_active":"2024-04-25T13:16:14.092076+0000","last_peered":"2024-04-25T13:16:14.092076+0000","last_clean":"2024-04-25T13:16:14.092076+0000","last_became_active":"2024-04-25T13:16:08.007727+0000","last_became_peered":"2024-04-25T13:16:08.007727+0000","last_unstale":"2024-04-25T13:16:14.092076+0000","last_undegraded":"2024-04-25T13:16:14.092076+0000","last_fullsized":"2024-04-25T13:16:14.092076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:11.193610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025864+0000","last_change":"2024-04-25T13:16:08.014997+0000","last_active":"2024-04-25T13:16:14.025864+0000","last_peered":"2024-04-25T13:16:14.025864+0000","last_clean":"2024-04-25T13:16:14.025864+0000","last_became_active":"2024-04-25T13:16:08.014579+0000","last_became_peered":"2024-04-25T13:16:08.014579+0000","last_unstale":"2024-04-25T13:16:14.025864+0000","last_undegraded":"2024-04-25T13:16:14.025864+0000","last_fullsized":"2024-04-25T13:16:14.025864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:07.884249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025224+0000","last_change":"2024-04-25T13:16:08.015379+0000","last_active":"2024-04-25T13:16:14.025224+0000","last_peered":"2024-04-25T13:16:14.025224+0000","last_clean":"2024-04-25T13:16:14.025224+0000","last_became_active":"2024-04-25T13:16:08.014693+0000","last_became_peered":"2024-04-25T13:16:08.014693+0000","last_unstale":"2024-04-25T13:16:14.025224+0000","last_undegraded":"2024-04-25T13:16:14.025224+0000","last_fullsized":"2024-04-25T13:16:14.025224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:41.305358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025156+0000","last_change":"2024-04-25T13:16:08.014873+0000","last_active":"2024-04-25T13:16:14.025156+0000","last_peered":"2024-04-25T13:16:14.025156+0000","last_clean":"2024-04-25T13:16:14.025156+0000","last_became_active":"2024-04-25T13:16:08.014575+0000","last_became_peered":"2024-04-25T13:16:08.014575+0000","last_unstale":"2024-04-25T13:16:14.025156+0000","last_undegraded":"2024-04-25T13:16:14.025156+0000","last_fullsized":"2024-04-25T13:16:14.025156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:41.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025900+0000","last_change":"2024-04-25T13:16:08.016992+0000","last_active":"2024-04-25T13:16:14.025900+0000","last_peered":"2024-04-25T13:16:14.025900+0000","last_clean":"2024-04-25T13:16:14.025900+0000","last_became_active":"2024-04-25T13:16:08.016499+0000","last_became_peered":"2024-04-25T13:16:08.016499+0000","last_unstale":"2024-04-25T13:16:14.025900+0000","last_undegraded":"2024-04-25T13:16:14.025900+0000","last_fullsized":"2024-04-25T13:16:14.025900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:47.275363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090726+0000","last_change":"2024-04-25T13:16:08.000447+0000","last_active":"2024-04-25T13:16:14.090726+0000","last_peered":"2024-04-25T13:16:14.090726+0000","last_clean":"2024-04-25T13:16:14.090726+0000","last_became_active":"2024-04-25T13:16:08.000102+0000","last_became_peered":"2024-04-25T13:16:08.000102+0000","last_unstale":"2024-04-25T13:16:14.090726+0000","last_undegraded":"2024-04-25T13:16:14.090726+0000","last_fullsized":"2024-04-25T13:16:14.090726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:30.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092034+0000","last_change":"2024-04-25T13:16:08.008437+0000","last_active":"2024-04-25T13:16:14.092034+0000","last_peered":"2024-04-25T13:16:14.092034+0000","last_clean":"2024-04-25T13:16:14.092034+0000","last_became_active":"2024-04-25T13:16:08.008173+0000","last_became_peered":"2024-04-25T13:16:08.008173+0000","last_unstale":"2024-04-25T13:16:14.092034+0000","last_undegraded":"2024-04-25T13:16:14.092034+0000","last_fullsized":"2024-04-25T13:16:14.092034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:54.362757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092640+0000","last_change":"2024-04-25T13:16:08.004689+0000","last_active":"2024-04-25T13:16:14.092640+0000","last_peered":"2024-04-25T13:16:14.092640+0000","last_clean":"2024-04-25T13:16:14.092640+0000","last_became_active":"2024-04-25T13:16:08.004340+0000","last_became_peered":"2024-04-25T13:16:08.004340+0000","last_unstale":"2024-04-25T13:16:14.092640+0000","last_undegraded":"2024-04-25T13:16:14.092640+0000","last_fullsized":"2024-04-25T13:16:14.092640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:18.870731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090426+0000","last_change":"2024-04-25T13:16:08.005344+0000","last_active":"2024-04-25T13:16:14.090426+0000","last_peered":"2024-04-25T13:16:14.090426+0000","last_clean":"2024-04-25T13:16:14.090426+0000","last_became_active":"2024-04-25T13:16:08.005041+0000","last_became_peered":"2024-04-25T13:16:08.005041+0000","last_unstale":"2024-04-25T13:16:14.090426+0000","last_undegraded":"2024-04-25T13:16:14.090426+0000","last_fullsized":"2024-04-25T13:16:14.090426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.389800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025849+0000","last_change":"2024-04-25T13:16:08.010203+0000","last_active":"2024-04-25T13:16:14.025849+0000","last_peered":"2024-04-25T13:16:14.025849+0000","last_clean":"2024-04-25T13:16:14.025849+0000","last_became_active":"2024-04-25T13:16:08.009922+0000","last_became_peered":"2024-04-25T13:16:08.009922+0000","last_unstale":"2024-04-25T13:16:14.025849+0000","last_undegraded":"2024-04-25T13:16:14.025849+0000","last_fullsized":"2024-04-25T13:16:14.025849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:06.831797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025079+0000","last_change":"2024-04-25T13:16:08.012737+0000","last_active":"2024-04-25T13:16:14.025079+0000","last_peered":"2024-04-25T13:16:14.025079+0000","last_clean":"2024-04-25T13:16:14.025079+0000","last_became_active":"2024-04-25T13:16:08.012472+0000","last_became_peered":"2024-04-25T13:16:08.012472+0000","last_unstale":"2024-04-25T13:16:14.025079+0000","last_undegraded":"2024-04-25T13:16:14.025079+0000","last_fullsized":"2024-04-25T13:16:14.025079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:36.880757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.021729+0000","last_change":"2024-04-25T13:16:08.007177+0000","last_active":"2024-04-25T13:16:14.021729+0000","last_peered":"2024-04-25T13:16:14.021729+0000","last_clean":"2024-04-25T13:16:14.021729+0000","last_became_active":"2024-04-25T13:16:08.006866+0000","last_became_peered":"2024-04-25T13:16:08.006866+0000","last_unstale":"2024-04-25T13:16:14.021729+0000","last_undegraded":"2024-04-25T13:16:14.021729+0000","last_fullsized":"2024-04-25T13:16:14.021729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:16.707771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090599+0000","last_change":"2024-04-25T13:16:07.999761+0000","last_active":"2024-04-25T13:16:14.090599+0000","last_peered":"2024-04-25T13:16:14.090599+0000","last_clean":"2024-04-25T13:16:14.090599+0000","last_became_active":"2024-04-25T13:16:07.999033+0000","last_became_peered":"2024-04-25T13:16:07.999033+0000","last_unstale":"2024-04-25T13:16:14.090599+0000","last_undegraded":"2024-04-25T13:16:14.090599+0000","last_fullsized":"2024-04-25T13:16:14.090599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:40.420290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025389+0000","last_change":"2024-04-25T13:16:08.016370+0000","last_active":"2024-04-25T13:16:14.025389+0000","last_peered":"2024-04-25T13:16:14.025389+0000","last_clean":"2024-04-25T13:16:14.025389+0000","last_became_active":"2024-04-25T13:16:08.016068+0000","last_became_peered":"2024-04-25T13:16:08.016068+0000","last_unstale":"2024-04-25T13:16:14.025389+0000","last_undegraded":"2024-04-25T13:16:14.025389+0000","last_fullsized":"2024-04-25T13:16:14.025389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:11.475920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091465+0000","last_change":"2024-04-25T13:16:08.005195+0000","last_active":"2024-04-25T13:16:14.091465+0000","last_peered":"2024-04-25T13:16:14.091465+0000","last_clean":"2024-04-25T13:16:14.091465+0000","last_became_active":"2024-04-25T13:16:08.004655+0000","last_became_peered":"2024-04-25T13:16:08.004655+0000","last_unstale":"2024-04-25T13:16:14.091465+0000","last_undegraded":"2024-04-25T13:16:14.091465+0000","last_fullsized":"2024-04-25T13:16:14.091465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:28.249616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091464+0000","last_change":"2024-04-25T13:16:08.011310+0000","last_active":"2024-04-25T13:16:14.091464+0000","last_peered":"2024-04-25T13:16:14.091464+0000","last_clean":"2024-04-25T13:16:14.091464+0000","last_became_active":"2024-04-25T13:16:08.011047+0000","last_became_peered":"2024-04-25T13:16:08.011047+0000","last_unstale":"2024-04-25T13:16:14.091464+0000","last_undegraded":"2024-04-25T13:16:14.091464+0000","last_fullsized":"2024-04-25T13:16:14.091464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:55.447995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091964+0000","last_change":"2024-04-25T13:16:08.012191+0000","last_active":"2024-04-25T13:16:14.091964+0000","last_peered":"2024-04-25T13:16:14.091964+0000","last_clean":"2024-04-25T13:16:14.091964+0000","last_became_active":"2024-04-25T13:16:08.011916+0000","last_became_peered":"2024-04-25T13:16:08.011916+0000","last_unstale":"2024-04-25T13:16:14.091964+0000","last_undegraded":"2024-04-25T13:16:14.091964+0000","last_fullsized":"2024-04-25T13:16:14.091964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:33.520554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092843+0000","last_change":"2024-04-25T13:16:08.012349+0000","last_active":"2024-04-25T13:16:14.092843+0000","last_peered":"2024-04-25T13:16:14.092843+0000","last_clean":"2024-04-25T13:16:14.092843+0000","last_became_active":"2024-04-25T13:16:08.011893+0000","last_became_peered":"2024-04-25T13:16:08.011893+0000","last_unstale":"2024-04-25T13:16:14.092843+0000","last_undegraded":"2024-04-25T13:16:14.092843+0000","last_fullsized":"2024-04-25T13:16:14.092843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:11.901170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.024985+0000","last_change":"2024-04-25T13:16:08.015681+0000","last_active":"2024-04-25T13:16:14.024985+0000","last_peered":"2024-04-25T13:16:14.024985+0000","last_clean":"2024-04-25T13:16:14.024985+0000","last_became_active":"2024-04-25T13:16:08.015405+0000","last_became_peered":"2024-04-25T13:16:08.015405+0000","last_unstale":"2024-04-25T13:16:14.024985+0000","last_undegraded":"2024-04-25T13:16:14.024985+0000","last_fullsized":"2024-04-25T13:16:14.024985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:00.932243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090639+0000","last_change":"2024-04-25T13:16:08.000456+0000","last_active":"2024-04-25T13:16:14.090639+0000","last_peered":"2024-04-25T13:16:14.090639+0000","last_clean":"2024-04-25T13:16:14.090639+0000","last_became_active":"2024-04-25T13:16:08.000193+0000","last_became_peered":"2024-04-25T13:16:08.000193+0000","last_unstale":"2024-04-25T13:16:14.090639+0000","last_undegraded":"2024-04-25T13:16:14.090639+0000","last_fullsized":"2024-04-25T13:16:14.090639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:15.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025845+0000","last_change":"2024-04-25T13:16:08.016060+0000","last_active":"2024-04-25T13:16:14.025845+0000","last_peered":"2024-04-25T13:16:14.025845+0000","last_clean":"2024-04-25T13:16:14.025845+0000","last_became_active":"2024-04-25T13:16:08.014300+0000","last_became_peered":"2024-04-25T13:16:08.014300+0000","last_unstale":"2024-04-25T13:16:14.025845+0000","last_undegraded":"2024-04-25T13:16:14.025845+0000","last_fullsized":"2024-04-25T13:16:14.025845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:37.644887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.091282+0000","last_change":"2024-04-25T13:16:08.004946+0000","last_active":"2024-04-25T13:16:14.091282+0000","last_peered":"2024-04-25T13:16:14.091282+0000","last_clean":"2024-04-25T13:16:14.091282+0000","last_became_active":"2024-04-25T13:16:08.004673+0000","last_became_peered":"2024-04-25T13:16:08.004673+0000","last_unstale":"2024-04-25T13:16:14.091282+0000","last_undegraded":"2024-04-25T13:16:14.091282+0000","last_fullsized":"2024-04-25T13:16:14.091282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:18.616424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.025492+0000","last_change":"2024-04-25T13:16:08.015676+0000","last_active":"2024-04-25T13:16:14.025492+0000","last_peered":"2024-04-25T13:16:14.025492+0000","last_clean":"2024-04-25T13:16:14.025492+0000","last_became_active":"2024-04-25T13:16:08.014719+0000","last_became_peered":"2024-04-25T13:16:08.014719+0000","last_unstale":"2024-04-25T13:16:14.025492+0000","last_undegraded":"2024-04-25T13:16:14.025492+0000","last_fullsized":"2024-04-25T13:16:14.025492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:04.274611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.090172+0000","last_change":"2024-04-25T13:16:07.997665+0000","last_active":"2024-04-25T13:16:14.090172+0000","last_peered":"2024-04-25T13:16:14.090172+0000","last_clean":"2024-04-25T13:16:14.090172+0000","last_became_active":"2024-04-25T13:16:07.996792+0000","last_became_peered":"2024-04-25T13:16:07.996792+0000","last_unstale":"2024-04-25T13:16:14.090172+0000","last_undegraded":"2024-04-25T13:16:14.090172+0000","last_fullsized":"2024-04-25T13:16:14.090172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:39.367026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.022259+0000","last_change":"2024-04-25T13:16:08.001495+0000","last_active":"2024-04-25T13:16:14.022259+0000","last_peered":"2024-04-25T13:16:14.022259+0000","last_clean":"2024-04-25T13:16:14.022259+0000","last_became_active":"2024-04-25T13:16:08.001182+0000","last_became_peered":"2024-04-25T13:16:08.001182+0000","last_unstale":"2024-04-25T13:16:14.022259+0000","last_undegraded":"2024-04-25T13:16:14.022259+0000","last_fullsized":"2024-04-25T13:16:14.022259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:48.417192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:14.092786+0000","last_change":"2024-04-25T13:16:08.006262+0000","last_active":"2024-04-25T13:16:14.092786+0000","last_peered":"2024-04-25T13:16:14.092786+0000","last_clean":"2024-04-25T13:16:14.092786+0000","last_became_active":"2024-04-25T13:16:08.005976+0000","last_became_peered":"2024-04-25T13:16:08.005976+0000","last_unstale":"2024-04-25T13:16:14.092786+0000","last_undegraded":"2024-04-25T13:16:14.092786+0000","last_fullsized":"2024-04-25T13:16:14.092786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:22.965387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":699077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":111857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":876544,"data_stored":698421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:16:42.062 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T13:16:42.062 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T13:16:42.062 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T13:16:42.062 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:16:42.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.196+0000 7f690c27c640 1 Processor -- start 2024-04-25T13:16:42.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.196+0000 7f690c27c640 1 -- start start 2024-04-25T13:16:42.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.197+0000 7f690c27c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f69040caac0 0x7f6904154e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.197+0000 7f690c27c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 0x7f69041553a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.197+0000 7f690c27c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f690415e7a0 con 0x7f69040ca6e0 2024-04-25T13:16:42.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.197+0000 7f690c27c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6904070ba0 con 0x7f69040caac0 2024-04-25T13:16:42.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.197+0000 7f690c27c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f690415ea80 con 0x7f69040c8260 2024-04-25T13:16:42.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.198+0000 7f690a819640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 0x7f69041553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.198+0000 7f6909817640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f69040caac0 0x7f6904154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.198+0000 7f690a819640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 0x7f69041553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:42194/0 (socket says 172.21.15.52:42194) 2024-04-25T13:16:42.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.198+0000 7f690a819640 1 -- 172.21.15.52:0/2963770251 learned_addr learned my addr 172.21.15.52:0/2963770251 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:42.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.198+0000 7f690a819640 1 -- 172.21.15.52:0/2963770251 >> v2:172.21.15.102:3300/0 conn(0x7f69040caac0 msgr2=0x7f6904154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:42.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.198+0000 7f690a819640 1 --2- 172.21.15.52:0/2963770251 >> v2:172.21.15.102:3300/0 conn(0x7f69040caac0 0x7f6904154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.198+0000 7f690a819640 1 -- 172.21.15.52:0/2963770251 >> v1:172.21.15.102:6789/0 conn(0x7f69040ca6e0 legacy=0x7f6904070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.198+0000 7f690a819640 1 -- 172.21.15.52:0/2963770251 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690415ed60 con 0x7f69040c8260 2024-04-25T13:16:42.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.198+0000 7f6909817640 1 --2- 172.21.15.52:0/2963770251 >> v2:172.21.15.102:3300/0 conn(0x7f69040caac0 0x7f6904154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:42.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.199+0000 7f690a819640 1 --2- 172.21.15.52:0/2963770251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 0x7f69041553a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009e50 tx=0x7f68fc02a7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f890a6635ef8d45d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:42.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.199+0000 7f6909016640 1 -- 172.21.15.52:0/2963770251 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc036070 con 0x7f69040c8260 2024-04-25T13:16:42.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.199+0000 7f6909016640 1 -- 172.21.15.52:0/2963770251 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68fc031600 con 0x7f69040c8260 2024-04-25T13:16:42.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.199+0000 7f6909016640 1 -- 172.21.15.52:0/2963770251 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0319f0 con 0x7f69040c8260 2024-04-25T13:16:42.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.199+0000 7f690c27c640 1 -- 172.21.15.52:0/2963770251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 msgr2=0x7f69041553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.199+0000 7f690c27c640 1 --2- 172.21.15.52:0/2963770251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 0x7f69041553a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009e50 tx=0x7f68fc02a7c0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.200+0000 7f690c27c640 1 -- 172.21.15.52:0/2963770251 shutdown_connections 2024-04-25T13:16:42.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.200+0000 7f690c27c640 1 --2- 172.21.15.52:0/2963770251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 0x7f69041553a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.200+0000 7f690c27c640 1 --2- 172.21.15.52:0/2963770251 >> v2:172.21.15.102:3300/0 conn(0x7f69040caac0 0x7f6904154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.200+0000 7f690c27c640 1 -- 172.21.15.52:0/2963770251 >> 172.21.15.52:0/2963770251 conn(0x7f690406bd10 msgr2=0x7f690406c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:42.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.200+0000 7f690c27c640 1 -- 172.21.15.52:0/2963770251 shutdown_connections 2024-04-25T13:16:42.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.200+0000 7f690c27c640 1 -- 172.21.15.52:0/2963770251 wait complete. 2024-04-25T13:16:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.201+0000 7f690c27c640 1 Processor -- start 2024-04-25T13:16:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.201+0000 7f690c27c640 1 -- start start 2024-04-25T13:16:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690c27c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 0x7f69040cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690c27c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69040ca6e0 0x7f69041f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690c27c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69040caac0 0x7f6904157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690c27c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69040c9e30 con 0x7f69040caac0 2024-04-25T13:16:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690c27c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f690415f320 con 0x7f69040ca6e0 2024-04-25T13:16:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690c27c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f690415b480 con 0x7f69040c8260 2024-04-25T13:16:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690a819640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69040caac0 0x7f6904157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690a018640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 0x7f69040cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690a018640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 0x7f69040cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:42206/0 (socket says 172.21.15.52:42206) 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690a819640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69040caac0 0x7f6904157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55330/0 (socket says 172.21.15.52:55330) 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690a018640 1 -- 172.21.15.52:0/1901119098 learned_addr learned my addr 172.21.15.52:0/1901119098 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f6909817640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69040ca6e0 0x7f69041f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690a018640 1 -- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69040ca6e0 msgr2=0x7f69041f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690a018640 1 --2- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69040ca6e0 0x7f69041f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690a018640 1 -- 172.21.15.52:0/1901119098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69040caac0 msgr2=0x7f6904157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690a018640 1 --2- 172.21.15.52:0/1901119098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69040caac0 0x7f6904157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690a018640 1 -- 172.21.15.52:0/1901119098 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69041f43a0 con 0x7f69040c8260 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f690a018640 1 --2- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 0x7f69040cddd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f690000c460 tx=0x7f690000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.202+0000 7f68faffd640 1 -- 172.21.15.52:0/1901119098 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69000052d0 con 0x7f69040c8260 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.203+0000 7f68faffd640 1 -- 172.21.15.52:0/1901119098 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6900012630 con 0x7f69040c8260 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.203+0000 7f690c27c640 1 -- 172.21.15.52:0/1901119098 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690414fa30 con 0x7f69040c8260 2024-04-25T13:16:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.203+0000 7f68faffd640 1 -- 172.21.15.52:0/1901119098 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69000054b0 con 0x7f69040c8260 2024-04-25T13:16:42.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.203+0000 7f690c27c640 1 -- 172.21.15.52:0/1901119098 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f690414fff0 con 0x7f69040c8260 2024-04-25T13:16:42.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.204+0000 7f690c27c640 1 -- 172.21.15.52:0/1901119098 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6904068e40 con 0x7f69040c8260 2024-04-25T13:16:42.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.204+0000 7f68faffd640 1 -- 172.21.15.52:0/1901119098 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6900012a20 con 0x7f69040c8260 2024-04-25T13:16:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.204+0000 7f68faffd640 1 --2- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f68e806c920 0x7f68e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.205+0000 7f68faffd640 1 -- 172.21.15.52:0/1901119098 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f690008b9b0 con 0x7f69040c8260 2024-04-25T13:16:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.205+0000 7f6909817640 1 --2- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f68e806c920 0x7f68e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.205+0000 7f6909817640 1 --2- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f68e806c920 0x7f68e806ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f69040cb500 tx=0x7f68f4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:42.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.209+0000 7f68faffd640 1 -- 172.21.15.52:0/1901119098 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f69000593c0 con 0x7f69040c8260 2024-04-25T13:16:42.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.435+0000 7f690c27c640 1 -- 172.21.15.52:0/1901119098 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f690414f150 con 0x7f69040c8260 2024-04-25T13:16:42.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.436+0000 7f68faffd640 1 -- 172.21.15.52:0/1901119098 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f690005d6c0 con 0x7f69040c8260 2024-04-25T13:16:42.436 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:42.436 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T13:16:42.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.438+0000 7f690c27c640 1 -- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f68e806c920 msgr2=0x7f68e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.438+0000 7f690c27c640 1 --2- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f68e806c920 0x7f68e806ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f69040cb500 tx=0x7f68f4009190 comp rx=0 tx=0).stop 2024-04-25T13:16:42.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.438+0000 7f690c27c640 1 -- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 msgr2=0x7f69040cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:42.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.438+0000 7f690c27c640 1 --2- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 0x7f69040cddd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f690000c460 tx=0x7f690000c920 comp rx=0 tx=0).stop 2024-04-25T13:16:42.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.438+0000 7f690c27c640 1 -- 172.21.15.52:0/1901119098 shutdown_connections 2024-04-25T13:16:42.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.438+0000 7f690c27c640 1 --2- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f68e806c920 0x7f68e806ede0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.438+0000 7f690c27c640 1 --2- 172.21.15.52:0/1901119098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69040caac0 0x7f6904157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.438+0000 7f690c27c640 1 --2- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69040ca6e0 0x7f69041f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.438+0000 7f690c27c640 1 --2- 172.21.15.52:0/1901119098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69040c8260 0x7f69040cddd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:42.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.438+0000 7f690c27c640 1 -- 172.21.15.52:0/1901119098 >> 172.21.15.52:0/1901119098 conn(0x7f690406bd10 msgr2=0x7f6904154c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:42.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.438+0000 7f690c27c640 1 -- 172.21.15.52:0/1901119098 shutdown_connections 2024-04-25T13:16:42.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:42.438+0000 7f690c27c640 1 -- 172.21.15.52:0/1901119098 wait complete. 2024-04-25T13:16:45.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:16:45.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.552+0000 7f2df69fe640 1 Processor -- start 2024-04-25T13:16:45.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.552+0000 7f2df69fe640 1 -- start start 2024-04-25T13:16:45.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2df69fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2df0155170 0x7f2df015eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2df69fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2df0155550 0x7f2df00d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2df69fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2df00cb9e0 0x7f2df00d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2df69fe640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2df00cddf0 con 0x7f2df0155170 2024-04-25T13:16:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2df69fe640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2df015f430 con 0x7f2df00cb9e0 2024-04-25T13:16:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2df69fe640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2df00ccf00 con 0x7f2df0155550 2024-04-25T13:16:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2deffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2df0155170 0x7f2df015eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2deffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2df0155170 0x7f2df015eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55338/0 (socket says 172.21.15.52:55338) 2024-04-25T13:16:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2deffff640 1 -- 172.21.15.52:0/711862674 learned_addr learned my addr 172.21.15.52:0/711862674 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2df4f9b640 1 --2- 172.21.15.52:0/711862674 >> v2:172.21.15.102:3300/0 conn(0x7f2df00cb9e0 0x7f2df00d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2deffff640 1 -- 172.21.15.52:0/711862674 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2df0155550 msgr2=0x7f2df00d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2deffff640 1 --2- 172.21.15.52:0/711862674 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2df0155550 0x7f2df00d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2deffff640 1 -- 172.21.15.52:0/711862674 >> v2:172.21.15.102:3300/0 conn(0x7f2df00cb9e0 msgr2=0x7f2df00d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2deffff640 1 --2- 172.21.15.52:0/711862674 >> v2:172.21.15.102:3300/0 conn(0x7f2df00cb9e0 0x7f2df00d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2deffff640 1 -- 172.21.15.52:0/711862674 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df00cd1e0 con 0x7f2df0155170 2024-04-25T13:16:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.553+0000 7f2df4f9b640 1 --2- 172.21.15.52:0/711862674 >> v2:172.21.15.102:3300/0 conn(0x7f2df00cb9e0 0x7f2df00d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:45.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.554+0000 7f2deffff640 1 --2- 172.21.15.52:0/711862674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0155170 0x7f2df015eef0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2df00cdd60 tx=0x7f2de002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41f1e873da193be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.554+0000 7f2deeffd640 1 -- 172.21.15.52:0/711862674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0037070 con 0x7f2df0155170 2024-04-25T13:16:45.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.554+0000 7f2deeffd640 1 -- 172.21.15.52:0/711862674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de0032440 con 0x7f2df0155170 2024-04-25T13:16:45.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.554+0000 7f2deeffd640 1 -- 172.21.15.52:0/711862674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0032810 con 0x7f2df0155170 2024-04-25T13:16:45.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.554+0000 7f2df69fe640 1 -- 172.21.15.52:0/711862674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0155170 msgr2=0x7f2df015eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.554+0000 7f2df69fe640 1 --2- 172.21.15.52:0/711862674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0155170 0x7f2df015eef0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2df00cdd60 tx=0x7f2de002a140 comp rx=0 tx=0).stop 2024-04-25T13:16:45.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.554+0000 7f2df69fe640 1 -- 172.21.15.52:0/711862674 shutdown_connections 2024-04-25T13:16:45.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.554+0000 7f2df69fe640 1 --2- 172.21.15.52:0/711862674 >> v2:172.21.15.102:3300/0 conn(0x7f2df00cb9e0 0x7f2df00d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.554+0000 7f2df69fe640 1 --2- 172.21.15.52:0/711862674 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2df0155550 0x7f2df00d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.554+0000 7f2df69fe640 1 --2- 172.21.15.52:0/711862674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0155170 0x7f2df015eef0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.554+0000 7f2df69fe640 1 -- 172.21.15.52:0/711862674 >> 172.21.15.52:0/711862674 conn(0x7f2df0072570 msgr2=0x7f2df0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:45.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.555+0000 7f2df69fe640 1 -- 172.21.15.52:0/711862674 shutdown_connections 2024-04-25T13:16:45.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.555+0000 7f2df69fe640 1 -- 172.21.15.52:0/711862674 wait complete. 2024-04-25T13:16:45.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.556+0000 7f2df69fe640 1 Processor -- start 2024-04-25T13:16:45.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.556+0000 7f2df69fe640 1 -- start start 2024-04-25T13:16:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.556+0000 7f2df69fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2df00cb9e0 0x7f2df00cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.556+0000 7f2df69fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2df0155170 0x7f2df014bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df69fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0155550 0x7f2df014c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df69fe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2df00cda80 con 0x7f2df0155550 2024-04-25T13:16:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df69fe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2df00cd7a0 con 0x7f2df00cb9e0 2024-04-25T13:16:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df69fe640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2df00ccae0 con 0x7f2df0155170 2024-04-25T13:16:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df4f9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0155550 0x7f2df014c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df4f9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0155550 0x7f2df014c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55342/0 (socket says 172.21.15.52:55342) 2024-04-25T13:16:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df4f9b640 1 -- 172.21.15.52:0/742900513 learned_addr learned my addr 172.21.15.52:0/742900513 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2def7fe640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2df0155170 0x7f2df014bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2deffff640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2df00cb9e0 0x7f2df00cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df4f9b640 1 -- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2df0155170 msgr2=0x7f2df014bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df4f9b640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2df0155170 0x7f2df014bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df4f9b640 1 -- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2df00cb9e0 msgr2=0x7f2df00cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df4f9b640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2df00cb9e0 0x7f2df00cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df4f9b640 1 -- 172.21.15.52:0/742900513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df014ef10 con 0x7f2df0155550 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df4f9b640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0155550 0x7f2df014c490 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2de800cf20 tx=0x7f2de800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2decff9640 1 -- 172.21.15.52:0/742900513 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de801a070 con 0x7f2df0155550 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2decff9640 1 -- 172.21.15.52:0/742900513 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de800d840 con 0x7f2df0155550 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2decff9640 1 -- 172.21.15.52:0/742900513 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de800dc30 con 0x7f2df0155550 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df69fe640 1 -- 172.21.15.52:0/742900513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df014cf60 con 0x7f2df0155550 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.557+0000 7f2df69fe640 1 -- 172.21.15.52:0/742900513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df014d520 con 0x7f2df0155550 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.558+0000 7f2df69fe640 1 -- 172.21.15.52:0/742900513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df0068e40 con 0x7f2df0155550 2024-04-25T13:16:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.559+0000 7f2decff9640 1 -- 172.21.15.52:0/742900513 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2de801d070 con 0x7f2df0155550 2024-04-25T13:16:45.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.559+0000 7f2decff9640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2ddc06c8f0 0x7f2ddc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:45.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.559+0000 7f2decff9640 1 -- 172.21.15.52:0/742900513 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2de808c6c0 con 0x7f2df0155550 2024-04-25T13:16:45.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.560+0000 7f2deffff640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2ddc06c8f0 0x7f2ddc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:45.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.560+0000 7f2deffff640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2ddc06c8f0 0x7f2ddc06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2de0034000 tx=0x7f2de002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:45.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.564+0000 7f2decff9640 1 -- 172.21.15.52:0/742900513 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2de805a0d0 con 0x7f2df0155550 2024-04-25T13:16:45.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.793+0000 7f2df69fe640 1 -- 172.21.15.52:0/742900513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2df00cc2b0 con 0x7f2df0155550 2024-04-25T13:16:45.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.793+0000 7f2decff9640 1 -- 172.21.15.52:0/742900513 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f2de805e3d0 con 0x7f2df0155550 2024-04-25T13:16:45.793 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:45.794 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T13:16:45.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.795+0000 7f2df69fe640 1 -- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2ddc06c8f0 msgr2=0x7f2ddc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.795+0000 7f2df69fe640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2ddc06c8f0 0x7f2ddc06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2de0034000 tx=0x7f2de002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:45.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.795+0000 7f2df69fe640 1 -- 172.21.15.52:0/742900513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0155550 msgr2=0x7f2df014c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:45.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.795+0000 7f2df69fe640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0155550 0x7f2df014c490 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2de800cf20 tx=0x7f2de800a7d0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.795+0000 7f2df69fe640 1 -- 172.21.15.52:0/742900513 shutdown_connections 2024-04-25T13:16:45.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.795+0000 7f2df69fe640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2ddc06c8f0 0x7f2ddc06edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.795+0000 7f2df69fe640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2df0155170 0x7f2df014bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.795+0000 7f2df69fe640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0155550 0x7f2df014c490 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.795+0000 7f2df69fe640 1 --2- 172.21.15.52:0/742900513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2df00cb9e0 0x7f2df00cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:45.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.796+0000 7f2df69fe640 1 -- 172.21.15.52:0/742900513 >> 172.21.15.52:0/742900513 conn(0x7f2df0072570 msgr2=0x7f2df00b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:45.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.796+0000 7f2df69fe640 1 -- 172.21.15.52:0/742900513 shutdown_connections 2024-04-25T13:16:45.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:45.796+0000 7f2df69fe640 1 -- 172.21.15.52:0/742900513 wait complete. 2024-04-25T13:16:48.808 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:16:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.907+0000 7fbf6bdf7640 1 Processor -- start 2024-04-25T13:16:48.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.907+0000 7fbf6bdf7640 1 -- start start 2024-04-25T13:16:48.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.908+0000 7fbf6bdf7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbf64153130 0x7fbf64073c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:48.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.908+0000 7fbf6bdf7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbf640ca940 0x7fbf640ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.908+0000 7fbf6bdf7640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf640c7690 con 0x7fbf640ceb40 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.908+0000 7fbf6bdf7640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbf64159c20 con 0x7fbf64153130 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.908+0000 7fbf6bdf7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbf64158d50 con 0x7fbf640ca940 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.908+0000 7fbf69b93640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbf64153130 0x7fbf64073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.908+0000 7fbf6a394640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbf640ceb40 0x7fbf6415c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47842/0 (socket says 172.21.15.52:47842) 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.908+0000 7fbf6a394640 1 -- 172.21.15.52:0/3978571267 learned_addr learned my addr 172.21.15.52:0/3978571267 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.908+0000 7fbf69392640 1 --2- 172.21.15.52:0/3978571267 >> v2:172.21.15.102:3300/0 conn(0x7fbf640ca940 0x7fbf640ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.908+0000 7fbf69b93640 1 -- 172.21.15.52:0/3978571267 >> v2:172.21.15.102:3300/0 conn(0x7fbf640ca940 msgr2=0x7fbf640ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.908+0000 7fbf69b93640 1 --2- 172.21.15.52:0/3978571267 >> v2:172.21.15.102:3300/0 conn(0x7fbf640ca940 0x7fbf640ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.908+0000 7fbf69b93640 1 -- 172.21.15.52:0/3978571267 >> v1:172.21.15.52:6789/0 conn(0x7fbf640ceb40 legacy=0x7fbf6415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.909+0000 7fbf68b91640 1 -- 172.21.15.52:0/3978571267 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319875580 0 0) 0x7fbf640c7690 con 0x7fbf640ceb40 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.909+0000 7fbf69b93640 1 -- 172.21.15.52:0/3978571267 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf64159010 con 0x7fbf64153130 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.909+0000 7fbf69392640 1 --2- 172.21.15.52:0/3978571267 >> v2:172.21.15.102:3300/0 conn(0x7fbf640ca940 0x7fbf640ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.909+0000 7fbf69b93640 1 --2- 172.21.15.52:0/3978571267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf64153130 0x7fbf64073c50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbf64068960 tx=0x7fbf5402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefde115ff9519a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.909+0000 7fbf68b91640 1 -- 172.21.15.52:0/3978571267 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54037070 con 0x7fbf64153130 2024-04-25T13:16:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.909+0000 7fbf68b91640 1 -- 172.21.15.52:0/3978571267 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf54032440 con 0x7fbf64153130 2024-04-25T13:16:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.909+0000 7fbf68b91640 1 -- 172.21.15.52:0/3978571267 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54032810 con 0x7fbf64153130 2024-04-25T13:16:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.910+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/3978571267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf64153130 msgr2=0x7fbf64073c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.910+0000 7fbf6bdf7640 1 --2- 172.21.15.52:0/3978571267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf64153130 0x7fbf64073c50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbf64068960 tx=0x7fbf5402a1a0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.910+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/3978571267 shutdown_connections 2024-04-25T13:16:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.910+0000 7fbf6bdf7640 1 --2- 172.21.15.52:0/3978571267 >> v2:172.21.15.102:3300/0 conn(0x7fbf640ca940 0x7fbf640ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.910+0000 7fbf6bdf7640 1 --2- 172.21.15.52:0/3978571267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf64153130 0x7fbf64073c50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.910+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/3978571267 >> 172.21.15.52:0/3978571267 conn(0x7fbf64074d50 msgr2=0x7fbf64075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.910+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/3978571267 shutdown_connections 2024-04-25T13:16:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.910+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/3978571267 wait complete. 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.911+0000 7fbf6bdf7640 1 Processor -- start 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.911+0000 7fbf6bdf7640 1 -- start start 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf6bdf7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf640ca940 0x7fbf64146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf6bdf7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf640ceb40 0x7fbf641f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf6bdf7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf64153130 0x7fbf6415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf6bdf7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf641598b0 con 0x7fbf640ca940 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf6bdf7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbf641595d0 con 0x7fbf64153130 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf6bdf7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbf64074190 con 0x7fbf640ceb40 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf69b93640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf640ca940 0x7fbf64146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf69b93640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf640ca940 0x7fbf64146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46558/0 (socket says 172.21.15.52:46558) 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf69b93640 1 -- 172.21.15.52:0/21845720 learned_addr learned my addr 172.21.15.52:0/21845720 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf6a394640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf64153130 0x7fbf6415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:48.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf69b93640 1 -- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf640ceb40 msgr2=0x7fbf641f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf69b93640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf640ceb40 0x7fbf641f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf69b93640 1 -- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf64153130 msgr2=0x7fbf6415ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf69b93640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf64153130 0x7fbf6415ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.912+0000 7fbf69b93640 1 -- 172.21.15.52:0/21845720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf641f4750 con 0x7fbf640ca940 2024-04-25T13:16:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.913+0000 7fbf69b93640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf640ca940 0x7fbf64146f80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbf5402a790 tx=0x7fbf540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.913+0000 7fbf5a7fc640 1 -- 172.21.15.52:0/21845720 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54037040 con 0x7fbf640ca940 2024-04-25T13:16:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.913+0000 7fbf5a7fc640 1 -- 172.21.15.52:0/21845720 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf54042070 con 0x7fbf640ca940 2024-04-25T13:16:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.913+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/21845720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf641f4a30 con 0x7fbf640ca940 2024-04-25T13:16:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.913+0000 7fbf5a7fc640 1 -- 172.21.15.52:0/21845720 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54030bb0 con 0x7fbf640ca940 2024-04-25T13:16:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.913+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/21845720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf641f4ff0 con 0x7fbf640ca940 2024-04-25T13:16:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.914+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/21845720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf64070690 con 0x7fbf640ca940 2024-04-25T13:16:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.914+0000 7fbf5a7fc640 1 -- 172.21.15.52:0/21845720 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf54047460 con 0x7fbf640ca940 2024-04-25T13:16:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.915+0000 7fbf5a7fc640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbf4806c8f0 0x7fbf4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.915+0000 7fbf5a7fc640 1 -- 172.21.15.52:0/21845720 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fbf540acc70 con 0x7fbf640ca940 2024-04-25T13:16:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.915+0000 7fbf69392640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbf4806c8f0 0x7fbf4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.915+0000 7fbf69392640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbf4806c8f0 0x7fbf4806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbf60006fd0 tx=0x7fbf60008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:48.919+0000 7fbf5a7fc640 1 -- 172.21.15.52:0/21845720 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf64070690 con 0x7fbf640ca940 2024-04-25T13:16:49.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.150+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/21845720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbf64070120 con 0x7fbf640ca940 2024-04-25T13:16:49.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.151+0000 7fbf5a7fc640 1 -- 172.21.15.52:0/21845720 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fbf64070120 con 0x7fbf640ca940 2024-04-25T13:16:49.151 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:49.151 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T13:16:49.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.153+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbf4806c8f0 msgr2=0x7fbf4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:49.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.153+0000 7fbf6bdf7640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbf4806c8f0 0x7fbf4806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbf60006fd0 tx=0x7fbf60008040 comp rx=0 tx=0).stop 2024-04-25T13:16:49.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.153+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/21845720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf640ca940 msgr2=0x7fbf64146f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:49.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.153+0000 7fbf6bdf7640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf640ca940 0x7fbf64146f80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbf5402a790 tx=0x7fbf540046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.153+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/21845720 shutdown_connections 2024-04-25T13:16:49.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.153+0000 7fbf6bdf7640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbf4806c8f0 0x7fbf4806edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.153+0000 7fbf6bdf7640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf640ceb40 0x7fbf641f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.153+0000 7fbf6bdf7640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf64153130 0x7fbf6415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.153+0000 7fbf6bdf7640 1 --2- 172.21.15.52:0/21845720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf640ca940 0x7fbf64146f80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.153+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/21845720 >> 172.21.15.52:0/21845720 conn(0x7fbf64074d50 msgr2=0x7fbf640c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:49.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.153+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/21845720 shutdown_connections 2024-04-25T13:16:49.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:49.153+0000 7fbf6bdf7640 1 -- 172.21.15.52:0/21845720 wait complete. 2024-04-25T13:16:51.121 INFO:tasks.ceph.mds.e.smithi052.stderr:2024-04-25T13:16:51.121+0000 7f78dc76d640 -1 quiesce.mds.0 failed to decode message of type 1286 v1: End of buffer [buffer:2] 2024-04-25T13:16:52.164 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:16:52.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.264+0000 7fbd47194640 1 Processor -- start 2024-04-25T13:16:52.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.264+0000 7fbd47194640 1 -- start start 2024-04-25T13:16:52.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.265+0000 7fbd47194640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbd400c5b80 0x7fbd4015bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.265+0000 7fbd47194640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd40158570 con 0x7fbd400c9610 2024-04-25T13:16:52.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.265+0000 7fbd47194640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd40158850 con 0x7fbd40151f10 2024-04-25T13:16:52.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.265+0000 7fbd47194640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbd4015b8a0 con 0x7fbd400c5b80 2024-04-25T13:16:52.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.265+0000 7fbd3ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbd400c5b80 0x7fbd4015bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.265+0000 7fbd45731640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbd400c9610 0x7fbd400ca560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47850/0 (socket says 172.21.15.52:47850) 2024-04-25T13:16:52.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.265+0000 7fbd45731640 1 -- 172.21.15.52:0/2215904283 learned_addr learned my addr 172.21.15.52:0/2215904283 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:52.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.265+0000 7fbd3ffff640 1 -- 172.21.15.52:0/2215904283 >> v1:172.21.15.102:6789/0 conn(0x7fbd40151f10 legacy=0x7fbd40157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:52.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.265+0000 7fbd3ffff640 1 -- 172.21.15.52:0/2215904283 >> v1:172.21.15.52:6789/0 conn(0x7fbd400c9610 legacy=0x7fbd400ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.265+0000 7fbd3ffff640 1 -- 172.21.15.52:0/2215904283 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd40158b30 con 0x7fbd400c5b80 2024-04-25T13:16:52.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.265+0000 7fbd3f7fe640 1 -- 172.21.15.52:0/2215904283 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275589326 0 0) 0x7fbd40158570 con 0x7fbd400c9610 2024-04-25T13:16:52.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.266+0000 7fbd3ffff640 1 --2- 172.21.15.52:0/2215904283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd400c5b80 0x7fbd4015bd30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0097a0 tx=0x7fbd2c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178ef9fbf94090a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.266+0000 7fbd3f7fe640 1 -- 172.21.15.52:0/2215904283 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c037070 con 0x7fbd400c5b80 2024-04-25T13:16:52.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.266+0000 7fbd3f7fe640 1 -- 172.21.15.52:0/2215904283 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2c032440 con 0x7fbd400c5b80 2024-04-25T13:16:52.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.266+0000 7fbd3f7fe640 1 -- 172.21.15.52:0/2215904283 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c032810 con 0x7fbd400c5b80 2024-04-25T13:16:52.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.267+0000 7fbd47194640 1 -- 172.21.15.52:0/2215904283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd400c5b80 msgr2=0x7fbd4015bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.267+0000 7fbd47194640 1 --2- 172.21.15.52:0/2215904283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd400c5b80 0x7fbd4015bd30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0097a0 tx=0x7fbd2c02a230 comp rx=0 tx=0).stop 2024-04-25T13:16:52.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.267+0000 7fbd47194640 1 -- 172.21.15.52:0/2215904283 shutdown_connections 2024-04-25T13:16:52.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.267+0000 7fbd47194640 1 --2- 172.21.15.52:0/2215904283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd400c5b80 0x7fbd4015bd30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.267+0000 7fbd47194640 1 -- 172.21.15.52:0/2215904283 >> 172.21.15.52:0/2215904283 conn(0x7fbd4006bd10 msgr2=0x7fbd4006c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:52.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.267+0000 7fbd47194640 1 -- 172.21.15.52:0/2215904283 shutdown_connections 2024-04-25T13:16:52.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.267+0000 7fbd47194640 1 -- 172.21.15.52:0/2215904283 wait complete. 2024-04-25T13:16:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.268+0000 7fbd47194640 1 Processor -- start 2024-04-25T13:16:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.268+0000 7fbd47194640 1 -- start start 2024-04-25T13:16:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd47194640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd400c5b80 0x7fbd40074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd47194640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd400c9610 0x7fbd401f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd47194640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd40151f10 0x7fbd401f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd47194640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbd400c7f80 con 0x7fbd400c5b80 2024-04-25T13:16:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd47194640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4015c270 con 0x7fbd400c9610 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd47194640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbd400c8100 con 0x7fbd40151f10 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd44f30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd400c5b80 0x7fbd40074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd44f30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd400c5b80 0x7fbd40074fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46566/0 (socket says 172.21.15.52:46566) 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd44f30640 1 -- 172.21.15.52:0/950805094 learned_addr learned my addr 172.21.15.52:0/950805094 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd3ffff640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd400c9610 0x7fbd401f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd45731640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd40151f10 0x7fbd401f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd44f30640 1 -- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd40151f10 msgr2=0x7fbd401f17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd44f30640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd40151f10 0x7fbd401f17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd44f30640 1 -- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd400c9610 msgr2=0x7fbd401f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd44f30640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd400c9610 0x7fbd401f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd44f30640 1 -- 172.21.15.52:0/950805094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd40157da0 con 0x7fbd400c5b80 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd3ffff640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd400c9610 0x7fbd401f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd45731640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd40151f10 0x7fbd401f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd44f30640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd400c5b80 0x7fbd40074fc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400c400 tx=0x7fbd3400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.269+0000 7fbd3d7fa640 1 -- 172.21.15.52:0/950805094 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34017070 con 0x7fbd400c5b80 2024-04-25T13:16:52.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.270+0000 7fbd3d7fa640 1 -- 172.21.15.52:0/950805094 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd340052d0 con 0x7fbd400c5b80 2024-04-25T13:16:52.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.270+0000 7fbd3d7fa640 1 -- 172.21.15.52:0/950805094 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34003830 con 0x7fbd400c5b80 2024-04-25T13:16:52.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.270+0000 7fbd47194640 1 -- 172.21.15.52:0/950805094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd40158080 con 0x7fbd400c5b80 2024-04-25T13:16:52.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.270+0000 7fbd47194640 1 -- 172.21.15.52:0/950805094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd400ce170 con 0x7fbd400c5b80 2024-04-25T13:16:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.271+0000 7fbd47194640 1 -- 172.21.15.52:0/950805094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd40068e40 con 0x7fbd400c5b80 2024-04-25T13:16:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.271+0000 7fbd3d7fa640 1 -- 172.21.15.52:0/950805094 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd3401a070 con 0x7fbd400c5b80 2024-04-25T13:16:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.272+0000 7fbd3d7fa640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbd2406c8f0 0x7fbd2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.272+0000 7fbd3d7fa640 1 -- 172.21.15.52:0/950805094 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fbd3408b2d0 con 0x7fbd400c5b80 2024-04-25T13:16:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.272+0000 7fbd3ffff640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbd2406c8f0 0x7fbd2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.272+0000 7fbd3ffff640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbd2406c8f0 0x7fbd2406edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c034000 tx=0x7fbd2c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.276+0000 7fbd3d7fa640 1 -- 172.21.15.52:0/950805094 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbd340592e0 con 0x7fbd400c5b80 2024-04-25T13:16:52.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.501+0000 7fbd47194640 1 -- 172.21.15.52:0/950805094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbd4014f430 con 0x7fbd400c5b80 2024-04-25T13:16:52.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.501+0000 7fbd3d7fa640 1 -- 172.21.15.52:0/950805094 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbd34058be0 con 0x7fbd400c5b80 2024-04-25T13:16:52.501 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:52.502 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T13:16:52.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.504+0000 7fbd47194640 1 -- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbd2406c8f0 msgr2=0x7fbd2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.504+0000 7fbd47194640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbd2406c8f0 0x7fbd2406edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c034000 tx=0x7fbd2c02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:52.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.504+0000 7fbd47194640 1 -- 172.21.15.52:0/950805094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd400c5b80 msgr2=0x7fbd40074fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.504+0000 7fbd47194640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd400c5b80 0x7fbd40074fc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400c400 tx=0x7fbd3400c8c0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.504+0000 7fbd47194640 1 -- 172.21.15.52:0/950805094 shutdown_connections 2024-04-25T13:16:52.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.504+0000 7fbd47194640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbd2406c8f0 0x7fbd2406edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.504+0000 7fbd47194640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd40151f10 0x7fbd401f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.504+0000 7fbd47194640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd400c9610 0x7fbd401f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.504+0000 7fbd47194640 1 --2- 172.21.15.52:0/950805094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd400c5b80 0x7fbd40074fc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.504+0000 7fbd47194640 1 -- 172.21.15.52:0/950805094 >> 172.21.15.52:0/950805094 conn(0x7fbd4006bd10 msgr2=0x7fbd4006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:52.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.504+0000 7fbd47194640 1 -- 172.21.15.52:0/950805094 shutdown_connections 2024-04-25T13:16:52.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.504+0000 7fbd47194640 1 -- 172.21.15.52:0/950805094 wait complete. 2024-04-25T13:16:52.518 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T13:16:52.518 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:52.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.618+0000 7fca1b891640 1 Processor -- start 2024-04-25T13:16:52.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.618+0000 7fca1b891640 1 -- start start 2024-04-25T13:16:52.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.619+0000 7fca1b891640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fca14151e70 0x7fca140cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.619+0000 7fca1b891640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca140ca610 0x7fca140cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.619+0000 7fca1b891640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca14157e60 con 0x7fca140c88f0 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.619+0000 7fca1b891640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fca14157c30 con 0x7fca14151e70 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.619+0000 7fca1b891640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fca14158100 con 0x7fca140ca610 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.619+0000 7fca18e2c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fca140c88f0 0x7fca14072250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47860/0 (socket says 172.21.15.52:47860) 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.619+0000 7fca18e2c640 1 -- 172.21.15.52:0/984210896 learned_addr learned my addr 172.21.15.52:0/984210896 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.619+0000 7fca19e2e640 1 --2- 172.21.15.52:0/984210896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca140ca610 0x7fca140cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.620+0000 7fca1962d640 1 --2- 172.21.15.52:0/984210896 >> v2:172.21.15.102:3300/0 conn(0x7fca14151e70 0x7fca140cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.620+0000 7fca0bfff640 1 -- 172.21.15.52:0/984210896 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777237862 0 0) 0x7fca14157e60 con 0x7fca140c88f0 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.620+0000 7fca0bfff640 1 -- 172.21.15.52:0/984210896 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca00003520 con 0x7fca140c88f0 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.620+0000 7fca0bfff640 1 -- 172.21.15.52:0/984210896 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 491114789 0 0) 0x7fca00003520 con 0x7fca140c88f0 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.620+0000 7fca19e2e640 1 -- 172.21.15.52:0/984210896 >> v2:172.21.15.102:3300/0 conn(0x7fca14151e70 msgr2=0x7fca140cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.620+0000 7fca19e2e640 1 --2- 172.21.15.52:0/984210896 >> v2:172.21.15.102:3300/0 conn(0x7fca14151e70 0x7fca140cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.620+0000 7fca19e2e640 1 -- 172.21.15.52:0/984210896 >> v1:172.21.15.52:6789/0 conn(0x7fca140c88f0 legacy=0x7fca14072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.620+0000 7fca19e2e640 1 -- 172.21.15.52:0/984210896 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca141583a0 con 0x7fca140ca610 2024-04-25T13:16:52.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.620+0000 7fca1962d640 1 --2- 172.21.15.52:0/984210896 >> v2:172.21.15.102:3300/0 conn(0x7fca14151e70 0x7fca140cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:52.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.621+0000 7fca19e2e640 1 --2- 172.21.15.52:0/984210896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca140ca610 0x7fca140cddd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009d90 tx=0x7fca0c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5615ce5c0b25a52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.621+0000 7fca0bfff640 1 -- 172.21.15.52:0/984210896 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10001670 con 0x7fca140ca610 2024-04-25T13:16:52.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.621+0000 7fca0bfff640 1 -- 172.21.15.52:0/984210896 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0c007540 con 0x7fca140ca610 2024-04-25T13:16:52.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.621+0000 7fca0bfff640 1 -- 172.21.15.52:0/984210896 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c007910 con 0x7fca140ca610 2024-04-25T13:16:52.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.622+0000 7fca1b891640 1 -- 172.21.15.52:0/984210896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca140ca610 msgr2=0x7fca140cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.622+0000 7fca1b891640 1 --2- 172.21.15.52:0/984210896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca140ca610 0x7fca140cddd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009d90 tx=0x7fca0c02a5f0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.622+0000 7fca1b891640 1 -- 172.21.15.52:0/984210896 shutdown_connections 2024-04-25T13:16:52.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.622+0000 7fca1b891640 1 --2- 172.21.15.52:0/984210896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca140ca610 0x7fca140cddd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.622+0000 7fca1b891640 1 --2- 172.21.15.52:0/984210896 >> v2:172.21.15.102:3300/0 conn(0x7fca14151e70 0x7fca140cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.622+0000 7fca1b891640 1 -- 172.21.15.52:0/984210896 >> 172.21.15.52:0/984210896 conn(0x7fca1406b920 msgr2=0x7fca1406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:52.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.622+0000 7fca1b891640 1 -- 172.21.15.52:0/984210896 shutdown_connections 2024-04-25T13:16:52.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.622+0000 7fca1b891640 1 -- 172.21.15.52:0/984210896 wait complete. 2024-04-25T13:16:52.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.623+0000 7fca1b891640 1 Processor -- start 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.623+0000 7fca1b891640 1 -- start start 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca1b891640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca140c88f0 0x7fca141507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca1b891640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca140ca610 0x7fca141eec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca1b891640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca14151e70 0x7fca141e4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca1b891640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca14152250 con 0x7fca140ca610 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca1b891640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fca14158920 con 0x7fca14151e70 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca1b891640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fca141523d0 con 0x7fca140c88f0 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca18e2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca140ca610 0x7fca141eec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca18e2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca140ca610 0x7fca141eec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46570/0 (socket says 172.21.15.52:46570) 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca18e2c640 1 -- 172.21.15.52:0/1912774613 learned_addr learned my addr 172.21.15.52:0/1912774613 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca1962d640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca140c88f0 0x7fca141507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca19e2e640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca14151e70 0x7fca141e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca18e2c640 1 -- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca140c88f0 msgr2=0x7fca141507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca18e2c640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca140c88f0 0x7fca141507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca18e2c640 1 -- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca14151e70 msgr2=0x7fca141e4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca18e2c640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca14151e70 0x7fca141e4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca18e2c640 1 -- 172.21.15.52:0/1912774613 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca141f2210 con 0x7fca140ca610 2024-04-25T13:16:52.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca19e2e640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca14151e70 0x7fca141e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:52.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca18e2c640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca140ca610 0x7fca141eec00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c780 tx=0x7fca1000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.624+0000 7fca09ffb640 1 -- 172.21.15.52:0/1912774613 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10017070 con 0x7fca140ca610 2024-04-25T13:16:52.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.625+0000 7fca09ffb640 1 -- 172.21.15.52:0/1912774613 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10005ad0 con 0x7fca140ca610 2024-04-25T13:16:52.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.625+0000 7fca1b891640 1 -- 172.21.15.52:0/1912774613 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca14159210 con 0x7fca140ca610 2024-04-25T13:16:52.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.625+0000 7fca09ffb640 1 -- 172.21.15.52:0/1912774613 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10007070 con 0x7fca140ca610 2024-04-25T13:16:52.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.625+0000 7fca1b891640 1 -- 172.21.15.52:0/1912774613 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca141f2a70 con 0x7fca140ca610 2024-04-25T13:16:52.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.626+0000 7fca1b891640 1 -- 172.21.15.52:0/1912774613 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca14068e40 con 0x7fca140ca610 2024-04-25T13:16:52.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.626+0000 7fca09ffb640 1 -- 172.21.15.52:0/1912774613 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca1001a070 con 0x7fca140ca610 2024-04-25T13:16:52.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.627+0000 7fca09ffb640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc9f806c920 0x7fc9f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.627+0000 7fca09ffb640 1 -- 172.21.15.52:0/1912774613 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fca1008b400 con 0x7fca140ca610 2024-04-25T13:16:52.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.627+0000 7fca1962d640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc9f806c920 0x7fc9f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.627+0000 7fca1962d640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc9f806c920 0x7fc9f806ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fca04009560 tx=0x7fca04009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.631+0000 7fca09ffb640 1 -- 172.21.15.52:0/1912774613 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fca10058dc0 con 0x7fca140ca610 2024-04-25T13:16:52.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.817+0000 7fca1b891640 1 -- 172.21.15.52:0/1912774613 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca140c91d0 con 0x7fca140ca610 2024-04-25T13:16:52.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.818+0000 7fca09ffb640 1 -- 172.21.15.52:0/1912774613 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18927 (secure 0 0 0) 0x7fca1005d0c0 con 0x7fca140ca610 2024-04-25T13:16:52.819 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:52.819 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:49.125761+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:52.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.821+0000 7fca1b891640 1 -- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc9f806c920 msgr2=0x7fc9f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.821+0000 7fca1b891640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc9f806c920 0x7fc9f806ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fca04009560 tx=0x7fca04009190 comp rx=0 tx=0).stop 2024-04-25T13:16:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.821+0000 7fca1b891640 1 -- 172.21.15.52:0/1912774613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca140ca610 msgr2=0x7fca141eec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.821+0000 7fca1b891640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca140ca610 0x7fca141eec00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c780 tx=0x7fca1000cc40 comp rx=0 tx=0).stop 2024-04-25T13:16:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.821+0000 7fca1b891640 1 -- 172.21.15.52:0/1912774613 shutdown_connections 2024-04-25T13:16:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.821+0000 7fca1b891640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc9f806c920 0x7fc9f806ede0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.821+0000 7fca1b891640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca14151e70 0x7fca141e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.821+0000 7fca1b891640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca140ca610 0x7fca141eec00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.821+0000 7fca1b891640 1 --2- 172.21.15.52:0/1912774613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca140c88f0 0x7fca141507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.821+0000 7fca1b891640 1 -- 172.21.15.52:0/1912774613 >> 172.21.15.52:0/1912774613 conn(0x7fca1406b920 msgr2=0x7fca14073b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.821+0000 7fca1b891640 1 -- 172.21.15.52:0/1912774613 shutdown_connections 2024-04-25T13:16:52.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.821+0000 7fca1b891640 1 -- 172.21.15.52:0/1912774613 wait complete. 2024-04-25T13:16:52.832 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.833544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:05.935596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:06.297991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:10.015464+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:16:52.833 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:52.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.936+0000 7fbc60f08640 1 Processor -- start 2024-04-25T13:16:52.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.936+0000 7fbc60f08640 1 -- start start 2024-04-25T13:16:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.937+0000 7fbc60f08640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbc5c074fc0 0x7fbc5c06ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.937+0000 7fbc60f08640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc5c0753a0 0x7fbc5c15cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.937+0000 7fbc60f08640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc5c0c6e60 con 0x7fbc5c070820 2024-04-25T13:16:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.937+0000 7fbc60f08640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbc5c158eb0 con 0x7fbc5c074fc0 2024-04-25T13:16:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.937+0000 7fbc60f08640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5c0c7140 con 0x7fbc5c0753a0 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.937+0000 7fbc5ad9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbc5c070820 0x7fbc5c152cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47868/0 (socket says 172.21.15.52:47868) 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.937+0000 7fbc5ad9d640 1 -- 172.21.15.52:0/2078460707 learned_addr learned my addr 172.21.15.52:0/2078460707 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.937+0000 7fbc59d9b640 1 --2- 172.21.15.52:0/2078460707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc5c0753a0 0x7fbc5c15cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.937+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397520701 0 0) 0x7fbc5c0c6e60 con 0x7fbc5c070820 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.937+0000 7fbc5a59c640 1 --2- 172.21.15.52:0/2078460707 >> v2:172.21.15.102:3300/0 conn(0x7fbc5c074fc0 0x7fbc5c06ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.937+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc48003520 con 0x7fbc5c070820 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 904063715 0 0) 0x7fbc48003520 con 0x7fbc5c070820 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc5c0753a0 msgr2=0x7fbc5c15cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 --2- 172.21.15.52:0/2078460707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc5c0753a0 0x7fbc5c15cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 >> v2:172.21.15.102:3300/0 conn(0x7fbc5c074fc0 msgr2=0x7fbc5c06ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 --2- 172.21.15.52:0/2078460707 >> v2:172.21.15.102:3300/0 conn(0x7fbc5c074fc0 0x7fbc5c06ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c0c7420 con 0x7fbc5c070820 2024-04-25T13:16:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7fbc540019f0 con 0x7fbc5c070820 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 >> v1:172.21.15.52:6789/0 conn(0x7fbc5c070820 legacy=0x7fbc5c152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 --2- 172.21.15.52:0/2078460707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc480039b0 0x7fbc48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 --2- 172.21.15.52:0/2078460707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc48004800 0x7fbc48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 --2- 172.21.15.52:0/2078460707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc5c0753a0 0x7fbc480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c0c7140 con 0x7fbc480039b0 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4800b9c0 con 0x7fbc48004800 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4800bb40 con 0x7fbc5c0753a0 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5a59c640 1 --2- 172.21.15.52:0/2078460707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc480039b0 0x7fbc48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc59d9b640 1 --2- 172.21.15.52:0/2078460707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc48004800 0x7fbc48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5ad9d640 1 --2- 172.21.15.52:0/2078460707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc5c0753a0 0x7fbc480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5a59c640 1 -- 172.21.15.52:0/2078460707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc5c0753a0 msgr2=0x7fbc480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5a59c640 1 --2- 172.21.15.52:0/2078460707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc5c0753a0 0x7fbc480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5a59c640 1 -- 172.21.15.52:0/2078460707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc48004800 msgr2=0x7fbc48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5a59c640 1 --2- 172.21.15.52:0/2078460707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc48004800 0x7fbc48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.938+0000 7fbc5a59c640 1 -- 172.21.15.52:0/2078460707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc48003520 con 0x7fbc480039b0 2024-04-25T13:16:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.939+0000 7fbc5a59c640 1 --2- 172.21.15.52:0/2078460707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc480039b0 0x7fbc48003dd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009af0 tx=0x7fbc48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642a91c9bce9efbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.939+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44036070 con 0x7fbc480039b0 2024-04-25T13:16:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.939+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc44031400 con 0x7fbc480039b0 2024-04-25T13:16:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.939+0000 7fbc5959a640 1 -- 172.21.15.52:0/2078460707 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44009690 con 0x7fbc480039b0 2024-04-25T13:16:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.939+0000 7fbc60f08640 1 -- 172.21.15.52:0/2078460707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc480039b0 msgr2=0x7fbc48003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.939+0000 7fbc60f08640 1 --2- 172.21.15.52:0/2078460707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc480039b0 0x7fbc48003dd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009af0 tx=0x7fbc48005830 comp rx=0 tx=0).stop 2024-04-25T13:16:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.940+0000 7fbc5ad9d640 1 -- 172.21.15.52:0/2078460707 reap_dead start 2024-04-25T13:16:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.940+0000 7fbc60f08640 1 -- 172.21.15.52:0/2078460707 shutdown_connections 2024-04-25T13:16:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.940+0000 7fbc60f08640 1 -- 172.21.15.52:0/2078460707 >> 172.21.15.52:0/2078460707 conn(0x7fbc5c06b920 msgr2=0x7fbc5c06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.940+0000 7fbc60f08640 1 -- 172.21.15.52:0/2078460707 shutdown_connections 2024-04-25T13:16:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.940+0000 7fbc60f08640 1 -- 172.21.15.52:0/2078460707 wait complete. 2024-04-25T13:16:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.941+0000 7fbc60f08640 1 Processor -- start 2024-04-25T13:16:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.941+0000 7fbc60f08640 1 -- start start 2024-04-25T13:16:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc60f08640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc480039b0 0x7fbc5c1e2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc60f08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5c073310 0x7fbc5c151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc60f08640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc5c1e17e0 0x7fbc5c152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc60f08640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c070510 con 0x7fbc5c073310 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc60f08640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c15c640 con 0x7fbc5c1e17e0 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc60f08640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5c0c6a70 con 0x7fbc480039b0 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc59d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5c073310 0x7fbc5c151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc59d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5c073310 0x7fbc5c151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46582/0 (socket says 172.21.15.52:46582) 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc59d9b640 1 -- 172.21.15.52:0/1966312455 learned_addr learned my addr 172.21.15.52:0/1966312455 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc5ad9d640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc5c1e17e0 0x7fbc5c152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc5a59c640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc480039b0 0x7fbc5c1e2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc59d9b640 1 -- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc480039b0 msgr2=0x7fbc5c1e2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc59d9b640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc480039b0 0x7fbc5c1e2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc59d9b640 1 -- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc5c1e17e0 msgr2=0x7fbc5c152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc59d9b640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc5c1e17e0 0x7fbc5c152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc59d9b640 1 -- 172.21.15.52:0/1966312455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c073b10 con 0x7fbc5c073310 2024-04-25T13:16:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.942+0000 7fbc59d9b640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5c073310 0x7fbc5c151d30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0119d0 tx=0x7fbc4c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.943+0000 7fbc52ffd640 1 -- 172.21.15.52:0/1966312455 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00fb50 con 0x7fbc5c073310 2024-04-25T13:16:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.943+0000 7fbc52ffd640 1 -- 172.21.15.52:0/1966312455 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4c00fcf0 con 0x7fbc5c073310 2024-04-25T13:16:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.943+0000 7fbc60f08640 1 -- 172.21.15.52:0/1966312455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5c15bc50 con 0x7fbc5c073310 2024-04-25T13:16:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.943+0000 7fbc52ffd640 1 -- 172.21.15.52:0/1966312455 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00fea0 con 0x7fbc5c073310 2024-04-25T13:16:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.943+0000 7fbc60f08640 1 -- 172.21.15.52:0/1966312455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc5c15c210 con 0x7fbc5c073310 2024-04-25T13:16:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.944+0000 7fbc60f08640 1 -- 172.21.15.52:0/1966312455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc5c068f50 con 0x7fbc5c073310 2024-04-25T13:16:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.944+0000 7fbc52ffd640 1 -- 172.21.15.52:0/1966312455 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc4c012040 con 0x7fbc5c073310 2024-04-25T13:16:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.945+0000 7fbc52ffd640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbc3c06c920 0x7fbc3c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.945+0000 7fbc52ffd640 1 -- 172.21.15.52:0/1966312455 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fbc4c08c4b0 con 0x7fbc5c073310 2024-04-25T13:16:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.945+0000 7fbc5a59c640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbc3c06c920 0x7fbc3c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.946+0000 7fbc5a59c640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbc3c06c920 0x7fbc3c06ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbc44033000 tx=0x7fbc44008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:52.949+0000 7fbc52ffd640 1 -- 172.21.15.52:0/1966312455 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbc4c019030 con 0x7fbc5c073310 2024-04-25T13:16:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.136+0000 7fbc60f08640 1 -- 172.21.15.52:0/1966312455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbc5c0cc770 con 0x7fbc5c073310 2024-04-25T13:16:53.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.136+0000 7fbc52ffd640 1 -- 172.21.15.52:0/1966312455 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fbc4c059f00 con 0x7fbc5c073310 2024-04-25T13:16:53.137 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T13:16:53.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.138+0000 7fbc60f08640 1 -- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbc3c06c920 msgr2=0x7fbc3c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.138+0000 7fbc60f08640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbc3c06c920 0x7fbc3c06ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbc44033000 tx=0x7fbc44008030 comp rx=0 tx=0).stop 2024-04-25T13:16:53.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.138+0000 7fbc60f08640 1 -- 172.21.15.52:0/1966312455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5c073310 msgr2=0x7fbc5c151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.138+0000 7fbc60f08640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5c073310 0x7fbc5c151d30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0119d0 tx=0x7fbc4c011e90 comp rx=0 tx=0).stop 2024-04-25T13:16:53.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.138+0000 7fbc60f08640 1 -- 172.21.15.52:0/1966312455 shutdown_connections 2024-04-25T13:16:53.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.138+0000 7fbc60f08640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbc3c06c920 0x7fbc3c06ede0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.138+0000 7fbc60f08640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc5c1e17e0 0x7fbc5c152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.138+0000 7fbc60f08640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5c073310 0x7fbc5c151d30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.138+0000 7fbc60f08640 1 --2- 172.21.15.52:0/1966312455 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc480039b0 0x7fbc5c1e2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.138+0000 7fbc60f08640 1 -- 172.21.15.52:0/1966312455 >> 172.21.15.52:0/1966312455 conn(0x7fbc5c06b920 msgr2=0x7fbc5c0ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.138+0000 7fbc60f08640 1 -- 172.21.15.52:0/1966312455 shutdown_connections 2024-04-25T13:16:53.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.138+0000 7fbc60f08640 1 -- 172.21.15.52:0/1966312455 wait complete. 2024-04-25T13:16:53.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:16:53.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.253+0000 7fbf55344640 1 Processor -- start 2024-04-25T13:16:53.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.253+0000 7fbf55344640 1 -- start start 2024-04-25T13:16:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.254+0000 7fbf55344640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbf50155130 0x7fbf500cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.254+0000 7fbf55344640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf500cb910 0x7fbf5015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.254+0000 7fbf55344640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf5015f3f0 con 0x7fbf5015ef60 2024-04-25T13:16:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.254+0000 7fbf55344640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbf5015e590 con 0x7fbf50155130 2024-04-25T13:16:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.254+0000 7fbf55344640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbf50071c40 con 0x7fbf500cb910 2024-04-25T13:16:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.254+0000 7fbf4effd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbf50155130 0x7fbf500cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.254+0000 7fbf4e7fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf500cb910 0x7fbf5015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.254+0000 7fbf4effd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbf50155130 0x7fbf500cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:52092/0 (socket says 172.21.15.52:52092) 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.254+0000 7fbf4e7fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf500cb910 0x7fbf5015ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:41878/0 (socket says 172.21.15.52:41878) 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.254+0000 7fbf4effd640 1 -- 172.21.15.52:0/4110167291 learned_addr learned my addr 172.21.15.52:0/4110167291 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.254+0000 7fbf4f7fe640 1 --1- 172.21.15.52:0/4110167291 >> v1:172.21.15.102:6789/0 conn(0x7fbf5015ef60 0x7fbf5006b920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:46674/0 (socket says 172.21.15.52:46674) 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.255+0000 7fbf4effd640 1 -- 172.21.15.52:0/4110167291 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf500cb910 msgr2=0x7fbf5015ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.255+0000 7fbf4effd640 1 --2- 172.21.15.52:0/4110167291 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf500cb910 0x7fbf5015ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.255+0000 7fbf4effd640 1 -- 172.21.15.52:0/4110167291 >> v1:172.21.15.102:6789/0 conn(0x7fbf5015ef60 legacy=0x7fbf5006b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.255+0000 7fbf4effd640 1 -- 172.21.15.52:0/4110167291 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5015afa0 con 0x7fbf50155130 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.255+0000 7fbf4e7fc640 1 --2- 172.21.15.52:0/4110167291 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf500cb910 0x7fbf5015ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.256+0000 7fbf4effd640 1 --2- 172.21.15.52:0/4110167291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf50155130 0x7fbf500cb3d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009870 tx=0x7fbf3802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbbfd36c0ea6c2b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.256+0000 7fbf4dffb640 1 -- 172.21.15.52:0/4110167291 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38037070 con 0x7fbf50155130 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.256+0000 7fbf4dffb640 1 -- 172.21.15.52:0/4110167291 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3802ae50 con 0x7fbf50155130 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.256+0000 7fbf4dffb640 1 -- 172.21.15.52:0/4110167291 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38032860 con 0x7fbf50155130 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.256+0000 7fbf55344640 1 -- 172.21.15.52:0/4110167291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf50155130 msgr2=0x7fbf500cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.256+0000 7fbf55344640 1 --2- 172.21.15.52:0/4110167291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf50155130 0x7fbf500cb3d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009870 tx=0x7fbf3802a300 comp rx=0 tx=0).stop 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.256+0000 7fbf55344640 1 -- 172.21.15.52:0/4110167291 shutdown_connections 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.256+0000 7fbf55344640 1 --2- 172.21.15.52:0/4110167291 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf500cb910 0x7fbf5015ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.256+0000 7fbf55344640 1 --2- 172.21.15.52:0/4110167291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf50155130 0x7fbf500cb3d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.256+0000 7fbf55344640 1 -- 172.21.15.52:0/4110167291 >> 172.21.15.52:0/4110167291 conn(0x7fbf50074f30 msgr2=0x7fbf50075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.257+0000 7fbf55344640 1 -- 172.21.15.52:0/4110167291 shutdown_connections 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.257+0000 7fbf55344640 1 -- 172.21.15.52:0/4110167291 wait complete. 2024-04-25T13:16:53.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.258+0000 7fbf55344640 1 Processor -- start 2024-04-25T13:16:53.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.258+0000 7fbf55344640 1 -- start start 2024-04-25T13:16:53.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf55344640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf500cb910 0x7fbf500c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf55344640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf50155130 0x7fbf5014af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf55344640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf5015ef60 0x7fbf5014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf55344640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5015b820 con 0x7fbf500cb910 2024-04-25T13:16:53.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf55344640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5015b540 con 0x7fbf50155130 2024-04-25T13:16:53.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf55344640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5015bb00 con 0x7fbf5015ef60 2024-04-25T13:16:53.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf4effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf500cb910 0x7fbf500c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf4effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf500cb910 0x7fbf500c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46586/0 (socket says 172.21.15.52:46586) 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf4effd640 1 -- 172.21.15.52:0/3295791626 learned_addr learned my addr 172.21.15.52:0/3295791626 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf4e7fc640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf50155130 0x7fbf5014af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf4f7fe640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf5015ef60 0x7fbf5014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf4effd640 1 -- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf5015ef60 msgr2=0x7fbf5014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf4effd640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf5015ef60 0x7fbf5014b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf4effd640 1 -- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf50155130 msgr2=0x7fbf5014af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf4effd640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf50155130 0x7fbf5014af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf4effd640 1 -- 172.21.15.52:0/3295791626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf500c5a80 con 0x7fbf500cb910 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf4f7fe640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf5015ef60 0x7fbf5014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf4effd640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf500cb910 0x7fbf500c7bd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbf38000c00 tx=0x7fbf380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf477fe640 1 -- 172.21.15.52:0/3295791626 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38041020 con 0x7fbf500cb910 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf477fe640 1 -- 172.21.15.52:0/3295791626 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3803c870 con 0x7fbf500cb910 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf477fe640 1 -- 172.21.15.52:0/3295791626 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38037040 con 0x7fbf500cb910 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.260+0000 7fbf55344640 1 -- 172.21.15.52:0/3295791626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf500c5d60 con 0x7fbf500cb910 2024-04-25T13:16:53.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.261+0000 7fbf55344640 1 -- 172.21.15.52:0/3295791626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf500c73d0 con 0x7fbf500cb910 2024-04-25T13:16:53.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.261+0000 7fbf55344640 1 -- 172.21.15.52:0/3295791626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf50068e40 con 0x7fbf500cb910 2024-04-25T13:16:53.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.262+0000 7fbf477fe640 1 -- 172.21.15.52:0/3295791626 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf38044020 con 0x7fbf500cb910 2024-04-25T13:16:53.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.262+0000 7fbf477fe640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbf3006c8f0 0x7fbf3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.262+0000 7fbf477fe640 1 -- 172.21.15.52:0/3295791626 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fbf380ac740 con 0x7fbf500cb910 2024-04-25T13:16:53.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.263+0000 7fbf4e7fc640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbf3006c8f0 0x7fbf3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.263+0000 7fbf4e7fc640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbf3006c8f0 0x7fbf3006edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf40009560 tx=0x7fbf40009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.267+0000 7fbf477fe640 1 -- 172.21.15.52:0/3295791626 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf3804b030 con 0x7fbf500cb910 2024-04-25T13:16:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.450+0000 7fbf55344640 1 -- 172.21.15.52:0/3295791626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbf50159200 con 0x7fbf500cb910 2024-04-25T13:16:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.451+0000 7fbf477fe640 1 -- 172.21.15.52:0/3295791626 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fbf3807a7e0 con 0x7fbf500cb910 2024-04-25T13:16:53.451 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T13:16:53.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.453+0000 7fbf55344640 1 -- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbf3006c8f0 msgr2=0x7fbf3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.453+0000 7fbf55344640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbf3006c8f0 0x7fbf3006edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf40009560 tx=0x7fbf40009190 comp rx=0 tx=0).stop 2024-04-25T13:16:53.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.453+0000 7fbf55344640 1 -- 172.21.15.52:0/3295791626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf500cb910 msgr2=0x7fbf500c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.453+0000 7fbf55344640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf500cb910 0x7fbf500c7bd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbf38000c00 tx=0x7fbf380046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.453+0000 7fbf55344640 1 -- 172.21.15.52:0/3295791626 shutdown_connections 2024-04-25T13:16:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.453+0000 7fbf55344640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fbf3006c8f0 0x7fbf3006edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.453+0000 7fbf55344640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbf5015ef60 0x7fbf5014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.453+0000 7fbf55344640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf50155130 0x7fbf5014af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.453+0000 7fbf55344640 1 --2- 172.21.15.52:0/3295791626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf500cb910 0x7fbf500c7bd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.453+0000 7fbf55344640 1 -- 172.21.15.52:0/3295791626 >> 172.21.15.52:0/3295791626 conn(0x7fbf50074f30 msgr2=0x7fbf500ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.453+0000 7fbf55344640 1 -- 172.21.15.52:0/3295791626 shutdown_connections 2024-04-25T13:16:53.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.453+0000 7fbf55344640 1 -- 172.21.15.52:0/3295791626 wait complete. 2024-04-25T13:16:53.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:16:53.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.566+0000 7f8a24859640 1 Processor -- start 2024-04-25T13:16:53.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.566+0000 7f8a24859640 1 -- start start 2024-04-25T13:16:53.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.567+0000 7f8a24859640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a201553c0 0x7f8a2015edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.567+0000 7f8a24859640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8a2015b070 0x7f8a200d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.567+0000 7f8a24859640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a200c5c80 con 0x7f8a2015f310 2024-04-25T13:16:53.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.567+0000 7f8a24859640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8a2015e660 con 0x7f8a2015b070 2024-04-25T13:16:53.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.567+0000 7f8a24859640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8a201557a0 con 0x7f8a201553c0 2024-04-25T13:16:53.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.567+0000 7f8a1ed9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8a2015b070 0x7f8a200d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.567+0000 7f8a1ed9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8a2015b070 0x7f8a200d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46600/0 (socket says 172.21.15.52:46600) 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.567+0000 7f8a1ed9d640 1 -- 172.21.15.52:0/829915305 learned_addr learned my addr 172.21.15.52:0/829915305 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.568+0000 7f8a1e59c640 1 --2- 172.21.15.52:0/829915305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a201553c0 0x7f8a2015edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.568+0000 7f8a1ed9d640 1 -- 172.21.15.52:0/829915305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a201553c0 msgr2=0x7f8a2015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.568+0000 7f8a1ed9d640 1 --2- 172.21.15.52:0/829915305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a201553c0 0x7f8a2015edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.568+0000 7f8a1ed9d640 1 -- 172.21.15.52:0/829915305 >> v1:172.21.15.102:6789/0 conn(0x7f8a2015f310 legacy=0x7f8a200cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.568+0000 7f8a1ed9d640 1 -- 172.21.15.52:0/829915305 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2015b5d0 con 0x7f8a2015b070 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.568+0000 7f8a1e59c640 1 --2- 172.21.15.52:0/829915305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a201553c0 0x7f8a2015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.568+0000 7f8a1ed9d640 1 --2- 172.21.15.52:0/829915305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2015b070 0x7f8a200d0820 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8a2015e7e0 tx=0x7f8a1802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b505251cf57d5841 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.569+0000 7f8a1d59a640 1 -- 172.21.15.52:0/829915305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18036070 con 0x7f8a2015b070 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.569+0000 7f8a1d59a640 1 -- 172.21.15.52:0/829915305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a18031600 con 0x7f8a2015b070 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.569+0000 7f8a1d59a640 1 -- 172.21.15.52:0/829915305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a180319d0 con 0x7f8a2015b070 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.569+0000 7f8a24859640 1 -- 172.21.15.52:0/829915305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2015b070 msgr2=0x7f8a200d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.569+0000 7f8a24859640 1 --2- 172.21.15.52:0/829915305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2015b070 0x7f8a200d0820 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8a2015e7e0 tx=0x7f8a1802a680 comp rx=0 tx=0).stop 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.569+0000 7f8a24859640 1 -- 172.21.15.52:0/829915305 shutdown_connections 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.569+0000 7f8a24859640 1 --2- 172.21.15.52:0/829915305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a2015b070 0x7f8a200d0820 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.569+0000 7f8a24859640 1 --2- 172.21.15.52:0/829915305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a201553c0 0x7f8a2015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.569+0000 7f8a24859640 1 -- 172.21.15.52:0/829915305 >> 172.21.15.52:0/829915305 conn(0x7f8a20072360 msgr2=0x7f8a20074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.569+0000 7f8a24859640 1 -- 172.21.15.52:0/829915305 shutdown_connections 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.569+0000 7f8a24859640 1 -- 172.21.15.52:0/829915305 wait complete. 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.571+0000 7f8a24859640 1 Processor -- start 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.571+0000 7f8a24859640 1 -- start start 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.571+0000 7f8a24859640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a201553c0 0x7f8a200cf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.571+0000 7f8a24859640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a2015b070 0x7f8a201f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.571+0000 7f8a24859640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a2015f310 0x7f8a2014b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.571+0000 7f8a24859640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2015be70 con 0x7f8a201553c0 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.571+0000 7f8a24859640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2015bb90 con 0x7f8a2015f310 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.571+0000 7f8a24859640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2015e8b0 con 0x7f8a2015b070 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.571+0000 7f8a1e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a201553c0 0x7f8a200cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.571+0000 7f8a1e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a201553c0 0x7f8a200cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46604/0 (socket says 172.21.15.52:46604) 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.571+0000 7f8a1e59c640 1 -- 172.21.15.52:0/3974218627 learned_addr learned my addr 172.21.15.52:0/3974218627 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a1dd9b640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a2015b070 0x7f8a201f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a1ed9d640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a2015f310 0x7f8a2014b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a1e59c640 1 -- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a2015b070 msgr2=0x7f8a201f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a1e59c640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a2015b070 0x7f8a201f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a1e59c640 1 -- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a2015f310 msgr2=0x7f8a2014b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a1e59c640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a2015f310 0x7f8a2014b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a1e59c640 1 -- 172.21.15.52:0/3974218627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a201e72d0 con 0x7f8a201553c0 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a1e59c640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a201553c0 0x7f8a200cf730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400c7f0 tx=0x7f8a1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a0effd640 1 -- 172.21.15.52:0/3974218627 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14004220 con 0x7f8a201553c0 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a0effd640 1 -- 172.21.15.52:0/3974218627 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a140043c0 con 0x7f8a201553c0 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a24859640 1 -- 172.21.15.52:0/3974218627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a200cf450 con 0x7f8a201553c0 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a0effd640 1 -- 172.21.15.52:0/3974218627 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14005bb0 con 0x7f8a201553c0 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.572+0000 7f8a24859640 1 -- 172.21.15.52:0/3974218627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a201f1520 con 0x7f8a201553c0 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.573+0000 7f8a24859640 1 -- 172.21.15.52:0/3974218627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a20068f50 con 0x7f8a201553c0 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.574+0000 7f8a0effd640 1 -- 172.21.15.52:0/3974218627 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a14006030 con 0x7f8a201553c0 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.574+0000 7f8a0effd640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8a0006c8f0 0x7f8a0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.574+0000 7f8a0effd640 1 -- 172.21.15.52:0/3974218627 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f8a1408c620 con 0x7f8a201553c0 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.574+0000 7f8a1dd9b640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8a0006c8f0 0x7f8a0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.575+0000 7f8a1dd9b640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8a0006c8f0 0x7f8a0006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8a201f4500 tx=0x7f8a10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.583+0000 7f8a0effd640 1 -- 172.21.15.52:0/3974218627 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a1401e020 con 0x7f8a201553c0 2024-04-25T13:16:53.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.769+0000 7f8a24859640 1 -- 172.21.15.52:0/3974218627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8a200cac50 con 0x7f8a201553c0 2024-04-25T13:16:53.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.769+0000 7f8a0effd640 1 -- 172.21.15.52:0/3974218627 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f8a201e72d0 con 0x7f8a201553c0 2024-04-25T13:16:53.770 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-25T13:16:53.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.771+0000 7f8a24859640 1 -- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8a0006c8f0 msgr2=0x7f8a0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.771+0000 7f8a24859640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8a0006c8f0 0x7f8a0006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8a201f4500 tx=0x7f8a10009040 comp rx=0 tx=0).stop 2024-04-25T13:16:53.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.771+0000 7f8a24859640 1 -- 172.21.15.52:0/3974218627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a201553c0 msgr2=0x7f8a200cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.771+0000 7f8a24859640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a201553c0 0x7f8a200cf730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400c7f0 tx=0x7f8a1400ccb0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.771+0000 7f8a24859640 1 -- 172.21.15.52:0/3974218627 shutdown_connections 2024-04-25T13:16:53.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.771+0000 7f8a24859640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8a0006c8f0 0x7f8a0006edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.771+0000 7f8a24859640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a2015b070 0x7f8a201f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.771+0000 7f8a24859640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a2015f310 0x7f8a2014b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.771+0000 7f8a24859640 1 --2- 172.21.15.52:0/3974218627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a201553c0 0x7f8a200cf730 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.771+0000 7f8a24859640 1 -- 172.21.15.52:0/3974218627 >> 172.21.15.52:0/3974218627 conn(0x7f8a20072360 msgr2=0x7f8a200b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.771+0000 7f8a24859640 1 -- 172.21.15.52:0/3974218627 shutdown_connections 2024-04-25T13:16:53.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.771+0000 7f8a24859640 1 -- 172.21.15.52:0/3974218627 wait complete. 2024-04-25T13:16:53.782 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:16:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.886+0000 7f0789944640 1 Processor -- start 2024-04-25T13:16:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.886+0000 7f0789944640 1 -- start start 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f0789944640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f07840cb270 0x7f078406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f0789944640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f07840c60c0 0x7f07840c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f0789944640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07840c5900 con 0x7f0784155220 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f0789944640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f078415c040 con 0x7f07840c60c0 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f0789944640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f07840c6a70 con 0x7f07840cb270 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f07837fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f07840c60c0 0x7f07840c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f07837fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f07840c60c0 0x7f07840c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46610/0 (socket says 172.21.15.52:46610) 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f07837fe640 1 -- 172.21.15.52:0/4223915785 learned_addr learned my addr 172.21.15.52:0/4223915785 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f07827fc640 1 --2- 172.21.15.52:0/4223915785 >> v2:172.21.15.102:3300/0 conn(0x7f07840cb270 0x7f078406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f07837fe640 1 -- 172.21.15.52:0/4223915785 >> v2:172.21.15.102:3300/0 conn(0x7f07840cb270 msgr2=0x7f078406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f07837fe640 1 --2- 172.21.15.52:0/4223915785 >> v2:172.21.15.102:3300/0 conn(0x7f07840cb270 0x7f078406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f07837fe640 1 -- 172.21.15.52:0/4223915785 >> v1:172.21.15.102:6789/0 conn(0x7f0784155220 legacy=0x7f07840d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f07837fe640 1 -- 172.21.15.52:0/4223915785 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07840cc4f0 con 0x7f07840c60c0 2024-04-25T13:16:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.887+0000 7f07827fc640 1 --2- 172.21.15.52:0/4223915785 >> v2:172.21.15.102:3300/0 conn(0x7f07840cb270 0x7f078406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.888+0000 7f07837fe640 1 --2- 172.21.15.52:0/4223915785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07840c60c0 0x7f07840c6530 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f078415f6b0 tx=0x7f077c02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d29c03cab72e354 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.888+0000 7f0781ffb640 1 -- 172.21.15.52:0/4223915785 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c036070 con 0x7f07840c60c0 2024-04-25T13:16:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.888+0000 7f0781ffb640 1 -- 172.21.15.52:0/4223915785 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f077c031600 con 0x7f07840c60c0 2024-04-25T13:16:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.888+0000 7f0781ffb640 1 -- 172.21.15.52:0/4223915785 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c0319d0 con 0x7f07840c60c0 2024-04-25T13:16:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.889+0000 7f0789944640 1 -- 172.21.15.52:0/4223915785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07840c60c0 msgr2=0x7f07840c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.889+0000 7f0789944640 1 --2- 172.21.15.52:0/4223915785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07840c60c0 0x7f07840c6530 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f078415f6b0 tx=0x7f077c02a780 comp rx=0 tx=0).stop 2024-04-25T13:16:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.889+0000 7f0789944640 1 -- 172.21.15.52:0/4223915785 shutdown_connections 2024-04-25T13:16:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.889+0000 7f0789944640 1 --2- 172.21.15.52:0/4223915785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07840c60c0 0x7f07840c6530 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.889+0000 7f0789944640 1 --2- 172.21.15.52:0/4223915785 >> v2:172.21.15.102:3300/0 conn(0x7f07840cb270 0x7f078406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.889+0000 7f0789944640 1 -- 172.21.15.52:0/4223915785 >> 172.21.15.52:0/4223915785 conn(0x7f0784075170 msgr2=0x7f0784075580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.889+0000 7f0789944640 1 -- 172.21.15.52:0/4223915785 shutdown_connections 2024-04-25T13:16:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.889+0000 7f0789944640 1 -- 172.21.15.52:0/4223915785 wait complete. 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.890+0000 7f0789944640 1 Processor -- start 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.890+0000 7f0789944640 1 -- start start 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0789944640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07840c60c0 0x7f0784145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0789944640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07840cb270 0x7f0784147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0789944640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0784155220 0x7f0784148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0789944640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f07840c5c30 con 0x7f07840c60c0 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0789944640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f078415bd60 con 0x7f07840cb270 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0789944640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0784155600 con 0x7f0784155220 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0782ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07840c60c0 0x7f0784145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0782ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07840c60c0 0x7f0784145500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46618/0 (socket says 172.21.15.52:46618) 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0782ffd640 1 -- 172.21.15.52:0/2873232531 learned_addr learned my addr 172.21.15.52:0/2873232531 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f07827fc640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07840cb270 0x7f0784147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0782ffd640 1 -- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0784155220 msgr2=0x7f0784148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0782ffd640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0784155220 0x7f0784148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0782ffd640 1 -- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07840cb270 msgr2=0x7f0784147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0782ffd640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07840cb270 0x7f0784147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f0782ffd640 1 -- 172.21.15.52:0/2873232531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0784145a40 con 0x7f07840c60c0 2024-04-25T13:16:53.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.891+0000 7f07827fc640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07840cb270 0x7f0784147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:53.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.892+0000 7f0782ffd640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07840c60c0 0x7f0784145500 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f076c00b3f0 tx=0x7f076c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.892+0000 7f077bfff640 1 -- 172.21.15.52:0/2873232531 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c015020 con 0x7f07840c60c0 2024-04-25T13:16:53.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.892+0000 7f077bfff640 1 -- 172.21.15.52:0/2873232531 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076c011830 con 0x7f07840c60c0 2024-04-25T13:16:53.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.892+0000 7f0789944640 1 -- 172.21.15.52:0/2873232531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07840c86c0 con 0x7f07840c60c0 2024-04-25T13:16:53.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.892+0000 7f077bfff640 1 -- 172.21.15.52:0/2873232531 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c011c20 con 0x7f07840c60c0 2024-04-25T13:16:53.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.892+0000 7f0789944640 1 -- 172.21.15.52:0/2873232531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0784146e90 con 0x7f07840c60c0 2024-04-25T13:16:53.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.893+0000 7f0789944640 1 -- 172.21.15.52:0/2873232531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0784068e40 con 0x7f07840c60c0 2024-04-25T13:16:53.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.893+0000 7f077bfff640 1 -- 172.21.15.52:0/2873232531 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f076c018020 con 0x7f07840c60c0 2024-04-25T13:16:53.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.894+0000 7f077bfff640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f076406c920 0x7f076406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.894+0000 7f077bfff640 1 -- 172.21.15.52:0/2873232531 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f076c08bac0 con 0x7f07840c60c0 2024-04-25T13:16:53.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.894+0000 7f07827fc640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f076406c920 0x7f076406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.895+0000 7f07827fc640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f076406c920 0x7f076406ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0774006fd0 tx=0x7f0774008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:53.902+0000 7f077bfff640 1 -- 172.21.15.52:0/2873232531 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f076c01f030 con 0x7f07840c60c0 2024-04-25T13:16:54.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.087+0000 7f0789944640 1 -- 172.21.15.52:0/2873232531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f078415f500 con 0x7f07840c60c0 2024-04-25T13:16:54.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.088+0000 7f077bfff640 1 -- 172.21.15.52:0/2873232531 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f0784145a40 con 0x7f07840c60c0 2024-04-25T13:16:54.088 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T13:16:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.090+0000 7f0789944640 1 -- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f076406c920 msgr2=0x7f076406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.090+0000 7f0789944640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f076406c920 0x7f076406ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0774006fd0 tx=0x7f0774008040 comp rx=0 tx=0).stop 2024-04-25T13:16:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.090+0000 7f0789944640 1 -- 172.21.15.52:0/2873232531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07840c60c0 msgr2=0x7f0784145500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.090+0000 7f0789944640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07840c60c0 0x7f0784145500 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f076c00b3f0 tx=0x7f076c00b8b0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.090+0000 7f0789944640 1 -- 172.21.15.52:0/2873232531 shutdown_connections 2024-04-25T13:16:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.090+0000 7f0789944640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f076406c920 0x7f076406ede0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.090+0000 7f0789944640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0784155220 0x7f0784148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.090+0000 7f0789944640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07840cb270 0x7f0784147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.090+0000 7f0789944640 1 --2- 172.21.15.52:0/2873232531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07840c60c0 0x7f0784145500 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.090+0000 7f0789944640 1 -- 172.21.15.52:0/2873232531 >> 172.21.15.52:0/2873232531 conn(0x7f0784075170 msgr2=0x7f07840cfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.090+0000 7f0789944640 1 -- 172.21.15.52:0/2873232531 shutdown_connections 2024-04-25T13:16:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.090+0000 7f0789944640 1 -- 172.21.15.52:0/2873232531 wait complete. 2024-04-25T13:16:54.101 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:54.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.202+0000 7f5de05a1640 1 Processor -- start 2024-04-25T13:16:54.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.202+0000 7f5de05a1640 1 -- start start 2024-04-25T13:16:54.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5de05a1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5dd806bf70 0x7f5dd815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5de05a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5dd80c99f0 0x7f5dd80c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5de05a1640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd815bef0 con 0x7f5dd806bb90 2024-04-25T13:16:54.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5de05a1640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5dd815f510 con 0x7f5dd806bf70 2024-04-25T13:16:54.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5de05a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd815b650 con 0x7f5dd80c99f0 2024-04-25T13:16:54.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5dddb3c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5dd806bf70 0x7f5dd815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5dde33d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5dd806bb90 0x7f5dd815ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47870/0 (socket says 172.21.15.52:47870) 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5dde33d640 1 -- 172.21.15.52:0/1710762919 learned_addr learned my addr 172.21.15.52:0/1710762919 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5ddeb3e640 1 --2- 172.21.15.52:0/1710762919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5dd80c99f0 0x7f5dd80c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5dddb3c640 1 -- 172.21.15.52:0/1710762919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5dd80c99f0 msgr2=0x7f5dd80c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5dddb3c640 1 --2- 172.21.15.52:0/1710762919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5dd80c99f0 0x7f5dd80c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5dddb3c640 1 -- 172.21.15.52:0/1710762919 >> v1:172.21.15.52:6789/0 conn(0x7f5dd806bb90 legacy=0x7f5dd815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5ddd33b640 1 -- 172.21.15.52:0/1710762919 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381980056 0 0) 0x7f5dd815bef0 con 0x7f5dd806bb90 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5dddb3c640 1 -- 172.21.15.52:0/1710762919 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd815b930 con 0x7f5dd806bf70 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.203+0000 7f5ddeb3e640 1 --2- 172.21.15.52:0/1710762919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5dd80c99f0 0x7f5dd80c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.204+0000 7f5dddb3c640 1 --2- 172.21.15.52:0/1710762919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd806bf70 0x7f5dd815af70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40097a0 tx=0x7f5dd402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9383d01e979c272c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.204+0000 7f5ddd33b640 1 -- 172.21.15.52:0/1710762919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4037070 con 0x7f5dd806bf70 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.204+0000 7f5ddd33b640 1 -- 172.21.15.52:0/1710762919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd4032440 con 0x7f5dd806bf70 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.204+0000 7f5ddd33b640 1 -- 172.21.15.52:0/1710762919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4032810 con 0x7f5dd806bf70 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.205+0000 7f5de05a1640 1 -- 172.21.15.52:0/1710762919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd806bf70 msgr2=0x7f5dd815af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.205+0000 7f5de05a1640 1 --2- 172.21.15.52:0/1710762919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd806bf70 0x7f5dd815af70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40097a0 tx=0x7f5dd402a210 comp rx=0 tx=0).stop 2024-04-25T13:16:54.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.205+0000 7f5de05a1640 1 -- 172.21.15.52:0/1710762919 shutdown_connections 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.205+0000 7f5de05a1640 1 --2- 172.21.15.52:0/1710762919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd806bf70 0x7f5dd815af70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.205+0000 7f5de05a1640 1 --2- 172.21.15.52:0/1710762919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5dd80c99f0 0x7f5dd80c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.205+0000 7f5de05a1640 1 -- 172.21.15.52:0/1710762919 >> 172.21.15.52:0/1710762919 conn(0x7f5dd8074d50 msgr2=0x7f5dd8075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.205+0000 7f5de05a1640 1 -- 172.21.15.52:0/1710762919 shutdown_connections 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.205+0000 7f5de05a1640 1 -- 172.21.15.52:0/1710762919 wait complete. 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.206+0000 7f5de05a1640 1 Processor -- start 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.206+0000 7f5de05a1640 1 -- start start 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5de05a1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5dd806bb90 0x7f5dd8150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5de05a1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5dd806bf70 0x7f5dd81f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5de05a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd80c99f0 0x7f5dd8159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5de05a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd815e8e0 con 0x7f5dd80c99f0 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5de05a1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd815e600 con 0x7f5dd806bf70 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5de05a1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd8074560 con 0x7f5dd806bb90 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5ddeb3e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd80c99f0 0x7f5dd8159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5ddeb3e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd80c99f0 0x7f5dd8159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46638/0 (socket says 172.21.15.52:46638) 2024-04-25T13:16:54.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5ddeb3e640 1 -- 172.21.15.52:0/3886650420 learned_addr learned my addr 172.21.15.52:0/3886650420 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5dde33d640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5dd806bb90 0x7f5dd8150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5dddb3c640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5dd806bf70 0x7f5dd81f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5ddeb3e640 1 -- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5dd806bb90 msgr2=0x7f5dd8150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5ddeb3e640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5dd806bb90 0x7f5dd8150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5ddeb3e640 1 -- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5dd806bf70 msgr2=0x7f5dd81f0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5ddeb3e640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5dd806bf70 0x7f5dd81f0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5ddeb3e640 1 -- 172.21.15.52:0/3886650420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd81f4170 con 0x7f5dd80c99f0 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5dddb3c640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5dd806bf70 0x7f5dd81f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5dde33d640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5dd806bb90 0x7f5dd8150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.207+0000 7f5ddeb3e640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd80c99f0 0x7f5dd8159f80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000cd50 tx=0x7f5dd000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.208+0000 7f5dceffd640 1 -- 172.21.15.52:0/3886650420 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000f680 con 0x7f5dd80c99f0 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.208+0000 7f5dceffd640 1 -- 172.21.15.52:0/3886650420 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd000f840 con 0x7f5dd80c99f0 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.208+0000 7f5de05a1640 1 -- 172.21.15.52:0/3886650420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd81f4450 con 0x7f5dd80c99f0 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.208+0000 7f5dceffd640 1 -- 172.21.15.52:0/3886650420 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000fc30 con 0x7f5dd80c99f0 2024-04-25T13:16:54.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.208+0000 7f5de05a1640 1 -- 172.21.15.52:0/3886650420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd81f4a10 con 0x7f5dd80c99f0 2024-04-25T13:16:54.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.209+0000 7f5de05a1640 1 -- 172.21.15.52:0/3886650420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd8068e40 con 0x7f5dd80c99f0 2024-04-25T13:16:54.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.209+0000 7f5dceffd640 1 -- 172.21.15.52:0/3886650420 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5dd00213f0 con 0x7f5dd80c99f0 2024-04-25T13:16:54.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.210+0000 7f5dceffd640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5dbc06c8f0 0x7f5dbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.210+0000 7f5dceffd640 1 -- 172.21.15.52:0/3886650420 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f5dd008cd80 con 0x7f5dd80c99f0 2024-04-25T13:16:54.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.210+0000 7f5dde33d640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5dbc06c8f0 0x7f5dbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.211+0000 7f5dde33d640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5dbc06c8f0 0x7f5dbc06edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8000f60 tx=0x7f5dc8007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.214+0000 7f5dceffd640 1 -- 172.21.15.52:0/3886650420 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5dd0014030 con 0x7f5dd80c99f0 2024-04-25T13:16:54.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.436+0000 7f5de05a1640 1 -- 172.21.15.52:0/3886650420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5dd8070870 con 0x7f5dd80c99f0 2024-04-25T13:16:54.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.437+0000 7f5dceffd640 1 -- 172.21.15.52:0/3886650420 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6910 (secure 0 0 0) 0x7f5dd005ad90 con 0x7f5dd80c99f0 2024-04-25T13:16:54.437 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:54.438 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2650846419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2650846419},{"type":"v1","addr":"172.21.15.102:6837","nonce":2650846419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:07.352382+0000","modified":"2024-04-25T13:16:51.139035+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4290,"mds_1":4284,"mds_2":4273,"mds_3":4265,"mds_4":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"d","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.102:6838/1508646651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":1508646651},{"type":"v1","addr":"172.21.15.102:6838","nonce":1508646651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4265":{"gid":4265,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":14,"addr":"172.21.15.102:6839/1980846137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1980846137},{"type":"v1","addr":"172.21.15.102:6839","nonce":1980846137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4273":{"gid":4273,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.52:6835/714334205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":714334205},{"type":"v1","addr":"172.21.15.52:6835","nonce":714334205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6834/3228537118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3228537118},{"type":"v1","addr":"172.21.15.52:6834","nonce":3228537118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4290":{"gid":4290,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6837/413759311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":413759311},{"type":"v1","addr":"172.21.15.52:6837","nonce":413759311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290,4284,4273,4265]},"id":1}]} 2024-04-25T13:16:54.438 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 17 2024-04-25T13:16:54.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.439+0000 7f5de05a1640 1 -- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5dbc06c8f0 msgr2=0x7f5dbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.439+0000 7f5de05a1640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5dbc06c8f0 0x7f5dbc06edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8000f60 tx=0x7f5dc8007c10 comp rx=0 tx=0).stop 2024-04-25T13:16:54.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.439+0000 7f5de05a1640 1 -- 172.21.15.52:0/3886650420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd80c99f0 msgr2=0x7f5dd8159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.439+0000 7f5de05a1640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd80c99f0 0x7f5dd8159f80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000cd50 tx=0x7f5dd000a650 comp rx=0 tx=0).stop 2024-04-25T13:16:54.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.439+0000 7f5de05a1640 1 -- 172.21.15.52:0/3886650420 shutdown_connections 2024-04-25T13:16:54.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.439+0000 7f5de05a1640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5dbc06c8f0 0x7f5dbc06edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.439+0000 7f5de05a1640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd80c99f0 0x7f5dd8159f80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.439+0000 7f5de05a1640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5dd806bf70 0x7f5dd81f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.439+0000 7f5de05a1640 1 --2- 172.21.15.52:0/3886650420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5dd806bb90 0x7f5dd8150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.439+0000 7f5de05a1640 1 -- 172.21.15.52:0/3886650420 >> 172.21.15.52:0/3886650420 conn(0x7f5dd8074d50 msgr2=0x7f5dd8153350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.439+0000 7f5de05a1640 1 -- 172.21.15.52:0/3886650420 shutdown_connections 2024-04-25T13:16:54.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.439+0000 7f5de05a1640 1 -- 172.21.15.52:0/3886650420 wait complete. 2024-04-25T13:16:54.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.551+0000 7f27d303a640 1 Processor -- start 2024-04-25T13:16:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.551+0000 7f27d303a640 1 -- start start 2024-04-25T13:16:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.551+0000 7f27d303a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f27cc1554e0 0x7f27cc15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.551+0000 7f27d303a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27cc0b3c00 0x7f27cc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.551+0000 7f27d303a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27cc1558c0 con 0x7f27cc0b5450 2024-04-25T13:16:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.551+0000 7f27d303a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f27cc0b4a80 con 0x7f27cc1554e0 2024-04-25T13:16:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.551+0000 7f27d303a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f27cc15f630 con 0x7f27cc0b3c00 2024-04-25T13:16:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.552+0000 7f27d0dd6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f27cc1554e0 0x7f27cc15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.552+0000 7f27d0dd6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f27cc1554e0 0x7f27cc15f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46644/0 (socket says 172.21.15.52:46644) 2024-04-25T13:16:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.552+0000 7f27d0dd6640 1 -- 172.21.15.52:0/2528554636 learned_addr learned my addr 172.21.15.52:0/2528554636 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.552+0000 7f27cbfff640 1 --2- 172.21.15.52:0/2528554636 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27cc0b3c00 0x7f27cc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.552+0000 7f27d0dd6640 1 -- 172.21.15.52:0/2528554636 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27cc0b3c00 msgr2=0x7f27cc0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.552+0000 7f27d0dd6640 1 --2- 172.21.15.52:0/2528554636 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27cc0b3c00 0x7f27cc0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.552+0000 7f27d0dd6640 1 -- 172.21.15.52:0/2528554636 >> v1:172.21.15.102:6789/0 conn(0x7f27cc0b5450 legacy=0x7f27cc0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.552+0000 7f27d0dd6640 1 -- 172.21.15.52:0/2528554636 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc0cb8c0 con 0x7f27cc1554e0 2024-04-25T13:16:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.553+0000 7f27d0dd6640 1 --2- 172.21.15.52:0/2528554636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27cc1554e0 0x7f27cc15f0f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009870 tx=0x7f27c002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fbcde84d2a4277 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.553+0000 7f27cb7fe640 1 -- 172.21.15.52:0/2528554636 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0037070 con 0x7f27cc1554e0 2024-04-25T13:16:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.553+0000 7f27cb7fe640 1 -- 172.21.15.52:0/2528554636 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c002ae50 con 0x7f27cc1554e0 2024-04-25T13:16:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.553+0000 7f27cb7fe640 1 -- 172.21.15.52:0/2528554636 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0032860 con 0x7f27cc1554e0 2024-04-25T13:16:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.553+0000 7f27d303a640 1 -- 172.21.15.52:0/2528554636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27cc1554e0 msgr2=0x7f27cc15f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.553+0000 7f27d303a640 1 --2- 172.21.15.52:0/2528554636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27cc1554e0 0x7f27cc15f0f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009870 tx=0x7f27c002a300 comp rx=0 tx=0).stop 2024-04-25T13:16:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.553+0000 7f27d303a640 1 -- 172.21.15.52:0/2528554636 shutdown_connections 2024-04-25T13:16:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.553+0000 7f27d303a640 1 --2- 172.21.15.52:0/2528554636 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27cc0b3c00 0x7f27cc0b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.553+0000 7f27d303a640 1 --2- 172.21.15.52:0/2528554636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27cc1554e0 0x7f27cc15f0f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.553+0000 7f27d303a640 1 -- 172.21.15.52:0/2528554636 >> 172.21.15.52:0/2528554636 conn(0x7f27cc074d50 msgr2=0x7f27cc075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.553+0000 7f27d303a640 1 -- 172.21.15.52:0/2528554636 shutdown_connections 2024-04-25T13:16:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.553+0000 7f27d303a640 1 -- 172.21.15.52:0/2528554636 wait complete. 2024-04-25T13:16:54.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.554+0000 7f27d303a640 1 Processor -- start 2024-04-25T13:16:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.554+0000 7f27d303a640 1 -- start start 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.555+0000 7f27d303a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27cc0b3c00 0x7f27cc1e5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.555+0000 7f27d303a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27cc0b5450 0x7f27cc156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.555+0000 7f27d303a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27cc1554e0 0x7f27cc156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.555+0000 7f27d303a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc0b4430 con 0x7f27cc0b3c00 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.555+0000 7f27d303a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc0b4150 con 0x7f27cc1554e0 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.555+0000 7f27d303a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f27cc0b4710 con 0x7f27cc0b5450 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.555+0000 7f27d0dd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27cc0b3c00 0x7f27cc1e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.555+0000 7f27d0dd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27cc0b3c00 0x7f27cc1e5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46658/0 (socket says 172.21.15.52:46658) 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.555+0000 7f27d0dd6640 1 -- 172.21.15.52:0/2385567474 learned_addr learned my addr 172.21.15.52:0/2385567474 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27d15d7640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27cc1554e0 0x7f27cc156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27cbfff640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27cc0b5450 0x7f27cc156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27d0dd6640 1 -- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27cc0b5450 msgr2=0x7f27cc156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27d0dd6640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27cc0b5450 0x7f27cc156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27d0dd6640 1 -- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27cc1554e0 msgr2=0x7f27cc156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27d0dd6640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27cc1554e0 0x7f27cc156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27d0dd6640 1 -- 172.21.15.52:0/2385567474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc1572a0 con 0x7f27cc0b3c00 2024-04-25T13:16:54.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27d0dd6640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27cc0b3c00 0x7f27cc1e5510 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f27c0000c00 tx=0x7f27c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27c97fa640 1 -- 172.21.15.52:0/2385567474 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0041020 con 0x7f27cc0b3c00 2024-04-25T13:16:54.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27c97fa640 1 -- 172.21.15.52:0/2385567474 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c003c670 con 0x7f27cc0b3c00 2024-04-25T13:16:54.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27c97fa640 1 -- 172.21.15.52:0/2385567474 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0037040 con 0x7f27cc0b3c00 2024-04-25T13:16:54.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27d303a640 1 -- 172.21.15.52:0/2385567474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27cc0c80f0 con 0x7f27cc0b3c00 2024-04-25T13:16:54.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.556+0000 7f27d303a640 1 -- 172.21.15.52:0/2385567474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27cc0c86b0 con 0x7f27cc0b3c00 2024-04-25T13:16:54.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.557+0000 7f27d303a640 1 -- 172.21.15.52:0/2385567474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27cc0b37f0 con 0x7f27cc0b3c00 2024-04-25T13:16:54.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.558+0000 7f27c97fa640 1 -- 172.21.15.52:0/2385567474 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27c0044020 con 0x7f27cc0b3c00 2024-04-25T13:16:54.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.558+0000 7f27c97fa640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f27b006c8f0 0x7f27b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.558+0000 7f27c97fa640 1 -- 172.21.15.52:0/2385567474 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f27c00ac830 con 0x7f27cc0b3c00 2024-04-25T13:16:54.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.558+0000 7f27cbfff640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f27b006c8f0 0x7f27b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.559+0000 7f27cbfff640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f27b006c8f0 0x7f27b006edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f27b8006fd0 tx=0x7f27b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.563+0000 7f27c97fa640 1 -- 172.21.15.52:0/2385567474 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f27c004b030 con 0x7f27cc0b3c00 2024-04-25T13:16:54.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.751+0000 7f27d303a640 1 -- 172.21.15.52:0/2385567474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27cc068e40 con 0x7f27cc0b3c00 2024-04-25T13:16:54.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.752+0000 7f27c97fa640 1 -- 172.21.15.52:0/2385567474 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18927 (secure 0 0 0) 0x7f27c007a8d0 con 0x7f27cc0b3c00 2024-04-25T13:16:54.752 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:54.752 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:49.125761+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:54.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.754+0000 7f27d303a640 1 -- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f27b006c8f0 msgr2=0x7f27b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.754+0000 7f27d303a640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f27b006c8f0 0x7f27b006edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f27b8006fd0 tx=0x7f27b8008040 comp rx=0 tx=0).stop 2024-04-25T13:16:54.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.754+0000 7f27d303a640 1 -- 172.21.15.52:0/2385567474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27cc0b3c00 msgr2=0x7f27cc1e5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.754+0000 7f27d303a640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27cc0b3c00 0x7f27cc1e5510 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f27c0000c00 tx=0x7f27c00046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.754+0000 7f27d303a640 1 -- 172.21.15.52:0/2385567474 shutdown_connections 2024-04-25T13:16:54.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.754+0000 7f27d303a640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f27b006c8f0 0x7f27b006edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.754+0000 7f27d303a640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27cc0b5450 0x7f27cc156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.754+0000 7f27d303a640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27cc1554e0 0x7f27cc156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.754+0000 7f27d303a640 1 --2- 172.21.15.52:0/2385567474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27cc0b3c00 0x7f27cc1e5510 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.754+0000 7f27d303a640 1 -- 172.21.15.52:0/2385567474 >> 172.21.15.52:0/2385567474 conn(0x7f27cc074d50 msgr2=0x7f27cc151790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.754+0000 7f27d303a640 1 -- 172.21.15.52:0/2385567474 shutdown_connections 2024-04-25T13:16:54.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.754+0000 7f27d303a640 1 -- 172.21.15.52:0/2385567474 wait complete. 2024-04-25T13:16:54.765 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.833544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:05.935596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:06.297991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:10.015464+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:16:54.766 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:54.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.870+0000 7f53d6205640 1 Processor -- start 2024-04-25T13:16:54.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.870+0000 7f53d6205640 1 -- start start 2024-04-25T13:16:54.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53d6205640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d0155210 0x7f53d00cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53d6205640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f53d00cb810 0x7f53d015e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53d6205640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d015f310 con 0x7f53d015eea0 2024-04-25T13:16:54.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53d6205640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f53d015bf00 con 0x7f53d00cb810 2024-04-25T13:16:54.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53d6205640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f53d015b0a0 con 0x7f53d0155210 2024-04-25T13:16:54.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53cffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f53d015eea0 0x7f53d006b920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47876/0 (socket says 172.21.15.52:47876) 2024-04-25T13:16:54.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53cffff640 1 -- 172.21.15.52:0/709204050 learned_addr learned my addr 172.21.15.52:0/709204050 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:54.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53ceffd640 1 --2- 172.21.15.52:0/709204050 >> v2:172.21.15.102:3300/0 conn(0x7f53d00cb810 0x7f53d015e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53cf7fe640 1 --2- 172.21.15.52:0/709204050 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d0155210 0x7f53d00cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3284629582 0 0) 0x7f53d015f310 con 0x7f53d015eea0 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53bc003520 con 0x7f53d015eea0 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 681408420 0 0) 0x7f53bc003520 con 0x7f53d015eea0 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d0155210 msgr2=0x7f53d00cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.871+0000 7f53ce7fc640 1 --2- 172.21.15.52:0/709204050 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d0155210 0x7f53d00cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 >> v2:172.21.15.102:3300/0 conn(0x7f53d00cb810 msgr2=0x7f53d015e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53ce7fc640 1 --2- 172.21.15.52:0/709204050 >> v2:172.21.15.102:3300/0 conn(0x7f53d00cb810 0x7f53d015e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d015b380 con 0x7f53d015eea0 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f53c80019f0 con 0x7f53d015eea0 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 >> v1:172.21.15.52:6789/0 conn(0x7f53d015eea0 legacy=0x7f53d006b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53ce7fc640 1 --2- 172.21.15.52:0/709204050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53bc0039b0 0x7f53bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53ce7fc640 1 --2- 172.21.15.52:0/709204050 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d0155210 0x7f53bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53ce7fc640 1 --2- 172.21.15.52:0/709204050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53bc004d40 0x7f53bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f53d015bf00 con 0x7f53bc0039b0 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f53d015b0a0 con 0x7f53bc004d40 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f53bc00b9c0 con 0x7f53d0155210 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53cf7fe640 1 --2- 172.21.15.52:0/709204050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53bc0039b0 0x7f53bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53ceffd640 1 --2- 172.21.15.52:0/709204050 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d0155210 0x7f53bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53cffff640 1 --2- 172.21.15.52:0/709204050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53bc004d40 0x7f53bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53cf7fe640 1 -- 172.21.15.52:0/709204050 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d0155210 msgr2=0x7f53bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53cf7fe640 1 --2- 172.21.15.52:0/709204050 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d0155210 0x7f53bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53cf7fe640 1 -- 172.21.15.52:0/709204050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53bc004d40 msgr2=0x7f53bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53cf7fe640 1 --2- 172.21.15.52:0/709204050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53bc004d40 0x7f53bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.872+0000 7f53cf7fe640 1 -- 172.21.15.52:0/709204050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53bc003520 con 0x7f53bc0039b0 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.873+0000 7f53cf7fe640 1 --2- 172.21.15.52:0/709204050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53bc0039b0 0x7f53bc003dd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009ac0 tx=0x7f53bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc85f23489acb5d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.873+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8036070 con 0x7f53bc0039b0 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.873+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b8031400 con 0x7f53bc0039b0 2024-04-25T13:16:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.873+0000 7f53ce7fc640 1 -- 172.21.15.52:0/709204050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8009690 con 0x7f53bc0039b0 2024-04-25T13:16:54.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.873+0000 7f53d6205640 1 -- 172.21.15.52:0/709204050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53bc0039b0 msgr2=0x7f53bc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.873+0000 7f53d6205640 1 --2- 172.21.15.52:0/709204050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53bc0039b0 0x7f53bc003dd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009ac0 tx=0x7f53bc005830 comp rx=0 tx=0).stop 2024-04-25T13:16:54.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.873+0000 7f53cffff640 1 -- 172.21.15.52:0/709204050 reap_dead start 2024-04-25T13:16:54.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.873+0000 7f53d6205640 1 -- 172.21.15.52:0/709204050 shutdown_connections 2024-04-25T13:16:54.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.873+0000 7f53d6205640 1 -- 172.21.15.52:0/709204050 >> 172.21.15.52:0/709204050 conn(0x7f53d0074f30 msgr2=0x7f53d0075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.874+0000 7f53d6205640 1 -- 172.21.15.52:0/709204050 shutdown_connections 2024-04-25T13:16:54.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.874+0000 7f53d6205640 1 -- 172.21.15.52:0/709204050 wait complete. 2024-04-25T13:16:54.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.875+0000 7f53d6205640 1 Processor -- start 2024-04-25T13:16:54.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.875+0000 7f53d6205640 1 -- start start 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.875+0000 7f53d6205640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53bc0039b0 0x7f53d01f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53d6205640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d015abe0 0x7f53d015d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53d6205640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53d014c2d0 0x7f53d01479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53d6205640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f53d015bc20 con 0x7f53bc0039b0 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53d6205640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f53d015b940 con 0x7f53d014c2d0 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53d6205640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f53d01555f0 con 0x7f53d015abe0 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53bc0039b0 0x7f53d01f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53bc0039b0 0x7f53d01f1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46670/0 (socket says 172.21.15.52:46670) 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53cf7fe640 1 -- 172.21.15.52:0/1612011330 learned_addr learned my addr 172.21.15.52:0/1612011330 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53cffff640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53d014c2d0 0x7f53d01479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53ceffd640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d015abe0 0x7f53d015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53cf7fe640 1 -- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d015abe0 msgr2=0x7f53d015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53cf7fe640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d015abe0 0x7f53d015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53cf7fe640 1 -- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53d014c2d0 msgr2=0x7f53d01479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53cf7fe640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53d014c2d0 0x7f53d01479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53cf7fe640 1 -- 172.21.15.52:0/1612011330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d01f08f0 con 0x7f53bc0039b0 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53ceffd640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d015abe0 0x7f53d015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53cffff640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53d014c2d0 0x7f53d01479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53cf7fe640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53bc0039b0 0x7f53d01f1370 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009ac0 tx=0x7f53b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53c7fff640 1 -- 172.21.15.52:0/1612011330 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8040020 con 0x7f53bc0039b0 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53c7fff640 1 -- 172.21.15.52:0/1612011330 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b8003bc0 con 0x7f53bc0039b0 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53d6205640 1 -- 172.21.15.52:0/1612011330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d015a500 con 0x7f53bc0039b0 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53c7fff640 1 -- 172.21.15.52:0/1612011330 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8036040 con 0x7f53bc0039b0 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.876+0000 7f53d6205640 1 -- 172.21.15.52:0/1612011330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d014da80 con 0x7f53bc0039b0 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.878+0000 7f53d6205640 1 -- 172.21.15.52:0/1612011330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d0068f50 con 0x7f53bc0039b0 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.879+0000 7f53c7fff640 1 -- 172.21.15.52:0/1612011330 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f53b8043020 con 0x7f53bc0039b0 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.879+0000 7f53c7fff640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f53b006c8f0 0x7f53b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.879+0000 7f53c7fff640 1 -- 172.21.15.52:0/1612011330 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f53b80ac840 con 0x7f53bc0039b0 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.879+0000 7f53ceffd640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f53b006c8f0 0x7f53b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.880+0000 7f53ceffd640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f53b006c8f0 0x7f53b006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f53d00ce640 tx=0x7f53c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:54.883+0000 7f53c7fff640 1 -- 172.21.15.52:0/1612011330 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53b804a070 con 0x7f53bc0039b0 2024-04-25T13:16:55.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.082+0000 7f53d6205640 1 -- 172.21.15.52:0/1612011330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f53d0154a10 con 0x7f53bc0039b0 2024-04-25T13:16:55.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.082+0000 7f53c7fff640 1 -- 172.21.15.52:0/1612011330 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f53d015a500 con 0x7f53bc0039b0 2024-04-25T13:16:55.083 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T13:16:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.084+0000 7f53d6205640 1 -- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f53b006c8f0 msgr2=0x7f53b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.084+0000 7f53d6205640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f53b006c8f0 0x7f53b006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f53d00ce640 tx=0x7f53c0008040 comp rx=0 tx=0).stop 2024-04-25T13:16:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.084+0000 7f53d6205640 1 -- 172.21.15.52:0/1612011330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53bc0039b0 msgr2=0x7f53d01f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.084+0000 7f53d6205640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53bc0039b0 0x7f53d01f1370 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009ac0 tx=0x7f53b8004730 comp rx=0 tx=0).stop 2024-04-25T13:16:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.084+0000 7f53d6205640 1 -- 172.21.15.52:0/1612011330 shutdown_connections 2024-04-25T13:16:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.084+0000 7f53d6205640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f53b006c8f0 0x7f53b006edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.084+0000 7f53d6205640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53d015abe0 0x7f53d015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.084+0000 7f53d6205640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53d014c2d0 0x7f53d01479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.084+0000 7f53d6205640 1 --2- 172.21.15.52:0/1612011330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53bc0039b0 0x7f53d01f1370 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.084+0000 7f53d6205640 1 -- 172.21.15.52:0/1612011330 >> 172.21.15.52:0/1612011330 conn(0x7f53d0074f30 msgr2=0x7f53d0152de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.084+0000 7f53d6205640 1 -- 172.21.15.52:0/1612011330 shutdown_connections 2024-04-25T13:16:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.084+0000 7f53d6205640 1 -- 172.21.15.52:0/1612011330 wait complete. 2024-04-25T13:16:55.095 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:16:55.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.199+0000 7f5fd7cfa640 1 Processor -- start 2024-04-25T13:16:55.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.199+0000 7f5fd7cfa640 1 -- start start 2024-04-25T13:16:55.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd7cfa640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5fd01530c0 0x7f5fd0073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd7cfa640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5fd0158dd0 0x7f5fd00ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd7cfa640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd015a280 con 0x7f5fd0074380 2024-04-25T13:16:55.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd7cfa640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd015c380 con 0x7f5fd0158dd0 2024-04-25T13:16:55.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd7cfa640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd0159330 con 0x7f5fd01530c0 2024-04-25T13:16:55.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd6297640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5fd0158dd0 0x7f5fd00ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd5295640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5fd0074380 0x7f5fd015caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47884/0 (socket says 172.21.15.52:47884) 2024-04-25T13:16:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd6297640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5fd0158dd0 0x7f5fd00ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46672/0 (socket says 172.21.15.52:46672) 2024-04-25T13:16:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd5295640 1 -- 172.21.15.52:0/2898502847 learned_addr learned my addr 172.21.15.52:0/2898502847 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd5a96640 1 --2- 172.21.15.52:0/2898502847 >> v2:172.21.15.102:3300/0 conn(0x7f5fd01530c0 0x7f5fd0073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd6297640 1 -- 172.21.15.52:0/2898502847 >> v2:172.21.15.102:3300/0 conn(0x7f5fd01530c0 msgr2=0x7f5fd0073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd6297640 1 --2- 172.21.15.52:0/2898502847 >> v2:172.21.15.102:3300/0 conn(0x7f5fd01530c0 0x7f5fd0073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd6297640 1 -- 172.21.15.52:0/2898502847 >> v1:172.21.15.52:6789/0 conn(0x7f5fd0074380 legacy=0x7f5fd015caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd6297640 1 -- 172.21.15.52:0/2898502847 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd0159610 con 0x7f5fd0158dd0 2024-04-25T13:16:55.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.200+0000 7f5fd5a96640 1 --2- 172.21.15.52:0/2898502847 >> v2:172.21.15.102:3300/0 conn(0x7f5fd01530c0 0x7f5fd0073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:55.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.201+0000 7f5fd6297640 1 --2- 172.21.15.52:0/2898502847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd0158dd0 0x7f5fd00ce620 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0075cd0 tx=0x7f5fc802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee619c0edb50c63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:55.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.201+0000 7f5fd4a94640 1 -- 172.21.15.52:0/2898502847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8007740 con 0x7f5fd0158dd0 2024-04-25T13:16:55.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.201+0000 7f5fd4a94640 1 -- 172.21.15.52:0/2898502847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc80078e0 con 0x7f5fd0158dd0 2024-04-25T13:16:55.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.201+0000 7f5fd4a94640 1 -- 172.21.15.52:0/2898502847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8007cb0 con 0x7f5fd0158dd0 2024-04-25T13:16:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.202+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2898502847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd0158dd0 msgr2=0x7f5fd00ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.202+0000 7f5fd7cfa640 1 --2- 172.21.15.52:0/2898502847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd0158dd0 0x7f5fd00ce620 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0075cd0 tx=0x7f5fc802a710 comp rx=0 tx=0).stop 2024-04-25T13:16:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.202+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2898502847 shutdown_connections 2024-04-25T13:16:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.202+0000 7f5fd7cfa640 1 --2- 172.21.15.52:0/2898502847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd0158dd0 0x7f5fd00ce620 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.202+0000 7f5fd7cfa640 1 --2- 172.21.15.52:0/2898502847 >> v2:172.21.15.102:3300/0 conn(0x7f5fd01530c0 0x7f5fd0073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.202+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2898502847 >> 172.21.15.52:0/2898502847 conn(0x7f5fd0074d50 msgr2=0x7f5fd0075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.202+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2898502847 shutdown_connections 2024-04-25T13:16:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.202+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2898502847 wait complete. 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.203+0000 7f5fd7cfa640 1 Processor -- start 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.203+0000 7f5fd7cfa640 1 -- start start 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd7cfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd0074380 0x7f5fd01f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd7cfa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fd01530c0 0x7f5fd01e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd7cfa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fd0158dd0 0x7f5fd01e4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd7cfa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd015c5d0 con 0x7f5fd0074380 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd7cfa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd0159bd0 con 0x7f5fd0158dd0 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd7cfa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd0074020 con 0x7f5fd01530c0 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd5a96640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd0074380 0x7f5fd01f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd5a96640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd0074380 0x7f5fd01f2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46682/0 (socket says 172.21.15.52:46682) 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd5a96640 1 -- 172.21.15.52:0/2221792768 learned_addr learned my addr 172.21.15.52:0/2221792768 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd6297640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fd0158dd0 0x7f5fd01e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd5295640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fd01530c0 0x7f5fd01e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd5a96640 1 -- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fd01530c0 msgr2=0x7f5fd01e3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd5a96640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fd01530c0 0x7f5fd01e3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd5a96640 1 -- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fd0158dd0 msgr2=0x7f5fd01e4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd5a96640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fd0158dd0 0x7f5fd01e4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd5a96640 1 -- 172.21.15.52:0/2221792768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd01e1c60 con 0x7f5fd0074380 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.204+0000 7f5fd5a96640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd0074380 0x7f5fd01f2020 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00c7f0 tx=0x7f5fcc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.205+0000 7f5fc67fc640 1 -- 172.21.15.52:0/2221792768 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc015070 con 0x7f5fd0074380 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.205+0000 7f5fc67fc640 1 -- 172.21.15.52:0/2221792768 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fcc007a30 con 0x7f5fd0074380 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.205+0000 7f5fc67fc640 1 -- 172.21.15.52:0/2221792768 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc007e00 con 0x7f5fd0074380 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.205+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2221792768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd01f29c0 con 0x7f5fd0074380 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.205+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2221792768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd01e3440 con 0x7f5fd0074380 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.206+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2221792768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd00c8ce0 con 0x7f5fd0074380 2024-04-25T13:16:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.206+0000 7f5fc67fc640 1 -- 172.21.15.52:0/2221792768 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5fcc018070 con 0x7f5fd0074380 2024-04-25T13:16:55.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.207+0000 7f5fc67fc640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5fb406c8f0 0x7f5fb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.207+0000 7f5fc67fc640 1 -- 172.21.15.52:0/2221792768 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f5fcc08bf20 con 0x7f5fd0074380 2024-04-25T13:16:55.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.207+0000 7f5fd5295640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5fb406c8f0 0x7f5fb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.208+0000 7f5fd5295640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5fb406c8f0 0x7f5fb406edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5fd01ec470 tx=0x7f5fc0007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:55.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.211+0000 7f5fc67fc640 1 -- 172.21.15.52:0/2221792768 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5fd00c8ce0 con 0x7f5fd0074380 2024-04-25T13:16:55.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.395+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2221792768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5fd015b010 con 0x7f5fd0074380 2024-04-25T13:16:55.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.395+0000 7f5fc67fc640 1 -- 172.21.15.52:0/2221792768 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f5fcc059840 con 0x7f5fd0074380 2024-04-25T13:16:55.396 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T13:16:55.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.397+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5fb406c8f0 msgr2=0x7f5fb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.397+0000 7f5fd7cfa640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5fb406c8f0 0x7f5fb406edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5fd01ec470 tx=0x7f5fc0007e80 comp rx=0 tx=0).stop 2024-04-25T13:16:55.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.397+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2221792768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd0074380 msgr2=0x7f5fd01f2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.397+0000 7f5fd7cfa640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd0074380 0x7f5fd01f2020 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00c7f0 tx=0x7f5fcc00cbf0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.397+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2221792768 shutdown_connections 2024-04-25T13:16:55.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.397+0000 7f5fd7cfa640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5fb406c8f0 0x7f5fb406edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.397+0000 7f5fd7cfa640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fd01530c0 0x7f5fd01e3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.397+0000 7f5fd7cfa640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fd0158dd0 0x7f5fd01e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.397+0000 7f5fd7cfa640 1 --2- 172.21.15.52:0/2221792768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd0074380 0x7f5fd01f2020 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.397+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2221792768 >> 172.21.15.52:0/2221792768 conn(0x7f5fd0074d50 msgr2=0x7f5fd00cb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:55.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.397+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2221792768 shutdown_connections 2024-04-25T13:16:55.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.397+0000 7f5fd7cfa640 1 -- 172.21.15.52:0/2221792768 wait complete. 2024-04-25T13:16:55.408 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:16:55.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.515+0000 7f95f3f68640 1 Processor -- start 2024-04-25T13:16:55.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.515+0000 7f95f3f68640 1 -- start start 2024-04-25T13:16:55.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.516+0000 7f95f3f68640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f95ec151fc0 0x7f95ec0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.516+0000 7f95f3f68640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95ec159d00 0x7f95ec0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.516+0000 7f95f3f68640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ec15b420 con 0x7f95ec0ca470 2024-04-25T13:16:55.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.516+0000 7f95f3f68640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f95ec15b700 con 0x7f95ec159d00 2024-04-25T13:16:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.516+0000 7f95f3f68640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f95ec15b9e0 con 0x7f95ec151fc0 2024-04-25T13:16:55.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.516+0000 7f95f2505640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95ec159d00 0x7f95ec0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.516+0000 7f95f1503640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f95ec0ca470 0x7f95ec1595f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47898/0 (socket says 172.21.15.52:47898) 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.516+0000 7f95f1503640 1 -- 172.21.15.52:0/2104282047 learned_addr learned my addr 172.21.15.52:0/2104282047 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.516+0000 7f95f1d04640 1 --2- 172.21.15.52:0/2104282047 >> v2:172.21.15.102:3300/0 conn(0x7f95ec151fc0 0x7f95ec0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.516+0000 7f95f2505640 1 -- 172.21.15.52:0/2104282047 >> v2:172.21.15.102:3300/0 conn(0x7f95ec151fc0 msgr2=0x7f95ec0c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.517+0000 7f95f2505640 1 --2- 172.21.15.52:0/2104282047 >> v2:172.21.15.102:3300/0 conn(0x7f95ec151fc0 0x7f95ec0c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.517+0000 7f95f2505640 1 -- 172.21.15.52:0/2104282047 >> v1:172.21.15.52:6789/0 conn(0x7f95ec0ca470 legacy=0x7f95ec1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.517+0000 7f95f2505640 1 -- 172.21.15.52:0/2104282047 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec15bcc0 con 0x7f95ec159d00 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.517+0000 7f95f0d02640 1 -- 172.21.15.52:0/2104282047 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 166188498 0 0) 0x7f95ec15b420 con 0x7f95ec0ca470 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.517+0000 7f95f2505640 1 --2- 172.21.15.52:0/2104282047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95ec159d00 0x7f95ec0c8660 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0ce530 tx=0x7f95e402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf90f0388b093a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.517+0000 7f95f0d02640 1 -- 172.21.15.52:0/2104282047 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4007740 con 0x7f95ec159d00 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.517+0000 7f95f0d02640 1 -- 172.21.15.52:0/2104282047 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e40078e0 con 0x7f95ec159d00 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.517+0000 7f95f0d02640 1 -- 172.21.15.52:0/2104282047 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4007cb0 con 0x7f95ec159d00 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.518+0000 7f95f3f68640 1 -- 172.21.15.52:0/2104282047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95ec159d00 msgr2=0x7f95ec0c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.518+0000 7f95f3f68640 1 --2- 172.21.15.52:0/2104282047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95ec159d00 0x7f95ec0c8660 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0ce530 tx=0x7f95e402a710 comp rx=0 tx=0).stop 2024-04-25T13:16:55.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.518+0000 7f95f3f68640 1 -- 172.21.15.52:0/2104282047 shutdown_connections 2024-04-25T13:16:55.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.518+0000 7f95f3f68640 1 --2- 172.21.15.52:0/2104282047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95ec159d00 0x7f95ec0c8660 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.518+0000 7f95f3f68640 1 --2- 172.21.15.52:0/2104282047 >> v2:172.21.15.102:3300/0 conn(0x7f95ec151fc0 0x7f95ec0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.518+0000 7f95f3f68640 1 -- 172.21.15.52:0/2104282047 >> 172.21.15.52:0/2104282047 conn(0x7f95ec06b920 msgr2=0x7f95ec06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:55.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.518+0000 7f95f3f68640 1 -- 172.21.15.52:0/2104282047 shutdown_connections 2024-04-25T13:16:55.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.518+0000 7f95f3f68640 1 -- 172.21.15.52:0/2104282047 wait complete. 2024-04-25T13:16:55.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.519+0000 7f95f3f68640 1 Processor -- start 2024-04-25T13:16:55.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.519+0000 7f95f3f68640 1 -- start start 2024-04-25T13:16:55.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f3f68640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95ec0ca470 0x7f95ec1f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f3f68640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95ec151fc0 0x7f95ec0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f3f68640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ec159d00 0x7f95ec1478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f3f68640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec1523a0 con 0x7f95ec151fc0 2024-04-25T13:16:55.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f3f68640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec158b80 con 0x7f95ec159d00 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f3f68640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f95ec0cb810 con 0x7f95ec0ca470 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f1503640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95ec151fc0 0x7f95ec0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f1503640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95ec151fc0 0x7f95ec0cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46696/0 (socket says 172.21.15.52:46696) 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f1503640 1 -- 172.21.15.52:0/3867619144 learned_addr learned my addr 172.21.15.52:0/3867619144 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f2505640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ec159d00 0x7f95ec1478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f1d04640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95ec0ca470 0x7f95ec1f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f1503640 1 -- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95ec0ca470 msgr2=0x7f95ec1f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f1503640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95ec0ca470 0x7f95ec1f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f1503640 1 -- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ec159d00 msgr2=0x7f95ec1478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f1503640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ec159d00 0x7f95ec1478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f1503640 1 -- 172.21.15.52:0/3867619144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec074430 con 0x7f95ec151fc0 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.520+0000 7f95f2505640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ec159d00 0x7f95ec1478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.521+0000 7f95f1503640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95ec151fc0 0x7f95ec0cbca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00c4d0 tx=0x7f95dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.521+0000 7f95e27fc640 1 -- 172.21.15.52:0/3867619144 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc018070 con 0x7f95ec151fc0 2024-04-25T13:16:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.521+0000 7f95e27fc640 1 -- 172.21.15.52:0/3867619144 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc007500 con 0x7f95ec151fc0 2024-04-25T13:16:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.521+0000 7f95f3f68640 1 -- 172.21.15.52:0/3867619144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ec0cc9f0 con 0x7f95ec151fc0 2024-04-25T13:16:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.521+0000 7f95e27fc640 1 -- 172.21.15.52:0/3867619144 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc004a20 con 0x7f95ec151fc0 2024-04-25T13:16:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.521+0000 7f95f3f68640 1 -- 172.21.15.52:0/3867619144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ec0ccfb0 con 0x7f95ec151fc0 2024-04-25T13:16:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.522+0000 7f95f3f68640 1 -- 172.21.15.52:0/3867619144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ec0cd1b0 con 0x7f95ec151fc0 2024-04-25T13:16:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.523+0000 7f95e27fc640 1 -- 172.21.15.52:0/3867619144 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95dc01b070 con 0x7f95ec151fc0 2024-04-25T13:16:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.523+0000 7f95e27fc640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f95d006c8f0 0x7f95d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.523+0000 7f95e27fc640 1 -- 172.21.15.52:0/3867619144 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f95dc08b5a0 con 0x7f95ec151fc0 2024-04-25T13:16:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.524+0000 7f95f1d04640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f95d006c8f0 0x7f95d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.524+0000 7f95f1d04640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f95d006c8f0 0x7f95d006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f95e8006fd0 tx=0x7f95e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:55.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.527+0000 7f95e27fc640 1 -- 172.21.15.52:0/3867619144 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f95dc059690 con 0x7f95ec151fc0 2024-04-25T13:16:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.714+0000 7f95f3f68640 1 -- 172.21.15.52:0/3867619144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f95ec0c9630 con 0x7f95ec151fc0 2024-04-25T13:16:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.714+0000 7f95e27fc640 1 -- 172.21.15.52:0/3867619144 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f95dc058f90 con 0x7f95ec151fc0 2024-04-25T13:16:55.715 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-25T13:16:55.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.716+0000 7f95f3f68640 1 -- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f95d006c8f0 msgr2=0x7f95d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.716+0000 7f95f3f68640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f95d006c8f0 0x7f95d006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f95e8006fd0 tx=0x7f95e8008040 comp rx=0 tx=0).stop 2024-04-25T13:16:55.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.716+0000 7f95f3f68640 1 -- 172.21.15.52:0/3867619144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95ec151fc0 msgr2=0x7f95ec0cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.716+0000 7f95f3f68640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95ec151fc0 0x7f95ec0cbca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00c4d0 tx=0x7f95dc00c990 comp rx=0 tx=0).stop 2024-04-25T13:16:55.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.716+0000 7f95f3f68640 1 -- 172.21.15.52:0/3867619144 shutdown_connections 2024-04-25T13:16:55.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.717+0000 7f95f3f68640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f95d006c8f0 0x7f95d006edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.717+0000 7f95f3f68640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ec159d00 0x7f95ec1478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.717+0000 7f95f3f68640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95ec151fc0 0x7f95ec0cbca0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.717+0000 7f95f3f68640 1 --2- 172.21.15.52:0/3867619144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95ec0ca470 0x7f95ec1f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.717+0000 7f95f3f68640 1 -- 172.21.15.52:0/3867619144 >> 172.21.15.52:0/3867619144 conn(0x7f95ec06b920 msgr2=0x7f95ec14e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:55.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.717+0000 7f95f3f68640 1 -- 172.21.15.52:0/3867619144 shutdown_connections 2024-04-25T13:16:55.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.717+0000 7f95f3f68640 1 -- 172.21.15.52:0/3867619144 wait complete. 2024-04-25T13:16:55.728 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:16:55.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.833+0000 7f00b7b22640 1 Processor -- start 2024-04-25T13:16:55.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.833+0000 7f00b7b22640 1 -- start start 2024-04-25T13:16:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.834+0000 7f00b7b22640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f00b006b920 0x7f00b006bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.834+0000 7f00b7b22640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b0071c40 con 0x7f00b015ea20 2024-04-25T13:16:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.834+0000 7f00b7b22640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b015afa0 con 0x7f00b0155130 2024-04-25T13:16:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.834+0000 7f00b7b22640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f00b015e590 con 0x7f00b006b920 2024-04-25T13:16:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.834+0000 7f00b50bd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f00b015ea20 0x7f00b015ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47908/0 (socket says 172.21.15.52:47908) 2024-04-25T13:16:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.834+0000 7f00b50bd640 1 -- 172.21.15.52:0/186285355 learned_addr learned my addr 172.21.15.52:0/186285355 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.834+0000 7f00b60bf640 1 --2- 172.21.15.52:0/186285355 >> v2:172.21.15.102:3300/0 conn(0x7f00b006b920 0x7f00b006bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.834+0000 7f00b48bc640 1 -- 172.21.15.52:0/186285355 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301321781 0 0) 0x7f00a0001110 con 0x7f00b015ea20 2024-04-25T13:16:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.834+0000 7f00b48bc640 1 -- 172.21.15.52:0/186285355 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f009c003520 con 0x7f00b015ea20 2024-04-25T13:16:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.834+0000 7f00b60bf640 1 -- 172.21.15.52:0/186285355 >> v1:172.21.15.102:6789/0 conn(0x7f00b0155130 legacy=0x7f00b00cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.834+0000 7f00b60bf640 1 -- 172.21.15.52:0/186285355 >> v1:172.21.15.52:6789/0 conn(0x7f00b015ea20 legacy=0x7f00b015ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.834+0000 7f00b60bf640 1 -- 172.21.15.52:0/186285355 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b015b260 con 0x7f00b006b920 2024-04-25T13:16:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.835+0000 7f00b60bf640 1 --2- 172.21.15.52:0/186285355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b006b920 0x7f00b006bd90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009d90 tx=0x7f00a802a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd70c41396f20b5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.835+0000 7f00b48bc640 1 -- 172.21.15.52:0/186285355 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8037070 con 0x7f00b006b920 2024-04-25T13:16:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.835+0000 7f00b48bc640 1 -- 172.21.15.52:0/186285355 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a8007740 con 0x7f00b006b920 2024-04-25T13:16:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.835+0000 7f00b48bc640 1 -- 172.21.15.52:0/186285355 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8007af0 con 0x7f00b006b920 2024-04-25T13:16:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.836+0000 7f00b7b22640 1 -- 172.21.15.52:0/186285355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b006b920 msgr2=0x7f00b006bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.836+0000 7f00b7b22640 1 --2- 172.21.15.52:0/186285355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b006b920 0x7f00b006bd90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009d90 tx=0x7f00a802a780 comp rx=0 tx=0).stop 2024-04-25T13:16:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.836+0000 7f00b7b22640 1 -- 172.21.15.52:0/186285355 shutdown_connections 2024-04-25T13:16:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.836+0000 7f00b7b22640 1 --2- 172.21.15.52:0/186285355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b006b920 0x7f00b006bd90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.836+0000 7f00b7b22640 1 -- 172.21.15.52:0/186285355 >> 172.21.15.52:0/186285355 conn(0x7f00b0074f30 msgr2=0x7f00b0075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.836+0000 7f00b7b22640 1 -- 172.21.15.52:0/186285355 shutdown_connections 2024-04-25T13:16:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.836+0000 7f00b7b22640 1 -- 172.21.15.52:0/186285355 wait complete. 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.837+0000 7f00b7b22640 1 Processor -- start 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.837+0000 7f00b7b22640 1 -- start start 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b7b22640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b006b920 0x7f00b0150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b7b22640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00b0155130 0x7f00b01f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b7b22640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b015ea20 0x7f00b01f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b7b22640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00b015bb00 con 0x7f00b015ea20 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b7b22640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f00b015b820 con 0x7f00b006b920 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b7b22640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f00b015bde0 con 0x7f00b0155130 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b60bf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b015ea20 0x7f00b01f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b60bf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b015ea20 0x7f00b01f1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46708/0 (socket says 172.21.15.52:46708) 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b60bf640 1 -- 172.21.15.52:0/898024356 learned_addr learned my addr 172.21.15.52:0/898024356 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b58be640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b006b920 0x7f00b0150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b50bd640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00b0155130 0x7f00b01f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b60bf640 1 -- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00b0155130 msgr2=0x7f00b01f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b60bf640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00b0155130 0x7f00b01f1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b60bf640 1 -- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b006b920 msgr2=0x7f00b0150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b60bf640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b006b920 0x7f00b0150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b60bf640 1 -- 172.21.15.52:0/898024356 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b00c6f30 con 0x7f00b015ea20 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.838+0000 7f00b58be640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b006b920 0x7f00b0150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.839+0000 7f00b60bf640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b015ea20 0x7f00b01f1bb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009eb0 tx=0x7f00a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.839+0000 7f00a67fc640 1 -- 172.21.15.52:0/898024356 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8041030 con 0x7f00b015ea20 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.839+0000 7f00a67fc640 1 -- 172.21.15.52:0/898024356 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a8003e10 con 0x7f00b015ea20 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.839+0000 7f00b7b22640 1 -- 172.21.15.52:0/898024356 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b014fff0 con 0x7f00b015ea20 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.839+0000 7f00a67fc640 1 -- 172.21.15.52:0/898024356 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8037040 con 0x7f00b015ea20 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.839+0000 7f00b7b22640 1 -- 172.21.15.52:0/898024356 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b0150290 con 0x7f00b015ea20 2024-04-25T13:16:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.840+0000 7f00b7b22640 1 -- 172.21.15.52:0/898024356 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b0070690 con 0x7f00b015ea20 2024-04-25T13:16:55.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.840+0000 7f00a67fc640 1 -- 172.21.15.52:0/898024356 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f00a8044070 con 0x7f00b015ea20 2024-04-25T13:16:55.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.841+0000 7f00a67fc640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f009406c8f0 0x7f009406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:55.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.841+0000 7f00a67fc640 1 -- 172.21.15.52:0/898024356 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f00a80acb10 con 0x7f00b015ea20 2024-04-25T13:16:55.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.841+0000 7f00b58be640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f009406c8f0 0x7f009406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:55.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.841+0000 7f00b58be640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f009406c8f0 0x7f009406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f00ac007fd0 tx=0x7f00ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:55.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:55.845+0000 7f00a67fc640 1 -- 172.21.15.52:0/898024356 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f00b0070690 con 0x7f00b015ea20 2024-04-25T13:16:56.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.031+0000 7f00b7b22640 1 -- 172.21.15.52:0/898024356 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f00b0068e40 con 0x7f00b015ea20 2024-04-25T13:16:56.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.032+0000 7f00a67fc640 1 -- 172.21.15.52:0/898024356 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f00a807abb0 con 0x7f00b015ea20 2024-04-25T13:16:56.032 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T13:16:56.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.033+0000 7f00b7b22640 1 -- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f009406c8f0 msgr2=0x7f009406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.033+0000 7f00b7b22640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f009406c8f0 0x7f009406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f00ac007fd0 tx=0x7f00ac009040 comp rx=0 tx=0).stop 2024-04-25T13:16:56.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.033+0000 7f00b7b22640 1 -- 172.21.15.52:0/898024356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b015ea20 msgr2=0x7f00b01f1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.033+0000 7f00b7b22640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b015ea20 0x7f00b01f1bb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009eb0 tx=0x7f00a8004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:56.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.034+0000 7f00b7b22640 1 -- 172.21.15.52:0/898024356 shutdown_connections 2024-04-25T13:16:56.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.034+0000 7f00b7b22640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f009406c8f0 0x7f009406edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.034+0000 7f00b7b22640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00b0155130 0x7f00b01f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.034+0000 7f00b7b22640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b015ea20 0x7f00b01f1bb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.034+0000 7f00b7b22640 1 --2- 172.21.15.52:0/898024356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b006b920 0x7f00b0150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.034+0000 7f00b7b22640 1 -- 172.21.15.52:0/898024356 >> 172.21.15.52:0/898024356 conn(0x7f00b0074f30 msgr2=0x7f00b014b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.034+0000 7f00b7b22640 1 -- 172.21.15.52:0/898024356 shutdown_connections 2024-04-25T13:16:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.034+0000 7f00b7b22640 1 -- 172.21.15.52:0/898024356 wait complete. 2024-04-25T13:16:56.047 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.150+0000 7ff9f118a640 1 Processor -- start 2024-04-25T13:16:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.150+0000 7ff9f118a640 1 -- start start 2024-04-25T13:16:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.151+0000 7ff9f118a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff9ec1554e0 0x7ff9ec15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.151+0000 7ff9f118a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ec1558c0 con 0x7ff9ec0b3c00 2024-04-25T13:16:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.151+0000 7ff9f118a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ec15f630 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.151+0000 7ff9f118a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ec0b4a80 con 0x7ff9ec1554e0 2024-04-25T13:16:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.151+0000 7ff9ead9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff9ec1554e0 0x7ff9ec15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.151+0000 7ff9ea59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff9ec0b3c00 0x7ff9ec0b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47910/0 (socket says 172.21.15.52:47910) 2024-04-25T13:16:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.151+0000 7ff9ead9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff9ec1554e0 0x7ff9ec15f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46712/0 (socket says 172.21.15.52:46712) 2024-04-25T13:16:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.151+0000 7ff9ea59c640 1 -- 172.21.15.52:0/2909388783 learned_addr learned my addr 172.21.15.52:0/2909388783 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.152+0000 7ff9ead9d640 1 -- 172.21.15.52:0/2909388783 >> v1:172.21.15.102:6789/0 conn(0x7ff9ec0d08a0 legacy=0x7ff9ec165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.152+0000 7ff9ead9d640 1 -- 172.21.15.52:0/2909388783 >> v1:172.21.15.52:6789/0 conn(0x7ff9ec0b3c00 legacy=0x7ff9ec0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.152+0000 7ff9ead9d640 1 -- 172.21.15.52:0/2909388783 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec0cb8c0 con 0x7ff9ec1554e0 2024-04-25T13:16:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.152+0000 7ff9ead9d640 1 --2- 172.21.15.52:0/2909388783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9ec1554e0 0x7ff9ec15f0f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0b4c00 tx=0x7ff9dc02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f00c4fb5b08953 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.153+0000 7ff9e9d9b640 1 -- 172.21.15.52:0/2909388783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc037070 con 0x7ff9ec1554e0 2024-04-25T13:16:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.153+0000 7ff9e9d9b640 1 -- 172.21.15.52:0/2909388783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc032640 con 0x7ff9ec1554e0 2024-04-25T13:16:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.153+0000 7ff9e9d9b640 1 -- 172.21.15.52:0/2909388783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc032a10 con 0x7ff9ec1554e0 2024-04-25T13:16:56.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.154+0000 7ff9f118a640 1 -- 172.21.15.52:0/2909388783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9ec1554e0 msgr2=0x7ff9ec15f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.154+0000 7ff9f118a640 1 --2- 172.21.15.52:0/2909388783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9ec1554e0 0x7ff9ec15f0f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0b4c00 tx=0x7ff9dc02a2c0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.154+0000 7ff9f118a640 1 -- 172.21.15.52:0/2909388783 shutdown_connections 2024-04-25T13:16:56.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.154+0000 7ff9f118a640 1 --2- 172.21.15.52:0/2909388783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9ec1554e0 0x7ff9ec15f0f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.154+0000 7ff9f118a640 1 -- 172.21.15.52:0/2909388783 >> 172.21.15.52:0/2909388783 conn(0x7ff9ec074d50 msgr2=0x7ff9ec075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:56.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.154+0000 7ff9f118a640 1 -- 172.21.15.52:0/2909388783 shutdown_connections 2024-04-25T13:16:56.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.154+0000 7ff9f118a640 1 -- 172.21.15.52:0/2909388783 wait complete. 2024-04-25T13:16:56.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.155+0000 7ff9f118a640 1 Processor -- start 2024-04-25T13:16:56.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.155+0000 7ff9f118a640 1 -- start start 2024-04-25T13:16:56.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.156+0000 7ff9f118a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9ec0b3c00 0x7ff9ec0c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.156+0000 7ff9f118a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9ec0d08a0 0x7ff9ec150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.156+0000 7ff9f118a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9ec1554e0 0x7ff9ec1f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.156+0000 7ff9f118a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec0b4430 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.156+0000 7ff9f118a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec0b4150 con 0x7ff9ec0b3c00 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.156+0000 7ff9f118a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ec0b4710 con 0x7ff9ec1554e0 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.156+0000 7ff9ea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9ec0d08a0 0x7ff9ec150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.156+0000 7ff9ea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9ec0d08a0 0x7ff9ec150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46728/0 (socket says 172.21.15.52:46728) 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.156+0000 7ff9ea59c640 1 -- 172.21.15.52:0/934693932 learned_addr learned my addr 172.21.15.52:0/934693932 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.156+0000 7ff9ead9d640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9ec0b3c00 0x7ff9ec0c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.156+0000 7ff9eb59e640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9ec1554e0 0x7ff9ec1f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.157+0000 7ff9ea59c640 1 -- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9ec1554e0 msgr2=0x7ff9ec1f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.157+0000 7ff9ea59c640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9ec1554e0 0x7ff9ec1f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.157+0000 7ff9ea59c640 1 -- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9ec0b3c00 msgr2=0x7ff9ec0c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.157+0000 7ff9ea59c640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9ec0b3c00 0x7ff9ec0c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.157+0000 7ff9ea59c640 1 -- 172.21.15.52:0/934693932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec1f10b0 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.157+0000 7ff9ea59c640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9ec0d08a0 0x7ff9ec150820 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c400 tx=0x7ff9e000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:56.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.157+0000 7ff9d37fe640 1 -- 172.21.15.52:0/934693932 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0017070 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.157+0000 7ff9d37fe640 1 -- 172.21.15.52:0/934693932 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e0005ce0 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.157+0000 7ff9f118a640 1 -- 172.21.15.52:0/934693932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ec1f5390 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.157+0000 7ff9d37fe640 1 -- 172.21.15.52:0/934693932 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0007310 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.157+0000 7ff9f118a640 1 -- 172.21.15.52:0/934693932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ec15f0e0 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.158+0000 7ff9f118a640 1 -- 172.21.15.52:0/934693932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ec0d1580 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.158+0000 7ff9d37fe640 1 -- 172.21.15.52:0/934693932 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff9e001a070 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.159+0000 7ff9d37fe640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff9d806c8f0 0x7ff9d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.159+0000 7ff9d37fe640 1 -- 172.21.15.52:0/934693932 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ff9e008b2e0 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.159+0000 7ff9ead9d640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff9d806c8f0 0x7ff9d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.160+0000 7ff9ead9d640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff9d806c8f0 0x7ff9d806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc034000 tx=0x7ff9dc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:56.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.164+0000 7ff9d37fe640 1 -- 172.21.15.52:0/934693932 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff9ec0d1580 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.389+0000 7ff9f118a640 1 -- 172.21.15.52:0/934693932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9ec0b3580 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.389+0000 7ff9d37fe640 1 -- 172.21.15.52:0/934693932 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6910 (secure 0 0 0) 0x7ff9ec0b3580 con 0x7ff9ec0d08a0 2024-04-25T13:16:56.390 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:56.390 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2650846419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2650846419},{"type":"v1","addr":"172.21.15.102:6837","nonce":2650846419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:07.352382+0000","modified":"2024-04-25T13:16:51.139035+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4290,"mds_1":4284,"mds_2":4273,"mds_3":4265,"mds_4":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"d","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.102:6838/1508646651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":1508646651},{"type":"v1","addr":"172.21.15.102:6838","nonce":1508646651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4265":{"gid":4265,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":14,"addr":"172.21.15.102:6839/1980846137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1980846137},{"type":"v1","addr":"172.21.15.102:6839","nonce":1980846137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4273":{"gid":4273,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.52:6835/714334205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":714334205},{"type":"v1","addr":"172.21.15.52:6835","nonce":714334205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6834/3228537118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3228537118},{"type":"v1","addr":"172.21.15.52:6834","nonce":3228537118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4290":{"gid":4290,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6837/413759311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":413759311},{"type":"v1","addr":"172.21.15.52:6837","nonce":413759311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290,4284,4273,4265]},"id":1}]} 2024-04-25T13:16:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 17 2024-04-25T13:16:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.391+0000 7ff9f118a640 1 -- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff9d806c8f0 msgr2=0x7ff9d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.391+0000 7ff9f118a640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff9d806c8f0 0x7ff9d806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc034000 tx=0x7ff9dc02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.391+0000 7ff9f118a640 1 -- 172.21.15.52:0/934693932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9ec0d08a0 msgr2=0x7ff9ec150820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.391+0000 7ff9f118a640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9ec0d08a0 0x7ff9ec150820 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c400 tx=0x7ff9e000c8c0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.391+0000 7ff9f118a640 1 -- 172.21.15.52:0/934693932 shutdown_connections 2024-04-25T13:16:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.391+0000 7ff9f118a640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff9d806c8f0 0x7ff9d806edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.391+0000 7ff9f118a640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff9ec1554e0 0x7ff9ec1f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.391+0000 7ff9f118a640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9ec0d08a0 0x7ff9ec150820 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.391+0000 7ff9f118a640 1 --2- 172.21.15.52:0/934693932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9ec0b3c00 0x7ff9ec0c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.391+0000 7ff9f118a640 1 -- 172.21.15.52:0/934693932 >> 172.21.15.52:0/934693932 conn(0x7ff9ec074d50 msgr2=0x7ff9ec0cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.391+0000 7ff9f118a640 1 -- 172.21.15.52:0/934693932 shutdown_connections 2024-04-25T13:16:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.391+0000 7ff9f118a640 1 -- 172.21.15.52:0/934693932 wait complete. 2024-04-25T13:16:56.403 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:56.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.503+0000 7fcb8d536640 1 Processor -- start 2024-04-25T13:16:56.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.503+0000 7fcb8d536640 1 -- start start 2024-04-25T13:16:56.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb8d536640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcb881554e0 0x7fcb8815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb8d536640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb880d08a0 0x7fcb880d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb8d536640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb881558c0 con 0x7fcb880b3c00 2024-04-25T13:16:56.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb8d536640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcb880b4a80 con 0x7fcb881554e0 2024-04-25T13:16:56.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb8d536640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcb8815f630 con 0x7fcb880d08a0 2024-04-25T13:16:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb86ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcb881554e0 0x7fcb8815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb867fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcb880b3c00 0x7fcb880b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47916/0 (socket says 172.21.15.52:47916) 2024-04-25T13:16:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb867fc640 1 -- 172.21.15.52:0/955471366 learned_addr learned my addr 172.21.15.52:0/955471366 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb877fe640 1 --2- 172.21.15.52:0/955471366 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb880d08a0 0x7fcb880d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb86ffd640 1 -- 172.21.15.52:0/955471366 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb880d08a0 msgr2=0x7fcb880d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb86ffd640 1 --2- 172.21.15.52:0/955471366 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb880d08a0 0x7fcb880d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb86ffd640 1 -- 172.21.15.52:0/955471366 >> v1:172.21.15.52:6789/0 conn(0x7fcb880b3c00 legacy=0x7fcb880b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.504+0000 7fcb86ffd640 1 -- 172.21.15.52:0/955471366 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb880cb8c0 con 0x7fcb881554e0 2024-04-25T13:16:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.505+0000 7fcb86ffd640 1 --2- 172.21.15.52:0/955471366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb881554e0 0x7fcb8815f0f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb780097a0 tx=0x7fcb7802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22de514357d96d6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.505+0000 7fcb85ffb640 1 -- 172.21.15.52:0/955471366 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78037070 con 0x7fcb881554e0 2024-04-25T13:16:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.505+0000 7fcb85ffb640 1 -- 172.21.15.52:0/955471366 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb78032440 con 0x7fcb881554e0 2024-04-25T13:16:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.505+0000 7fcb85ffb640 1 -- 172.21.15.52:0/955471366 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78032810 con 0x7fcb881554e0 2024-04-25T13:16:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.506+0000 7fcb8d536640 1 -- 172.21.15.52:0/955471366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb881554e0 msgr2=0x7fcb8815f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.506+0000 7fcb8d536640 1 --2- 172.21.15.52:0/955471366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb881554e0 0x7fcb8815f0f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb780097a0 tx=0x7fcb7802a210 comp rx=0 tx=0).stop 2024-04-25T13:16:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.506+0000 7fcb8d536640 1 -- 172.21.15.52:0/955471366 shutdown_connections 2024-04-25T13:16:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.506+0000 7fcb8d536640 1 --2- 172.21.15.52:0/955471366 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb880d08a0 0x7fcb880d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.506+0000 7fcb8d536640 1 --2- 172.21.15.52:0/955471366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb881554e0 0x7fcb8815f0f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.506+0000 7fcb8d536640 1 -- 172.21.15.52:0/955471366 >> 172.21.15.52:0/955471366 conn(0x7fcb88074d50 msgr2=0x7fcb88075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.506+0000 7fcb8d536640 1 -- 172.21.15.52:0/955471366 shutdown_connections 2024-04-25T13:16:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.506+0000 7fcb8d536640 1 -- 172.21.15.52:0/955471366 wait complete. 2024-04-25T13:16:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.507+0000 7fcb8d536640 1 Processor -- start 2024-04-25T13:16:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.507+0000 7fcb8d536640 1 -- start start 2024-04-25T13:16:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb8d536640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb880b3c00 0x7fcb880c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb8d536640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb880d08a0 0x7fcb8814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb8d536640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb881554e0 0x7fcb881500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb8d536640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb880b4430 con 0x7fcb880b3c00 2024-04-25T13:16:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb8d536640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcb880b4150 con 0x7fcb881554e0 2024-04-25T13:16:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb8d536640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcb880b4710 con 0x7fcb880d08a0 2024-04-25T13:16:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb86ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb880b3c00 0x7fcb880c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb86ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb880b3c00 0x7fcb880c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46738/0 (socket says 172.21.15.52:46738) 2024-04-25T13:16:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb86ffd640 1 -- 172.21.15.52:0/3862260715 learned_addr learned my addr 172.21.15.52:0/3862260715 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb86ffd640 1 -- 172.21.15.52:0/3862260715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb880d08a0 msgr2=0x7fcb8814fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb86ffd640 1 --2- 172.21.15.52:0/3862260715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb880d08a0 0x7fcb8814fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb86ffd640 1 -- 172.21.15.52:0/3862260715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb881554e0 msgr2=0x7fcb881500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb86ffd640 1 --2- 172.21.15.52:0/3862260715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb881554e0 0x7fcb881500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb86ffd640 1 -- 172.21.15.52:0/3862260715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8815b3f0 con 0x7fcb880b3c00 2024-04-25T13:16:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb86ffd640 1 --2- 172.21.15.52:0/3862260715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb880b3c00 0x7fcb880c85c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb780098c0 tx=0x7fcb780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.508+0000 7fcb6f7fe640 1 -- 172.21.15.52:0/3862260715 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78037040 con 0x7fcb880b3c00 2024-04-25T13:16:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.509+0000 7fcb6f7fe640 1 -- 172.21.15.52:0/3862260715 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb78030770 con 0x7fcb880b3c00 2024-04-25T13:16:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.509+0000 7fcb8d536640 1 -- 172.21.15.52:0/3862260715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8815b6d0 con 0x7fcb880b3c00 2024-04-25T13:16:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.509+0000 7fcb6f7fe640 1 -- 172.21.15.52:0/3862260715 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78030b40 con 0x7fcb880b3c00 2024-04-25T13:16:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.509+0000 7fcb8d536640 1 -- 172.21.15.52:0/3862260715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8815bc90 con 0x7fcb880b3c00 2024-04-25T13:16:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.510+0000 7fcb8d536640 1 -- 172.21.15.52:0/3862260715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb880cc260 con 0x7fcb880b3c00 2024-04-25T13:16:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.510+0000 7fcb6f7fe640 1 -- 172.21.15.52:0/3862260715 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb78044020 con 0x7fcb880b3c00 2024-04-25T13:16:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.511+0000 7fcb6f7fe640 1 --2- 172.21.15.52:0/3862260715 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcb7406c920 0x7fcb7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.511+0000 7fcb6f7fe640 1 -- 172.21.15.52:0/3862260715 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fcb780ac570 con 0x7fcb880b3c00 2024-04-25T13:16:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.511+0000 7fcb867fc640 1 --2- 172.21.15.52:0/3862260715 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcb7406c920 0x7fcb7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.511+0000 7fcb867fc640 1 --2- 172.21.15.52:0/3862260715 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcb7406c920 0x7fcb7406ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c000f60 tx=0x7fcb7c007a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.515+0000 7fcb6f7fe640 1 -- 172.21.15.52:0/3862260715 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcb78032e20 con 0x7fcb880b3c00 2024-04-25T13:16:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.702+0000 7fcb8d536640 1 -- 172.21.15.52:0/3862260715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb88068e20 con 0x7fcb880b3c00 2024-04-25T13:16:56.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.703+0000 7fcb6f7fe640 1 -- 172.21.15.52:0/3862260715 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18927 (secure 0 0 0) 0x7fcb7807a450 con 0x7fcb880b3c00 2024-04-25T13:16:56.703 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:56.704 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:49.125761+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:56.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.705+0000 7fcb8d536640 1 -- 172.21.15.52:0/3862260715 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcb7406c920 msgr2=0x7fcb7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.705+0000 7fcb8d536640 1 --2- 172.21.15.52:0/3862260715 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcb7406c920 0x7fcb7406ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c000f60 tx=0x7fcb7c007a80 comp rx=0 tx=0).stop 2024-04-25T13:16:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.705+0000 7fcb8d536640 1 -- 172.21.15.52:0/3862260715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb880b3c00 msgr2=0x7fcb880c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.705+0000 7fcb8d536640 1 --2- 172.21.15.52:0/3862260715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb880b3c00 0x7fcb880c85c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb780098c0 tx=0x7fcb780046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.705+0000 7fcb8d536640 1 -- 172.21.15.52:0/3862260715 shutdown_connections 2024-04-25T13:16:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.705+0000 7fcb8d536640 1 --2- 172.21.15.52:0/3862260715 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcb7406c920 0x7fcb7406ede0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.705+0000 7fcb8d536640 1 --2- 172.21.15.52:0/3862260715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb880d08a0 0x7fcb8814fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.705+0000 7fcb8d536640 1 --2- 172.21.15.52:0/3862260715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb881554e0 0x7fcb881500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.705+0000 7fcb8d536640 1 --2- 172.21.15.52:0/3862260715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb880b3c00 0x7fcb880c85c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.705+0000 7fcb8d536640 1 -- 172.21.15.52:0/3862260715 >> 172.21.15.52:0/3862260715 conn(0x7fcb88074d50 msgr2=0x7fcb88153410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.705+0000 7fcb8d536640 1 -- 172.21.15.52:0/3862260715 shutdown_connections 2024-04-25T13:16:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.705+0000 7fcb8d536640 1 -- 172.21.15.52:0/3862260715 wait complete. 2024-04-25T13:16:56.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.818+0000 7fc26f5bb640 1 Processor -- start 2024-04-25T13:16:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.818+0000 7fc26f5bb640 1 -- start start 2024-04-25T13:16:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26f5bb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2681554e0 0x7fc26815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26f5bb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc2680d08a0 0x7fc2680d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26f5bb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2681558c0 con 0x7fc2680b3c00 2024-04-25T13:16:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26f5bb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc2680b4a80 con 0x7fc2680d08a0 2024-04-25T13:16:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26f5bb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc26815f630 con 0x7fc2681554e0 2024-04-25T13:16:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26db58640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc2680d08a0 0x7fc2680d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26cb56640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc2680b3c00 0x7fc2680b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47926/0 (socket says 172.21.15.52:47926) 2024-04-25T13:16:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26cb56640 1 -- 172.21.15.52:0/1655820716 learned_addr learned my addr 172.21.15.52:0/1655820716 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26d357640 1 --2- 172.21.15.52:0/1655820716 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2681554e0 0x7fc26815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26db58640 1 -- 172.21.15.52:0/1655820716 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2681554e0 msgr2=0x7fc26815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26db58640 1 --2- 172.21.15.52:0/1655820716 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2681554e0 0x7fc26815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26db58640 1 -- 172.21.15.52:0/1655820716 >> v1:172.21.15.52:6789/0 conn(0x7fc2680b3c00 legacy=0x7fc2680b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc25ffff640 1 -- 172.21.15.52:0/1655820716 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375635896 0 0) 0x7fc258001110 con 0x7fc2680b3c00 2024-04-25T13:16:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.819+0000 7fc26db58640 1 -- 172.21.15.52:0/1655820716 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2680cb8c0 con 0x7fc2680d08a0 2024-04-25T13:16:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.820+0000 7fc26db58640 1 --2- 172.21.15.52:0/1655820716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2680d08a0 0x7fc2680d0cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc260009d90 tx=0x7fc26002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e96b397f57aebc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.820+0000 7fc25ffff640 1 -- 172.21.15.52:0/1655820716 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260007740 con 0x7fc2680d08a0 2024-04-25T13:16:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.820+0000 7fc25ffff640 1 -- 172.21.15.52:0/1655820716 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2600078e0 con 0x7fc2680d08a0 2024-04-25T13:16:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.820+0000 7fc25ffff640 1 -- 172.21.15.52:0/1655820716 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260007cb0 con 0x7fc2680d08a0 2024-04-25T13:16:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.820+0000 7fc26f5bb640 1 -- 172.21.15.52:0/1655820716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2680d08a0 msgr2=0x7fc2680d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.820+0000 7fc26f5bb640 1 --2- 172.21.15.52:0/1655820716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2680d08a0 0x7fc2680d0cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc260009d90 tx=0x7fc26002a6f0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.821+0000 7fc26f5bb640 1 -- 172.21.15.52:0/1655820716 shutdown_connections 2024-04-25T13:16:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.821+0000 7fc26f5bb640 1 --2- 172.21.15.52:0/1655820716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2680d08a0 0x7fc2680d0cf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.821+0000 7fc26f5bb640 1 --2- 172.21.15.52:0/1655820716 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2681554e0 0x7fc26815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.821+0000 7fc26f5bb640 1 -- 172.21.15.52:0/1655820716 >> 172.21.15.52:0/1655820716 conn(0x7fc268074d50 msgr2=0x7fc268075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.821+0000 7fc26f5bb640 1 -- 172.21.15.52:0/1655820716 shutdown_connections 2024-04-25T13:16:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.821+0000 7fc26f5bb640 1 -- 172.21.15.52:0/1655820716 wait complete. 2024-04-25T13:16:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.822+0000 7fc26f5bb640 1 Processor -- start 2024-04-25T13:16:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.822+0000 7fc26f5bb640 1 -- start start 2024-04-25T13:16:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.822+0000 7fc26f5bb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2680b3c00 0x7fc2681f1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.822+0000 7fc26f5bb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2680d08a0 0x7fc26815df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.822+0000 7fc26f5bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2681554e0 0x7fc26815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.822+0000 7fc26f5bb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc2680b4430 con 0x7fc2680b3c00 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.822+0000 7fc26f5bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc2680b4150 con 0x7fc2681554e0 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.822+0000 7fc26f5bb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc2680b4710 con 0x7fc2680d08a0 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26d357640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2680b3c00 0x7fc2681f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26d357640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2680b3c00 0x7fc2681f1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46752/0 (socket says 172.21.15.52:46752) 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26d357640 1 -- 172.21.15.52:0/593372885 learned_addr learned my addr 172.21.15.52:0/593372885 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26cb56640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2680d08a0 0x7fc26815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26db58640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2681554e0 0x7fc26815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26d357640 1 -- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2680d08a0 msgr2=0x7fc26815df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26d357640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2680d08a0 0x7fc26815df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26d357640 1 -- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2681554e0 msgr2=0x7fc26815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26d357640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2681554e0 0x7fc26815c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26d357640 1 -- 172.21.15.52:0/593372885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2680cd970 con 0x7fc2680b3c00 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26d357640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2680b3c00 0x7fc2681f1950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc26400d830 tx=0x7fc26400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc25dffb640 1 -- 172.21.15.52:0/593372885 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26400b6c0 con 0x7fc2680b3c00 2024-04-25T13:16:56.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc25dffb640 1 -- 172.21.15.52:0/593372885 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc264019070 con 0x7fc2680b3c00 2024-04-25T13:16:56.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26f5bb640 1 -- 172.21.15.52:0/593372885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26815c8f0 con 0x7fc2680b3c00 2024-04-25T13:16:56.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc25dffb640 1 -- 172.21.15.52:0/593372885 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26400ba80 con 0x7fc2680b3c00 2024-04-25T13:16:56.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.823+0000 7fc26f5bb640 1 -- 172.21.15.52:0/593372885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc26815ce90 con 0x7fc2680b3c00 2024-04-25T13:16:56.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.824+0000 7fc26f5bb640 1 -- 172.21.15.52:0/593372885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc268068e40 con 0x7fc2680b3c00 2024-04-25T13:16:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.825+0000 7fc25dffb640 1 -- 172.21.15.52:0/593372885 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc26401e460 con 0x7fc2680b3c00 2024-04-25T13:16:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.825+0000 7fc25dffb640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc24c06c8f0 0x7fc24c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.825+0000 7fc25dffb640 1 -- 172.21.15.52:0/593372885 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fc26408c5c0 con 0x7fc2680b3c00 2024-04-25T13:16:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.825+0000 7fc26cb56640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc24c06c8f0 0x7fc24c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.826+0000 7fc26cb56640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc24c06c8f0 0x7fc24c06edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc2680caec0 tx=0x7fc258007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:56.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:56.829+0000 7fc25dffb640 1 -- 172.21.15.52:0/593372885 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc26405a660 con 0x7fc2680b3c00 2024-04-25T13:16:57.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.053+0000 7fc26f5bb640 1 -- 172.21.15.52:0/593372885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2680cd3e0 con 0x7fc2680b3c00 2024-04-25T13:16:57.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.054+0000 7fc25dffb640 1 -- 172.21.15.52:0/593372885 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6910 (secure 0 0 0) 0x7fc264059f60 con 0x7fc2680b3c00 2024-04-25T13:16:57.054 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:57.054 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2650846419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2650846419},{"type":"v1","addr":"172.21.15.102:6837","nonce":2650846419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:07.352382+0000","modified":"2024-04-25T13:16:51.139035+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4290,"mds_1":4284,"mds_2":4273,"mds_3":4265,"mds_4":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"d","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.102:6838/1508646651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":1508646651},{"type":"v1","addr":"172.21.15.102:6838","nonce":1508646651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4265":{"gid":4265,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":14,"addr":"172.21.15.102:6839/1980846137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1980846137},{"type":"v1","addr":"172.21.15.102:6839","nonce":1980846137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4273":{"gid":4273,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.52:6835/714334205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":714334205},{"type":"v1","addr":"172.21.15.52:6835","nonce":714334205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6834/3228537118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3228537118},{"type":"v1","addr":"172.21.15.52:6834","nonce":3228537118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4290":{"gid":4290,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6837/413759311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":413759311},{"type":"v1","addr":"172.21.15.52:6837","nonce":413759311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290,4284,4273,4265]},"id":1}]} 2024-04-25T13:16:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 17 2024-04-25T13:16:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.056+0000 7fc26f5bb640 1 -- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc24c06c8f0 msgr2=0x7fc24c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.056+0000 7fc26f5bb640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc24c06c8f0 0x7fc24c06edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc2680caec0 tx=0x7fc258007c00 comp rx=0 tx=0).stop 2024-04-25T13:16:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.056+0000 7fc26f5bb640 1 -- 172.21.15.52:0/593372885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2680b3c00 msgr2=0x7fc2681f1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.056+0000 7fc26f5bb640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2680b3c00 0x7fc2681f1950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc26400d830 tx=0x7fc26400dcf0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.056+0000 7fc26f5bb640 1 -- 172.21.15.52:0/593372885 shutdown_connections 2024-04-25T13:16:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.056+0000 7fc26f5bb640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc24c06c8f0 0x7fc24c06edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.056+0000 7fc26f5bb640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2680d08a0 0x7fc26815df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.056+0000 7fc26f5bb640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2681554e0 0x7fc26815c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.056+0000 7fc26f5bb640 1 --2- 172.21.15.52:0/593372885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2680b3c00 0x7fc2681f1950 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.056+0000 7fc26f5bb640 1 -- 172.21.15.52:0/593372885 >> 172.21.15.52:0/593372885 conn(0x7fc268074d50 msgr2=0x7fc2680cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.056+0000 7fc26f5bb640 1 -- 172.21.15.52:0/593372885 shutdown_connections 2024-04-25T13:16:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:57.056+0000 7fc26f5bb640 1 -- 172.21.15.52:0/593372885 wait complete. 2024-04-25T13:16:57.671 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:16:07.352382+0000', 'modified': '2024-04-25T13:16:51.139035+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4290, 'mds_1': 4284, 'mds_2': 4273, 'mds_3': 4265, 'mds_4': 4262}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4262': {'gid': 4262, 'name': 'd', 'rank': 4, 'incarnation': 17, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.102:6838/1508646651', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6835', 'nonce': 1508646651}, {'type': 'v1', 'addr': '172.21.15.102:6838', 'nonce': 1508646651}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4265': {'gid': 4265, 'name': 'f', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.102:6839/1980846137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 1980846137}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 1980846137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4273': {'gid': 4273, 'name': 'c', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.52:6835/714334205', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6833', 'nonce': 714334205}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 714334205}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.52:6834/3228537118', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 3228537118}, {'type': 'v1', 'addr': '172.21.15.52:6834', 'nonce': 3228537118}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4290': {'gid': 4290, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.52:6837/413759311', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6836', 'nonce': 413759311}, {'type': 'v1', 'addr': '172.21.15.52:6837', 'nonce': 413759311}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4290, 'qdb_cluster': [4290, 4284, 4273, 4265]} 2024-04-25T13:16:57.671 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4262:up:creating 2024-04-25T13:16:58.672 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:58.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.772+0000 7fc95b120640 1 Processor -- start 2024-04-25T13:16:58.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.773+0000 7fc95b120640 1 -- start start 2024-04-25T13:16:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.773+0000 7fc95b120640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc9540c8870 0x7fc95415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.773+0000 7fc95b120640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc95415ca00 0x7fc954073a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.773+0000 7fc95b120640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95415ce70 con 0x7fc954152f70 2024-04-25T13:16:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.773+0000 7fc95b120640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc954158fe0 con 0x7fc9540c8870 2024-04-25T13:16:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.773+0000 7fc95b120640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc9541592c0 con 0x7fc95415ca00 2024-04-25T13:16:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.773+0000 7fc953fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc9540c8870 0x7fc95415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.774+0000 7fc953fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc9540c8870 0x7fc95415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57102/0 (socket says 172.21.15.52:57102) 2024-04-25T13:16:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.774+0000 7fc953fff640 1 -- 172.21.15.52:0/3260478561 learned_addr learned my addr 172.21.15.52:0/3260478561 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.774+0000 7fc953fff640 1 -- 172.21.15.52:0/3260478561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc95415ca00 msgr2=0x7fc954073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.774+0000 7fc9596bd640 1 --2- 172.21.15.52:0/3260478561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc95415ca00 0x7fc954073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.774+0000 7fc953fff640 1 --2- 172.21.15.52:0/3260478561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc95415ca00 0x7fc954073a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.774+0000 7fc953fff640 1 -- 172.21.15.52:0/3260478561 >> v1:172.21.15.102:6789/0 conn(0x7fc954152f70 legacy=0x7fc9540c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.774+0000 7fc953fff640 1 -- 172.21.15.52:0/3260478561 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9541595a0 con 0x7fc9540c8870 2024-04-25T13:16:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.774+0000 7fc9596bd640 1 --2- 172.21.15.52:0/3260478561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc95415ca00 0x7fc954073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.775+0000 7fc953fff640 1 --2- 172.21.15.52:0/3260478561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9540c8870 0x7fc95415c4c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc940009870 tx=0x7fc94002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d5c88ed76d7b4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.775+0000 7fc9537fe640 1 -- 172.21.15.52:0/3260478561 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940037070 con 0x7fc9540c8870 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.775+0000 7fc9537fe640 1 -- 172.21.15.52:0/3260478561 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc940032440 con 0x7fc9540c8870 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.775+0000 7fc9537fe640 1 -- 172.21.15.52:0/3260478561 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940032810 con 0x7fc9540c8870 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.775+0000 7fc95b120640 1 -- 172.21.15.52:0/3260478561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9540c8870 msgr2=0x7fc95415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.775+0000 7fc95b120640 1 --2- 172.21.15.52:0/3260478561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9540c8870 0x7fc95415c4c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc940009870 tx=0x7fc94002a200 comp rx=0 tx=0).stop 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.775+0000 7fc95b120640 1 -- 172.21.15.52:0/3260478561 shutdown_connections 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.775+0000 7fc95b120640 1 --2- 172.21.15.52:0/3260478561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc95415ca00 0x7fc954073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.775+0000 7fc95b120640 1 --2- 172.21.15.52:0/3260478561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9540c8870 0x7fc95415c4c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.775+0000 7fc95b120640 1 -- 172.21.15.52:0/3260478561 >> 172.21.15.52:0/3260478561 conn(0x7fc954074d50 msgr2=0x7fc954075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.775+0000 7fc95b120640 1 -- 172.21.15.52:0/3260478561 shutdown_connections 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.775+0000 7fc95b120640 1 -- 172.21.15.52:0/3260478561 wait complete. 2024-04-25T13:16:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.776+0000 7fc95b120640 1 Processor -- start 2024-04-25T13:16:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.777+0000 7fc95b120640 1 -- start start 2024-04-25T13:16:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.777+0000 7fc95b120640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9540c8870 0x7fc954151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.777+0000 7fc95b120640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc954152f70 0x7fc9541f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.777+0000 7fc95b120640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc95415ca00 0x7fc9541f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.777+0000 7fc95b120640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc954153350 con 0x7fc9540c8870 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.777+0000 7fc95b120640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc954159b60 con 0x7fc954152f70 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.777+0000 7fc95b120640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc9541534d0 con 0x7fc95415ca00 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.777+0000 7fc958ebc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9540c8870 0x7fc954151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc958ebc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9540c8870 0x7fc954151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57106/0 (socket says 172.21.15.52:57106) 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc958ebc640 1 -- 172.21.15.52:0/3279506962 learned_addr learned my addr 172.21.15.52:0/3279506962 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc953fff640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc954152f70 0x7fc9541f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc9596bd640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc95415ca00 0x7fc9541f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc958ebc640 1 -- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc95415ca00 msgr2=0x7fc9541f2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc958ebc640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc95415ca00 0x7fc9541f2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc958ebc640 1 -- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc954152f70 msgr2=0x7fc9541f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc958ebc640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc954152f70 0x7fc9541f22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc958ebc640 1 -- 172.21.15.52:0/3279506962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9541577e0 con 0x7fc9540c8870 2024-04-25T13:16:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc958ebc640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9540c8870 0x7fc954151d40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc94800c460 tx=0x7fc94800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc9517fa640 1 -- 172.21.15.52:0/3279506962 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948016020 con 0x7fc9540c8870 2024-04-25T13:16:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc9517fa640 1 -- 172.21.15.52:0/3279506962 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc948012870 con 0x7fc9540c8870 2024-04-25T13:16:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc95b120640 1 -- 172.21.15.52:0/3279506962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9540cb600 con 0x7fc9540c8870 2024-04-25T13:16:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc9517fa640 1 -- 172.21.15.52:0/3279506962 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948012c60 con 0x7fc9540c8870 2024-04-25T13:16:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.778+0000 7fc95b120640 1 -- 172.21.15.52:0/3279506962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc954156f40 con 0x7fc9540c8870 2024-04-25T13:16:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.779+0000 7fc95b120640 1 -- 172.21.15.52:0/3279506962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc954068e40 con 0x7fc9540c8870 2024-04-25T13:16:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.780+0000 7fc9517fa640 1 -- 172.21.15.52:0/3279506962 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc948019020 con 0x7fc9540c8870 2024-04-25T13:16:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.780+0000 7fc9517fa640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc93806c8f0 0x7fc93806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.781+0000 7fc9517fa640 1 -- 172.21.15.52:0/3279506962 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fc94808bb60 con 0x7fc9540c8870 2024-04-25T13:16:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.781+0000 7fc953fff640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc93806c8f0 0x7fc93806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.781+0000 7fc953fff640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc93806c8f0 0x7fc93806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc940034000 tx=0x7fc94002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:58.785+0000 7fc9517fa640 1 -- 172.21.15.52:0/3279506962 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc948020030 con 0x7fc9540c8870 2024-04-25T13:16:59.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.008+0000 7fc95b120640 1 -- 172.21.15.52:0/3279506962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9540c8290 con 0x7fc9540c8870 2024-04-25T13:16:59.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.008+0000 7fc9517fa640 1 -- 172.21.15.52:0/3279506962 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6914 (secure 0 0 0) 0x7fc948059520 con 0x7fc9540c8870 2024-04-25T13:16:59.009 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:16:59.009 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2650846419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2650846419},{"type":"v1","addr":"172.21.15.102:6837","nonce":2650846419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:07.352382+0000","modified":"2024-04-25T13:16:57.155694+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4290,"mds_1":4284,"mds_2":4273,"mds_3":4265,"mds_4":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":15,"addr":"172.21.15.102:6838/1508646651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":1508646651},{"type":"v1","addr":"172.21.15.102:6838","nonce":1508646651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4265":{"gid":4265,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":14,"addr":"172.21.15.102:6839/1980846137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1980846137},{"type":"v1","addr":"172.21.15.102:6839","nonce":1980846137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4273":{"gid":4273,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.52:6835/714334205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":714334205},{"type":"v1","addr":"172.21.15.52:6835","nonce":714334205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6834/3228537118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3228537118},{"type":"v1","addr":"172.21.15.52:6834","nonce":3228537118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4290":{"gid":4290,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6837/413759311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":413759311},{"type":"v1","addr":"172.21.15.52:6837","nonce":413759311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4262,4265,4273,4284,4290]},"id":1}]} 2024-04-25T13:16:59.009 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 18 2024-04-25T13:16:59.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.010+0000 7fc95b120640 1 -- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc93806c8f0 msgr2=0x7fc93806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.010+0000 7fc95b120640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc93806c8f0 0x7fc93806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc940034000 tx=0x7fc94002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:59.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.010+0000 7fc95b120640 1 -- 172.21.15.52:0/3279506962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9540c8870 msgr2=0x7fc954151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.010+0000 7fc95b120640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9540c8870 0x7fc954151d40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc94800c460 tx=0x7fc94800c920 comp rx=0 tx=0).stop 2024-04-25T13:16:59.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.010+0000 7fc95b120640 1 -- 172.21.15.52:0/3279506962 shutdown_connections 2024-04-25T13:16:59.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.010+0000 7fc95b120640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc93806c8f0 0x7fc93806edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.010+0000 7fc95b120640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc95415ca00 0x7fc9541f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.010+0000 7fc95b120640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc954152f70 0x7fc9541f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.010+0000 7fc95b120640 1 --2- 172.21.15.52:0/3279506962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9540c8870 0x7fc954151d40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.010+0000 7fc95b120640 1 -- 172.21.15.52:0/3279506962 >> 172.21.15.52:0/3279506962 conn(0x7fc954074d50 msgr2=0x7fc954075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.011+0000 7fc95b120640 1 -- 172.21.15.52:0/3279506962 shutdown_connections 2024-04-25T13:16:59.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.011+0000 7fc95b120640 1 -- 172.21.15.52:0/3279506962 wait complete. 2024-04-25T13:16:59.626 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:16:07.352382+0000', 'modified': '2024-04-25T13:16:57.155694+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4290, 'mds_1': 4284, 'mds_2': 4273, 'mds_3': 4265, 'mds_4': 4262}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4262': {'gid': 4262, 'name': 'd', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.102:6838/1508646651', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6835', 'nonce': 1508646651}, {'type': 'v1', 'addr': '172.21.15.102:6838', 'nonce': 1508646651}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4265': {'gid': 4265, 'name': 'f', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.102:6839/1980846137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 1980846137}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 1980846137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4273': {'gid': 4273, 'name': 'c', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.52:6835/714334205', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6833', 'nonce': 714334205}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 714334205}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.52:6834/3228537118', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 3228537118}, {'type': 'v1', 'addr': '172.21.15.52:6834', 'nonce': 3228537118}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4290': {'gid': 4290, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.52:6837/413759311', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6836', 'nonce': 413759311}, {'type': 'v1', 'addr': '172.21.15.52:6837', 'nonce': 413759311}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4290, 'qdb_cluster': [4262, 4265, 4273, 4284, 4290]} 2024-04-25T13:16:59.627 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-25T13:16:59.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T13:16:59.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.728+0000 7f7c97720640 1 Processor -- start 2024-04-25T13:16:59.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.728+0000 7f7c97720640 1 -- start start 2024-04-25T13:16:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c97720640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c9015c620 0x7f7c9015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c97720640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c9015cff0 con 0x7f7c900ca940 2024-04-25T13:16:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c97720640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c900c7690 con 0x7f7c90153130 2024-04-25T13:16:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c97720640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7c90159c20 con 0x7f7c9015c620 2024-04-25T13:16:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c94cbb640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7c900ca940 0x7f7c900ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41124/0 (socket says 172.21.15.52:41124) 2024-04-25T13:16:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c94cbb640 1 -- 172.21.15.52:0/589304603 learned_addr learned my addr 172.21.15.52:0/589304603 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:16:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/589304603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c9015c620 0x7f7c9015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c87fff640 1 -- 172.21.15.52:0/589304603 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277011551 0 0) 0x7f7c9015cff0 con 0x7f7c900ca940 2024-04-25T13:16:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c87fff640 1 -- 172.21.15.52:0/589304603 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c7c003520 con 0x7f7c900ca940 2024-04-25T13:16:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c87fff640 1 -- 172.21.15.52:0/589304603 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2337697616 0 0) 0x7f7c900c7690 con 0x7f7c90153130 2024-04-25T13:16:59.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c87fff640 1 -- 172.21.15.52:0/589304603 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c9015cff0 con 0x7f7c90153130 2024-04-25T13:16:59.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c95cbd640 1 -- 172.21.15.52:0/589304603 >> v1:172.21.15.102:6789/0 conn(0x7f7c90153130 legacy=0x7f7c90073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c95cbd640 1 -- 172.21.15.52:0/589304603 >> v1:172.21.15.52:6789/0 conn(0x7f7c900ca940 legacy=0x7f7c900ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.729+0000 7f7c87fff640 1 -- 172.21.15.52:0/589304603 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3491030697 0 0) 0x7f7c7c003520 con 0x7f7c900ca940 2024-04-25T13:16:59.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.730+0000 7f7c95cbd640 1 -- 172.21.15.52:0/589304603 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c90158d50 con 0x7f7c9015c620 2024-04-25T13:16:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.730+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/589304603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c9015c620 0x7f7c9015cab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c900c7860 tx=0x7f7c8802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60ce4d8e8d54023c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.730+0000 7f7c87fff640 1 -- 172.21.15.52:0/589304603 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80001670 con 0x7f7c9015c620 2024-04-25T13:16:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.730+0000 7f7c87fff640 1 -- 172.21.15.52:0/589304603 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c88007540 con 0x7f7c9015c620 2024-04-25T13:16:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.731+0000 7f7c87fff640 1 -- 172.21.15.52:0/589304603 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88007910 con 0x7f7c9015c620 2024-04-25T13:16:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.731+0000 7f7c97720640 1 -- 172.21.15.52:0/589304603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c9015c620 msgr2=0x7f7c9015cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.731+0000 7f7c97720640 1 --2- 172.21.15.52:0/589304603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c9015c620 0x7f7c9015cab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c900c7860 tx=0x7f7c8802a660 comp rx=0 tx=0).stop 2024-04-25T13:16:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.731+0000 7f7c97720640 1 -- 172.21.15.52:0/589304603 shutdown_connections 2024-04-25T13:16:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.731+0000 7f7c97720640 1 --2- 172.21.15.52:0/589304603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c9015c620 0x7f7c9015cab0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.731+0000 7f7c97720640 1 -- 172.21.15.52:0/589304603 >> 172.21.15.52:0/589304603 conn(0x7f7c90074d50 msgr2=0x7f7c90075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.731+0000 7f7c97720640 1 -- 172.21.15.52:0/589304603 shutdown_connections 2024-04-25T13:16:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.731+0000 7f7c97720640 1 -- 172.21.15.52:0/589304603 wait complete. 2024-04-25T13:16:59.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.732+0000 7f7c97720640 1 Processor -- start 2024-04-25T13:16:59.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.732+0000 7f7c97720640 1 -- start start 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.733+0000 7f7c97720640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c900ca940 0x7f7c901518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.733+0000 7f7c97720640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c90153130 0x7f7c90150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.733+0000 7f7c97720640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c9015c620 0x7f7c9015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.733+0000 7f7c97720640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901595d0 con 0x7f7c9015c620 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.733+0000 7f7c97720640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901592f0 con 0x7f7c900ca940 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.733+0000 7f7c97720640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7c901598b0 con 0x7f7c90153130 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.733+0000 7f7c95cbd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c9015c620 0x7f7c9015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.733+0000 7f7c95cbd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c9015c620 0x7f7c9015a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57118/0 (socket says 172.21.15.52:57118) 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.733+0000 7f7c95cbd640 1 -- 172.21.15.52:0/3956430759 learned_addr learned my addr 172.21.15.52:0/3956430759 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.733+0000 7f7c954bc640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c900ca940 0x7f7c901518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.733+0000 7f7c94cbb640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c90153130 0x7f7c90150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.734+0000 7f7c95cbd640 1 -- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c90153130 msgr2=0x7f7c90150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.734+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c90153130 0x7f7c90150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.734+0000 7f7c95cbd640 1 -- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c900ca940 msgr2=0x7f7c901518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.734+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c900ca940 0x7f7c901518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.734+0000 7f7c95cbd640 1 -- 172.21.15.52:0/3956430759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c900cd260 con 0x7f7c9015c620 2024-04-25T13:16:59.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.734+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c9015c620 0x7f7c9015a780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009eb0 tx=0x7f7c88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.734+0000 7f7c85ffb640 1 -- 172.21.15.52:0/3956430759 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8803f070 con 0x7f7c9015c620 2024-04-25T13:16:59.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.734+0000 7f7c85ffb640 1 -- 172.21.15.52:0/3956430759 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c88031bc0 con 0x7f7c9015c620 2024-04-25T13:16:59.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.734+0000 7f7c97720640 1 -- 172.21.15.52:0/3956430759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c900cd540 con 0x7f7c9015c620 2024-04-25T13:16:59.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.734+0000 7f7c85ffb640 1 -- 172.21.15.52:0/3956430759 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88007e90 con 0x7f7c9015c620 2024-04-25T13:16:59.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.734+0000 7f7c97720640 1 -- 172.21.15.52:0/3956430759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c900cdb00 con 0x7f7c9015c620 2024-04-25T13:16:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.736+0000 7f7c85ffb640 1 -- 172.21.15.52:0/3956430759 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c8803b410 con 0x7f7c9015c620 2024-04-25T13:16:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.736+0000 7f7c85ffb640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7c7406c920 0x7f7c7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.737+0000 7f7c85ffb640 1 -- 172.21.15.52:0/3956430759 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f7c880ad1f0 con 0x7f7c9015c620 2024-04-25T13:16:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.737+0000 7f7c954bc640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7c7406c920 0x7f7c7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.737+0000 7f7c954bc640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7c7406c920 0x7f7c7406ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0011e0 tx=0x7f7c8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.737+0000 7f7c9a436740 1 Processor -- start 2024-04-25T13:16:59.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.737+0000 7f7c9a436740 1 -- start start 2024-04-25T13:16:59.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c9a436740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 0x55d7d6db8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c9a436740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d73fc0 0x55d7d6d77f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c9a436740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6dc28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c9a436740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7d6cddc50 con 0x55d7d6d73fc0 2024-04-25T13:16:59.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c9a436740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d7d6c7a830 con 0x55d7d6d74690 2024-04-25T13:16:59.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c9a436740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55d7d6cd9c10 con 0x55d7d6d74a70 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c94cbb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d73fc0 0x55d7d6d77f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c94cbb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d73fc0 0x55d7d6d77f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57132/0 (socket says 172.21.15.52:57132) 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c94cbb640 1 -- 172.21.15.52:0/4104190223 learned_addr learned my addr 172.21.15.52:0/4104190223 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c954bc640 1 --2- 172.21.15.52:0/4104190223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 0x55d7d6db8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/4104190223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6dc28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c94cbb640 1 -- 172.21.15.52:0/4104190223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 msgr2=0x55d7d6dc28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c94cbb640 1 --2- 172.21.15.52:0/4104190223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6dc28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c94cbb640 1 -- 172.21.15.52:0/4104190223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 msgr2=0x55d7d6db8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c94cbb640 1 --2- 172.21.15.52:0/4104190223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 0x55d7d6db8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.738+0000 7f7c94cbb640 1 -- 172.21.15.52:0/4104190223 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7d69f02d0 con 0x55d7d6d73fc0 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c94cbb640 1 --2- 172.21.15.52:0/4104190223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d73fc0 0x55d7d6d77f40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7c80001e10 tx=0x7f7c80007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfee9a533404e45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c7affd640 1 -- 172.21.15.52:0/4104190223 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80019070 con 0x55d7d6d73fc0 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c7affd640 1 -- 172.21.15.52:0/4104190223 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c80005ae0 con 0x55d7d6d73fc0 2024-04-25T13:16:59.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c7affd640 1 -- 172.21.15.52:0/4104190223 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c800070d0 con 0x55d7d6d73fc0 2024-04-25T13:16:59.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c9a436740 1 -- 172.21.15.52:0/4104190223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d73fc0 msgr2=0x55d7d6d77f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:59.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c9a436740 1 --2- 172.21.15.52:0/4104190223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d73fc0 0x55d7d6d77f40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7c80001e10 tx=0x7f7c80007d80 comp rx=0 tx=0).stop 2024-04-25T13:16:59.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c9a436740 1 -- 172.21.15.52:0/4104190223 shutdown_connections 2024-04-25T13:16:59.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c9a436740 1 --2- 172.21.15.52:0/4104190223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6dc28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c9a436740 1 --2- 172.21.15.52:0/4104190223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d73fc0 0x55d7d6d77f40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c9a436740 1 --2- 172.21.15.52:0/4104190223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 0x55d7d6db8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c9a436740 1 -- 172.21.15.52:0/4104190223 >> 172.21.15.52:0/4104190223 conn(0x55d7d6d75c80 msgr2=0x55d7d6d78580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:59.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c9a436740 1 -- 172.21.15.52:0/4104190223 shutdown_connections 2024-04-25T13:16:59.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.739+0000 7f7c9a436740 1 -- 172.21.15.52:0/4104190223 wait complete. 2024-04-25T13:16:59.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.740+0000 7f7c9a436740 1 -- start start 2024-04-25T13:16:59.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.740+0000 7f7c9a436740 1 Processor -- start 2024-04-25T13:16:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c9a436740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 0x55d7d6d9db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c9a436740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6d96bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c9a436740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 0x55d7d6d93ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c9a436740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7d6db9700 con 0x55d7d6d955b0 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c9a436740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d7d6c78470 con 0x55d7d6d74690 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c9a436740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55d7d6d770e0 con 0x55d7d6d74a70 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c9a436740 10 client.0 _ll_register_callbacks cb 0x55d7d6c9df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c95cbd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 0x55d7d6d93ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c954bc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 0x55d7d6d9db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c95cbd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 0x55d7d6d93ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57146/0 (socket says 172.21.15.52:57146) 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c95cbd640 1 -- 172.21.15.52:0/1620872758 learned_addr learned my addr 172.21.15.52:0/1620872758 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c94cbb640 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6d96bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c95cbd640 1 -- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 msgr2=0x55d7d6d96bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6d96bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c95cbd640 1 -- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 msgr2=0x55d7d6d9db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 0x55d7d6d9db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.741+0000 7f7c95cbd640 1 -- 172.21.15.52:0/1620872758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7d6aba6b0 con 0x55d7d6d955b0 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 0x55d7d6d93ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c880ab390 tx=0x7f7c880ad110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2532129f60016869 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c6ffff640 1 -- 172.21.15.52:0/1620872758 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88048040 con 0x55d7d6d955b0 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c6ffff640 1 -- 172.21.15.52:0/1620872758 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f7c8807ad70 con 0x55d7d6d955b0 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c9a436740 1 -- 172.21.15.52:0/1620872758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c80005ae0 con 0x55d7d6d955b0 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c6ffff640 1 -- 172.21.15.52:0/1620872758 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7c8807eec0 con 0x55d7d6d955b0 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c9a436740 10 client.4905 fetch_fsmap learned FSMap version 18 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c9a436740 1 -- 172.21.15.52:0/1620872758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55d7d6d94c60 con 0x55d7d6d955b0 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c6ffff640 1 -- 172.21.15.52:0/1620872758 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c80005ae0 con 0x55d7d6d955b0 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c6ffff640 1 -- 172.21.15.52:0/1620872758 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f7c88094020 con 0x55d7d6d955b0 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c9a436740 10 client.4905 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:16:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c9a436740 10 client.4905 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c9a436740 20 client.4905 populate_metadata read hostname 'smithi052' 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c9a436740 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6dce040 0x55d7d6dd9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c9a436740 4 client.4905 mds_command: new command op to 4262 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c9a436740 1 -- 172.21.15.52:0/1620872758 --> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7d6ceb670 con 0x55d7d6dce040 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.742+0000 7f7c954bc640 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6dce040 0x55d7d6dd9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.743+0000 7f7c6ffff640 10 client.4905 ms_handle_connect on v2:172.21.15.102:6835/1508646651 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.743+0000 7f7c954bc640 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6dce040 0x55d7d6dd9930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ceccba868aa422fe server_cookie=ad1c4b6904c7461c in_seq=0 out_seq=0 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.743+0000 7f7c954bc640 1 -- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6dce040 msgr2=0x55d7d6dd9930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 17 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.743+0000 7f7c954bc640 1 -- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6dce040 msgr2=0x55d7d6dd9930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.743+0000 7f7c954bc640 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6dce040 0x55d7d6dd9930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.743+0000 7f7c954bc640 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6dce040 0x55d7d6dd9930 unknown :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.743+0000 7f7c954bc640 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6dce040 0x55d7d6dd9930 unknown :-1 s=BANNER_CONNECTING pgs=16 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.744+0000 7f7c6ffff640 10 client.4905 ms_handle_connect on v2:172.21.15.102:6835/1508646651 2024-04-25T13:16:59.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:16:59.744+0000 7f7c954bc640 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6dce040 0x55d7d6dd9930 crc :-1 s=READY pgs=16 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ceccba868aa422fe server_cookie=ad1c4b6904c7461c in_seq=0 out_seq=1 2024-04-25T13:17:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c6ffff640 1 -- 172.21.15.52:0/1620872758 <== mds.4 v2:172.21.15.102:6835/1508646651 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d7d6ceb670 con 0x55d7d6dce040 2024-04-25T13:17:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c6ffff640 10 client.4905 handle_command_reply: tid=0 2024-04-25T13:17:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c9a436740 1 client.4905 shutdown 2024-04-25T13:17:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c9a436740 1 -- 172.21.15.52:0/1620872758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 msgr2=0x55d7d6d93ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c9a436740 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 0x55d7d6d93ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c880ab390 tx=0x7f7c880ad110 comp rx=0 tx=0).stop 2024-04-25T13:17:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c9a436740 1 -- 172.21.15.52:0/1620872758 shutdown_connections 2024-04-25T13:17:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c9a436740 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6d96bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c9a436740 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6dce040 0x55d7d6dd9930 crc :-1 s=READY pgs=16 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c9a436740 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 0x55d7d6d93ad0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c9a436740 1 --2- 172.21.15.52:0/1620872758 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 0x55d7d6d9db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c6ffff640 0 client.4905 ms_handle_reset on v2:172.21.15.102:6835/1508646651 2024-04-25T13:17:02.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c9a436740 1 -- 172.21.15.52:0/1620872758 >> 172.21.15.52:0/1620872758 conn(0x55d7d6d73fc0 msgr2=0x55d7d6d731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c9a436740 1 -- 172.21.15.52:0/1620872758 shutdown_connections 2024-04-25T13:17:02.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c9a436740 1 -- 172.21.15.52:0/1620872758 wait complete. 2024-04-25T13:17:02.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.162+0000 7f7c9a436740 20 client.4905 trim_cache size 0 max 16384 2024-04-25T13:17:02.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.182+0000 7f7c9a436740 1 Processor -- start 2024-04-25T13:17:02.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.182+0000 7f7c9a436740 1 -- start start 2024-04-25T13:17:02.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c9a436740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d74690 0x55d7d6d77480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c9a436740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74a70 0x55d7d6dcd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c9a436740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d955b0 0x55d7d6dcd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c9a436740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901fcf70 con 0x55d7d6d74690 2024-04-25T13:17:02.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c9a436740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d7d6d98dd0 con 0x55d7d6d74a70 2024-04-25T13:17:02.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c9a436740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55d7d6d97390 con 0x55d7d6d955b0 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c954bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d74690 0x55d7d6d77480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c954bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d74690 0x55d7d6d77480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57156/0 (socket says 172.21.15.52:57156) 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c954bc640 1 -- 172.21.15.52:0/26006432 learned_addr learned my addr 172.21.15.52:0/26006432 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c94cbb640 1 --2- 172.21.15.52:0/26006432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74a70 0x55d7d6dcd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/26006432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d955b0 0x55d7d6dcd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c954bc640 1 -- 172.21.15.52:0/26006432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d955b0 msgr2=0x55d7d6dcd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c954bc640 1 --2- 172.21.15.52:0/26006432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d955b0 0x55d7d6dcd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c954bc640 1 -- 172.21.15.52:0/26006432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74a70 msgr2=0x55d7d6dcd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c954bc640 1 --2- 172.21.15.52:0/26006432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74a70 0x55d7d6dcd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c954bc640 1 -- 172.21.15.52:0/26006432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7d6db8de0 con 0x55d7d6d74690 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c94cbb640 1 --2- 172.21.15.52:0/26006432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74a70 0x55d7d6dcd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.183+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/26006432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d955b0 0x55d7d6dcd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.184+0000 7f7c954bc640 1 --2- 172.21.15.52:0/26006432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d74690 0x55d7d6d77480 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00e530 tx=0x7f7c8c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755963d829f0250d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.184+0000 7f7c7a7fc640 1 -- 172.21.15.52:0/26006432 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c00ed20 con 0x55d7d6d74690 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.184+0000 7f7c7a7fc640 1 -- 172.21.15.52:0/26006432 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8c02d360 con 0x55d7d6d74690 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.184+0000 7f7c7a7fc640 1 -- 172.21.15.52:0/26006432 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c02d510 con 0x55d7d6d74690 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.184+0000 7f7c9a436740 1 -- 172.21.15.52:0/26006432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d74690 msgr2=0x55d7d6d77480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.184+0000 7f7c9a436740 1 --2- 172.21.15.52:0/26006432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d74690 0x55d7d6d77480 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00e530 tx=0x7f7c8c012000 comp rx=0 tx=0).stop 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.184+0000 7f7c9a436740 1 -- 172.21.15.52:0/26006432 shutdown_connections 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.184+0000 7f7c9a436740 1 --2- 172.21.15.52:0/26006432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d955b0 0x55d7d6dcd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.184+0000 7f7c9a436740 1 --2- 172.21.15.52:0/26006432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74a70 0x55d7d6dcd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.184+0000 7f7c9a436740 1 --2- 172.21.15.52:0/26006432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d74690 0x55d7d6d77480 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.184+0000 7f7c9a436740 1 -- 172.21.15.52:0/26006432 >> 172.21.15.52:0/26006432 conn(0x55d7d6d73fc0 msgr2=0x55d7d6d78510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.185+0000 7f7c9a436740 1 -- 172.21.15.52:0/26006432 shutdown_connections 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.185+0000 7f7c9a436740 1 -- 172.21.15.52:0/26006432 wait complete. 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.185+0000 7f7c9a436740 1 -- start start 2024-04-25T13:17:02.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.185+0000 7f7c9a436740 1 Processor -- start 2024-04-25T13:17:02.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c9a436740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 0x55d7d6d93670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c9a436740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6e2f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c9a436740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 0x55d7d6da2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c9a436740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7d6dcdec0 con 0x55d7d6d955b0 2024-04-25T13:17:02.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c9a436740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d7d6dbcf60 con 0x55d7d6d74690 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c9a436740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55d7d6dce550 con 0x55d7d6d74a70 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c9a436740 10 client.0 _ll_register_callbacks cb 0x7f7c8807a470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c95cbd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 0x55d7d6da2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c95cbd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 0x55d7d6da2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57158/0 (socket says 172.21.15.52:57158) 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c95cbd640 1 -- 172.21.15.52:0/4121649436 learned_addr learned my addr 172.21.15.52:0/4121649436 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c954bc640 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 0x55d7d6d93670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c94cbb640 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6e2f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c95cbd640 1 -- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 msgr2=0x55d7d6e2f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6e2f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c95cbd640 1 -- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 msgr2=0x55d7d6d93670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 0x55d7d6d93670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c95cbd640 1 -- 172.21.15.52:0/4121649436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7d6d79280 con 0x55d7d6d955b0 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.186+0000 7f7c94cbb640 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6e2f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c95cbd640 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 0x55d7d6da2330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c8807aaa0 tx=0x7f7c880ab260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6adfbefbe369deb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c6ffff640 1 -- 172.21.15.52:0/4121649436 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88048070 con 0x55d7d6d955b0 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c6ffff640 1 -- 172.21.15.52:0/4121649436 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f7c88083460 con 0x55d7d6d955b0 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c9a436740 1 -- 172.21.15.52:0/4121649436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c8c02d360 con 0x55d7d6d955b0 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c6ffff640 1 -- 172.21.15.52:0/4121649436 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7c88083740 con 0x55d7d6d955b0 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c9a436740 10 client.4911 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c9a436740 1 -- 172.21.15.52:0/4121649436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55d7d6dcdab0 con 0x55d7d6d955b0 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c6ffff640 1 -- 172.21.15.52:0/4121649436 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8c02d360 con 0x55d7d6d955b0 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c6ffff640 1 -- 172.21.15.52:0/4121649436 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f7c88094070 con 0x55d7d6d955b0 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c9a436740 10 client.4911 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c9a436740 10 client.4911 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c9a436740 20 client.4911 populate_metadata read hostname 'smithi052' 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c9a436740 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6d99b00 0x55d7d6e41ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c9a436740 4 client.4911 mds_command: new command op to 4262 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c9a436740 1 -- 172.21.15.52:0/4121649436 --> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] -- command(tid 0: {"prefix": "status"}) -- 0x55d7d6ce54e0 con 0x55d7d6d99b00 2024-04-25T13:17:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.187+0000 7f7c954bc640 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6d99b00 0x55d7d6e41ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c6ffff640 10 client.4911 ms_handle_connect on v2:172.21.15.102:6835/1508646651 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c954bc640 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6d99b00 0x55d7d6e41ba0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a3aeea4b5276cfc4 server_cookie=4d61cc2c69c12056 in_seq=0 out_seq=0 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c6ffff640 1 -- 172.21.15.52:0/4121649436 <== mds.4 v2:172.21.15.102:6835/1508646651 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55d7d6ce54e0 con 0x55d7d6d99b00 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c6ffff640 10 client.4911 handle_command_reply: tid=0 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c9a436740 1 client.4911 shutdown 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c9a436740 1 -- 172.21.15.52:0/4121649436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 msgr2=0x55d7d6da2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c9a436740 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 0x55d7d6da2330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c8807aaa0 tx=0x7f7c880ab260 comp rx=0 tx=0).stop 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c9a436740 1 -- 172.21.15.52:0/4121649436 shutdown_connections 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c9a436740 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d7d6d74a70 0x55d7d6e2f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c9a436740 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:6835/1508646651,v1:172.21.15.102:6838/1508646651] conn(0x55d7d6d99b00 0x55d7d6e41ba0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c9a436740 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d6d955b0 0x55d7d6da2330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c9a436740 1 --2- 172.21.15.52:0/4121649436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7d6d74690 0x55d7d6d93670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c6ffff640 0 client.4911 ms_handle_reset on v2:172.21.15.102:6835/1508646651 2024-04-25T13:17:02.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c9a436740 1 -- 172.21.15.52:0/4121649436 >> 172.21.15.52:0/4121649436 conn(0x55d7d6d73fc0 msgr2=0x55d7d6dcd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.188+0000 7f7c9a436740 1 -- 172.21.15.52:0/4121649436 shutdown_connections 2024-04-25T13:17:02.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c9a436740 1 -- 172.21.15.52:0/4121649436 wait complete. 2024-04-25T13:17:02.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c9a436740 20 client.4911 trim_cache size 0 max 16384 2024-04-25T13:17:02.195 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "223f60a6-8e09-4413-a2a5-fc4244f2a674", 2024-04-25T13:17:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 4, 2024-04-25T13:17:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4262, 2024-04-25T13:17:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-04-25T13:17:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-04-25T13:17:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-04-25T13:17:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 11.048536062, 2024-04-25T13:17:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 18, 2024-04-25T13:17:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 27, 2024-04-25T13:17:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 27, 2024-04-25T13:17:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 60.760237728 2024-04-25T13:17:02.196 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:02.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c97720640 1 -- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7c7406c920 msgr2=0x7f7c7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c97720640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7c7406c920 0x7f7c7406ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0011e0 tx=0x7f7c8c009040 comp rx=0 tx=0).stop 2024-04-25T13:17:02.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c97720640 1 -- 172.21.15.52:0/3956430759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c9015c620 msgr2=0x7f7c9015a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c97720640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c9015c620 0x7f7c9015a780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009eb0 tx=0x7f7c88004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:02.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c97720640 1 -- 172.21.15.52:0/3956430759 shutdown_connections 2024-04-25T13:17:02.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c97720640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f7c7406c920 0x7f7c7406ede0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c97720640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c90153130 0x7f7c90150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c97720640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c9015c620 0x7f7c9015a780 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c97720640 1 --2- 172.21.15.52:0/3956430759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c900ca940 0x7f7c901518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c97720640 1 -- 172.21.15.52:0/3956430759 >> 172.21.15.52:0/3956430759 conn(0x7f7c90074d50 msgr2=0x7f7c900c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c97720640 1 -- 172.21.15.52:0/3956430759 shutdown_connections 2024-04-25T13:17:02.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.189+0000 7f7c97720640 1 -- 172.21.15.52:0/3956430759 wait complete. 2024-04-25T13:17:02.200 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-25T13:17:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.301+0000 7f9a1e3bb640 1 Processor -- start 2024-04-25T13:17:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.301+0000 7f9a1e3bb640 1 -- start start 2024-04-25T13:17:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a1e3bb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9a18155170 0x7f9a1815eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a1e3bb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a18155550 0x7f9a180d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a1e3bb640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a180ccf00 con 0x7f9a180cb9e0 2024-04-25T13:17:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a1e3bb640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9a180cddf0 con 0x7f9a18155170 2024-04-25T13:17:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a1e3bb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1815f430 con 0x7f9a18155550 2024-04-25T13:17:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a177fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a18155550 0x7f9a180d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a17fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9a18155170 0x7f9a1815eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a177fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a18155550 0x7f9a180d0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:33176/0 (socket says 172.21.15.52:33176) 2024-04-25T13:17:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a17fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9a18155170 0x7f9a1815eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:40538/0 (socket says 172.21.15.52:40538) 2024-04-25T13:17:02.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a177fe640 1 -- 172.21.15.52:0/280642524 learned_addr learned my addr 172.21.15.52:0/280642524 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a177fe640 1 -- 172.21.15.52:0/280642524 >> v2:172.21.15.102:3300/0 conn(0x7f9a18155170 msgr2=0x7f9a1815eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a177fe640 1 --2- 172.21.15.52:0/280642524 >> v2:172.21.15.102:3300/0 conn(0x7f9a18155170 0x7f9a1815eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a177fe640 1 -- 172.21.15.52:0/280642524 >> v1:172.21.15.102:6789/0 conn(0x7f9a180cb9e0 legacy=0x7f9a180c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.302+0000 7f9a177fe640 1 -- 172.21.15.52:0/280642524 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a180cd1e0 con 0x7f9a18155550 2024-04-25T13:17:02.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.303+0000 7f9a177fe640 1 --2- 172.21.15.52:0/280642524 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a18155550 0x7f9a180d0860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009870 tx=0x7f9a0802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dee7154aaeca885 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.303+0000 7f9a16ffd640 1 -- 172.21.15.52:0/280642524 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08037070 con 0x7f9a18155550 2024-04-25T13:17:02.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.303+0000 7f9a16ffd640 1 -- 172.21.15.52:0/280642524 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a08032440 con 0x7f9a18155550 2024-04-25T13:17:02.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.303+0000 7f9a16ffd640 1 -- 172.21.15.52:0/280642524 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08032810 con 0x7f9a18155550 2024-04-25T13:17:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.304+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/280642524 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a18155550 msgr2=0x7f9a180d0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.304+0000 7f9a1e3bb640 1 --2- 172.21.15.52:0/280642524 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a18155550 0x7f9a180d0860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009870 tx=0x7f9a0802a1c0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.304+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/280642524 shutdown_connections 2024-04-25T13:17:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.304+0000 7f9a1e3bb640 1 --2- 172.21.15.52:0/280642524 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a18155550 0x7f9a180d0860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.304+0000 7f9a1e3bb640 1 --2- 172.21.15.52:0/280642524 >> v2:172.21.15.102:3300/0 conn(0x7f9a18155170 0x7f9a1815eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.304+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/280642524 >> 172.21.15.52:0/280642524 conn(0x7f9a18072570 msgr2=0x7f9a18074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.304+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/280642524 shutdown_connections 2024-04-25T13:17:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.304+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/280642524 wait complete. 2024-04-25T13:17:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.305+0000 7f9a1e3bb640 1 Processor -- start 2024-04-25T13:17:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.305+0000 7f9a1e3bb640 1 -- start start 2024-04-25T13:17:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a1e3bb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a180cb9e0 0x7f9a181f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a1e3bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a18155170 0x7f9a180c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a1e3bb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a18155550 0x7f9a18153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a1e3bb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a180cda80 con 0x7f9a180cb9e0 2024-04-25T13:17:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a1e3bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9a180cd7a0 con 0x7f9a18155170 2024-04-25T13:17:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a1e3bb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a180ccae0 con 0x7f9a18155550 2024-04-25T13:17:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a17fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a180cb9e0 0x7f9a181f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a17fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a180cb9e0 0x7f9a181f1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57160/0 (socket says 172.21.15.52:57160) 2024-04-25T13:17:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a17fff640 1 -- 172.21.15.52:0/4178526783 learned_addr learned my addr 172.21.15.52:0/4178526783 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a1c958640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a18155550 0x7f9a18153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a177fe640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a18155170 0x7f9a180c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a17fff640 1 -- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a18155550 msgr2=0x7f9a18153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a17fff640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a18155550 0x7f9a18153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a17fff640 1 -- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a18155170 msgr2=0x7f9a180c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.306+0000 7f9a17fff640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a18155170 0x7f9a180c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.307+0000 7f9a17fff640 1 -- 172.21.15.52:0/4178526783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a180c58b0 con 0x7f9a180cb9e0 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.307+0000 7f9a17fff640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a180cb9e0 0x7f9a181f1970 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00e9e0 tx=0x7f9a0c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.307+0000 7f9a14ff9640 1 -- 172.21.15.52:0/4178526783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c017070 con 0x7f9a180cb9e0 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.307+0000 7f9a14ff9640 1 -- 172.21.15.52:0/4178526783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c00c9d0 con 0x7f9a180cb9e0 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.307+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/4178526783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a180c5b90 con 0x7f9a180cb9e0 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.307+0000 7f9a14ff9640 1 -- 172.21.15.52:0/4178526783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c00cdc0 con 0x7f9a180cb9e0 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.307+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/4178526783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a180c6150 con 0x7f9a180cb9e0 2024-04-25T13:17:02.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.308+0000 7f9a14ff9640 1 -- 172.21.15.52:0/4178526783 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a0c01a070 con 0x7f9a180cb9e0 2024-04-25T13:17:02.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.309+0000 7f9a14ff9640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9a0406c8f0 0x7f9a0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.309+0000 7f9a14ff9640 1 -- 172.21.15.52:0/4178526783 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f9a0c08c010 con 0x7f9a180cb9e0 2024-04-25T13:17:02.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.309+0000 7f9a177fe640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9a0406c8f0 0x7f9a0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.310+0000 7f9a211ab740 1 Processor -- start 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.310+0000 7f9a177fe640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9a0406c8f0 0x7f9a0406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9a08034000 tx=0x7f9a0802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.310+0000 7f9a211ab740 1 -- start start 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.310+0000 7f9a211ab740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 0x55ea71aeea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.310+0000 7f9a211ab740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aa9fc0 0x55ea71aadf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.310+0000 7f9a211ab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71aaaa70 0x55ea71af88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.310+0000 7f9a211ab740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ea71a13c50 con 0x55ea71aaa690 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.310+0000 7f9a211ab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ea719b0830 con 0x55ea71aaaa70 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.310+0000 7f9a211ab740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55ea71a0fc10 con 0x55ea71aa9fc0 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.310+0000 7f9a17fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 0x55ea71aeea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.310+0000 7f9a17fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 0x55ea71aeea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57172/0 (socket says 172.21.15.52:57172) 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.310+0000 7f9a17fff640 1 -- 172.21.15.52:0/2461839349 learned_addr learned my addr 172.21.15.52:0/2461839349 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.311+0000 7f9a1c958640 1 --2- 172.21.15.52:0/2461839349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71aaaa70 0x55ea71af88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.311+0000 7f9a177fe640 1 --2- 172.21.15.52:0/2461839349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aa9fc0 0x55ea71aadf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.311+0000 7f9a17fff640 1 -- 172.21.15.52:0/2461839349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aa9fc0 msgr2=0x55ea71aadf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.311+0000 7f9a17fff640 1 --2- 172.21.15.52:0/2461839349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aa9fc0 0x55ea71aadf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.311+0000 7f9a17fff640 1 -- 172.21.15.52:0/2461839349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71aaaa70 msgr2=0x55ea71af88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.311+0000 7f9a17fff640 1 --2- 172.21.15.52:0/2461839349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71aaaa70 0x55ea71af88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.311+0000 7f9a17fff640 1 -- 172.21.15.52:0/2461839349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea717262d0 con 0x55ea71aaa690 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.311+0000 7f9a17fff640 1 --2- 172.21.15.52:0/2461839349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 0x55ea71aeea90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c08a060 tx=0x7f9a0c05a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb7c1e9d3597fe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.311+0000 7f99fdffb640 1 -- 172.21.15.52:0/2461839349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c05ee60 con 0x55ea71aaa690 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.311+0000 7f99fdffb640 1 -- 172.21.15.52:0/2461839349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c062500 con 0x55ea71aaa690 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.311+0000 7f99fdffb640 1 -- 172.21.15.52:0/2461839349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c021040 con 0x55ea71aaa690 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.312+0000 7f9a211ab740 1 -- 172.21.15.52:0/2461839349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 msgr2=0x55ea71aeea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.312+0000 7f9a211ab740 1 --2- 172.21.15.52:0/2461839349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 0x55ea71aeea90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c08a060 tx=0x7f9a0c05a0e0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.312+0000 7f9a211ab740 1 -- 172.21.15.52:0/2461839349 shutdown_connections 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.312+0000 7f9a211ab740 1 --2- 172.21.15.52:0/2461839349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aa9fc0 0x55ea71aadf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.312+0000 7f9a211ab740 1 --2- 172.21.15.52:0/2461839349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71aaaa70 0x55ea71af88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.312+0000 7f9a211ab740 1 --2- 172.21.15.52:0/2461839349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 0x55ea71aeea90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.312+0000 7f9a211ab740 1 -- 172.21.15.52:0/2461839349 >> 172.21.15.52:0/2461839349 conn(0x55ea71aabc80 msgr2=0x55ea71aae580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.312+0000 7f9a211ab740 1 -- 172.21.15.52:0/2461839349 shutdown_connections 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.312+0000 7f9a211ab740 1 -- 172.21.15.52:0/2461839349 wait complete. 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.312+0000 7f9a211ab740 1 -- start start 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.312+0000 7f9a211ab740 1 Processor -- start 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.313+0000 7f9a211ab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71aaa690 0x55ea71af3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.313+0000 7f9a211ab740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 0x55ea71b00d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.313+0000 7f9a211ab740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71ad8ac0 0x55ea71acb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.313+0000 7f9a211ab740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ea71aef700 con 0x55ea71aaaa70 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.313+0000 7f9a211ab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ea719ae470 con 0x55ea71aaa690 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.313+0000 7f9a211ab740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55ea71aad0e0 con 0x55ea71ad8ac0 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.313+0000 7f9a211ab740 10 client.0 _ll_register_callbacks cb 0x55ea719d3f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.313+0000 7f9a177fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 0x55ea71b00d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.313+0000 7f9a177fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 0x55ea71b00d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57174/0 (socket says 172.21.15.52:57174) 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.313+0000 7f9a177fe640 1 -- 172.21.15.52:0/438770853 learned_addr learned my addr 172.21.15.52:0/438770853 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.313+0000 7f9a17fff640 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71aaa690 0x55ea71af3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.313+0000 7f9a1c958640 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71ad8ac0 0x55ea71acb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a177fe640 1 -- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71ad8ac0 msgr2=0x55ea71acb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a177fe640 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71ad8ac0 0x55ea71acb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a177fe640 1 -- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71aaa690 msgr2=0x55ea71af3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a177fe640 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71aaa690 0x55ea71af3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a177fe640 1 -- 172.21.15.52:0/438770853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea717f06b0 con 0x55ea71aaaa70 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a17fff640 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71aaa690 0x55ea71af3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a177fe640 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 0x55ea71b00d30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a08035040 tx=0x7f9a0802c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9a4c3e8fa1c95f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f99f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f99f6ffd640 1 -- 172.21.15.52:0/438770853 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08050060 con 0x55ea71aaaa70 2024-04-25T13:17:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f99f6ffd640 1 -- 172.21.15.52:0/438770853 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f9a0803eb30 con 0x55ea71aaaa70 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a211ab740 1 -- 172.21.15.52:0/438770853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a0c062500 con 0x55ea71aaaa70 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f99f6ffd640 1 -- 172.21.15.52:0/438770853 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9a08056050 con 0x55ea71aaaa70 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a211ab740 10 client.4920 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a211ab740 1 -- 172.21.15.52:0/438770853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55ea71aca910 con 0x55ea71aaaa70 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f99f6ffd640 1 -- 172.21.15.52:0/438770853 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c062500 con 0x55ea71aaaa70 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f99f6ffd640 1 -- 172.21.15.52:0/438770853 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f9a08059020 con 0x55ea71aaaa70 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a211ab740 10 client.4920 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a211ab740 10 client.4920 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.314+0000 7f9a211ab740 20 client.4920 populate_metadata read hostname 'smithi052' 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.315+0000 7f9a211ab740 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:6836/1980846137,v1:172.21.15.102:6839/1980846137] conn(0x55ea71b0d4b0 0x55ea71b0f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.315+0000 7f9a211ab740 4 client.4920 mds_command: new command op to 4265 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.315+0000 7f9a211ab740 1 -- 172.21.15.52:0/438770853 --> [v2:172.21.15.102:6836/1980846137,v1:172.21.15.102:6839/1980846137] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea71a21670 con 0x55ea71b0d4b0 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.315+0000 7f9a17fff640 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:6836/1980846137,v1:172.21.15.102:6839/1980846137] conn(0x55ea71b0d4b0 0x55ea71b0f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.315+0000 7f99f6ffd640 10 client.4920 ms_handle_connect on v2:172.21.15.102:6836/1980846137 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.315+0000 7f9a17fff640 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:6836/1980846137,v1:172.21.15.102:6839/1980846137] conn(0x55ea71b0d4b0 0x55ea71b0f8a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8c188ec6102af27b server_cookie=9568d7f5d6d3b3e9 in_seq=0 out_seq=0 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f99f6ffd640 1 -- 172.21.15.52:0/438770853 <== mds.3 v2:172.21.15.102:6836/1980846137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ea71a21670 con 0x55ea71b0d4b0 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f99f6ffd640 10 client.4920 handle_command_reply: tid=0 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f9a211ab740 1 client.4920 shutdown 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f9a211ab740 1 -- 172.21.15.52:0/438770853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 msgr2=0x55ea71b00d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f9a211ab740 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 0x55ea71b00d30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a08035040 tx=0x7f9a0802c070 comp rx=0 tx=0).stop 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f9a211ab740 1 -- 172.21.15.52:0/438770853 shutdown_connections 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f9a211ab740 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:6836/1980846137,v1:172.21.15.102:6839/1980846137] conn(0x55ea71b0d4b0 0x55ea71b0f8a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f9a211ab740 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71ad8ac0 0x55ea71acb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f9a211ab740 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 0x55ea71b00d30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f9a211ab740 1 --2- 172.21.15.52:0/438770853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71aaa690 0x55ea71af3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f99f6ffd640 0 client.4920 ms_handle_reset on v2:172.21.15.102:6836/1980846137 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f9a211ab740 1 -- 172.21.15.52:0/438770853 >> 172.21.15.52:0/438770853 conn(0x55ea71aa9fc0 msgr2=0x55ea71aeda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f9a211ab740 1 -- 172.21.15.52:0/438770853 shutdown_connections 2024-04-25T13:17:02.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f9a211ab740 1 -- 172.21.15.52:0/438770853 wait complete. 2024-04-25T13:17:02.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.316+0000 7f9a211ab740 20 client.4920 trim_cache size 0 max 16384 2024-04-25T13:17:02.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.335+0000 7f9a211ab740 1 Processor -- start 2024-04-25T13:17:02.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.335+0000 7f9a211ab740 1 -- start start 2024-04-25T13:17:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.335+0000 7f9a211ab740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aaa690 0x55ea71af0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.335+0000 7f9a211ab740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 0x55ea71aa4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.335+0000 7f9a211ab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71ad8ac0 0x55ea71aa53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.335+0000 7f9a211ab740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a181fd200 con 0x55ea71aaaa70 2024-04-25T13:17:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.335+0000 7f9a211ab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ea71af9be0 con 0x55ea71ad8ac0 2024-04-25T13:17:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.335+0000 7f9a211ab740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55ea71acab20 con 0x55ea71aaa690 2024-04-25T13:17:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.336+0000 7f9a177fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 0x55ea71aa4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.336+0000 7f9a177fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 0x55ea71aa4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57186/0 (socket says 172.21.15.52:57186) 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.336+0000 7f9a177fe640 1 -- 172.21.15.52:0/1894335337 learned_addr learned my addr 172.21.15.52:0/1894335337 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.336+0000 7f9a177fe640 1 -- 172.21.15.52:0/1894335337 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aaa690 msgr2=0x55ea71af0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.336+0000 7f9a177fe640 1 --2- 172.21.15.52:0/1894335337 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aaa690 0x55ea71af0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.336+0000 7f9a177fe640 1 -- 172.21.15.52:0/1894335337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71ad8ac0 msgr2=0x55ea71aa53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.336+0000 7f9a177fe640 1 --2- 172.21.15.52:0/1894335337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71ad8ac0 0x55ea71aa53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.336+0000 7f9a177fe640 1 -- 172.21.15.52:0/1894335337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea71aee5e0 con 0x55ea71aaaa70 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.336+0000 7f9a177fe640 1 --2- 172.21.15.52:0/1894335337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 0x55ea71aa4e70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9a08006a20 tx=0x7f9a0803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62abdbba771fa0de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.336+0000 7f99fd7fa640 1 -- 172.21.15.52:0/1894335337 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08037040 con 0x55ea71aaaa70 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.336+0000 7f99fd7fa640 1 -- 172.21.15.52:0/1894335337 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0803e830 con 0x55ea71aaaa70 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.336+0000 7f99fd7fa640 1 -- 172.21.15.52:0/1894335337 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a080516a0 con 0x55ea71aaaa70 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.337+0000 7f9a211ab740 1 -- 172.21.15.52:0/1894335337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 msgr2=0x55ea71aa4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.337+0000 7f9a211ab740 1 --2- 172.21.15.52:0/1894335337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 0x55ea71aa4e70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9a08006a20 tx=0x7f9a0803b000 comp rx=0 tx=0).stop 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.337+0000 7f9a211ab740 1 -- 172.21.15.52:0/1894335337 shutdown_connections 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.337+0000 7f9a211ab740 1 --2- 172.21.15.52:0/1894335337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71ad8ac0 0x55ea71aa53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.337+0000 7f9a211ab740 1 --2- 172.21.15.52:0/1894335337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaaa70 0x55ea71aa4e70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.337+0000 7f9a211ab740 1 --2- 172.21.15.52:0/1894335337 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aaa690 0x55ea71af0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.337+0000 7f9a211ab740 1 -- 172.21.15.52:0/1894335337 >> 172.21.15.52:0/1894335337 conn(0x55ea71aa9fc0 msgr2=0x55ea71af3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.337+0000 7f9a211ab740 1 -- 172.21.15.52:0/1894335337 shutdown_connections 2024-04-25T13:17:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.337+0000 7f9a211ab740 1 -- 172.21.15.52:0/1894335337 wait complete. 2024-04-25T13:17:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.337+0000 7f9a211ab740 1 -- start start 2024-04-25T13:17:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.338+0000 7f9a211ab740 1 Processor -- start 2024-04-25T13:17:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.338+0000 7f9a211ab740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 0x55ea71b151a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.338+0000 7f9a211ab740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aaaa70 0x55ea71b6ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.338+0000 7f9a211ab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71ad8ac0 0x55ea71b64e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.338+0000 7f9a211ab740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ea71b03b30 con 0x55ea71aaa690 2024-04-25T13:17:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.338+0000 7f9a211ab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ea71acbbb0 con 0x55ea71ad8ac0 2024-04-25T13:17:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.338+0000 7f9a211ab740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55ea71b041a0 con 0x55ea71aaaa70 2024-04-25T13:17:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.338+0000 7f9a211ab740 10 client.0 _ll_register_callbacks cb 0x7f9a0c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.338+0000 7f9a17fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 0x55ea71b151a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.338+0000 7f9a17fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 0x55ea71b151a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57202/0 (socket says 172.21.15.52:57202) 2024-04-25T13:17:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.338+0000 7f9a17fff640 1 -- 172.21.15.52:0/2369251336 learned_addr learned my addr 172.21.15.52:0/2369251336 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a17fff640 1 -- 172.21.15.52:0/2369251336 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aaaa70 msgr2=0x55ea71b6ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a17fff640 1 --2- 172.21.15.52:0/2369251336 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aaaa70 0x55ea71b6ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a17fff640 1 -- 172.21.15.52:0/2369251336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71ad8ac0 msgr2=0x55ea71b64e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a17fff640 1 --2- 172.21.15.52:0/2369251336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71ad8ac0 0x55ea71b64e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a17fff640 1 -- 172.21.15.52:0/2369251336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea71b6f140 con 0x55ea71aaa690 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a17fff640 1 --2- 172.21.15.52:0/2369251336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 0x55ea71b151a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c08a170 tx=0x7f9a0c089ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2671866f3554f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f99f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f99f6ffd640 1 -- 172.21.15.52:0/2369251336 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c021040 con 0x55ea71aaa690 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f99f6ffd640 1 -- 172.21.15.52:0/2369251336 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f9a0c055f90 con 0x55ea71aaa690 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a211ab740 1 -- 172.21.15.52:0/2369251336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a0803e830 con 0x55ea71aaa690 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f99f6ffd640 1 -- 172.21.15.52:0/2369251336 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9a0c055bc0 con 0x55ea71aaa690 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a211ab740 10 client.4926 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a211ab740 1 -- 172.21.15.52:0/2369251336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55ea71b6e6e0 con 0x55ea71aaa690 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f99f6ffd640 1 -- 172.21.15.52:0/2369251336 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0803e830 con 0x55ea71aaa690 2024-04-25T13:17:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f99f6ffd640 1 -- 172.21.15.52:0/2369251336 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f9a0c07c070 con 0x55ea71aaa690 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a211ab740 10 client.4926 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a211ab740 10 client.4926 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a211ab740 20 client.4926 populate_metadata read hostname 'smithi052' 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a211ab740 1 --2- 172.21.15.52:0/2369251336 >> [v2:172.21.15.102:6836/1980846137,v1:172.21.15.102:6839/1980846137] conn(0x55ea71af22e0 0x55ea71af26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a211ab740 4 client.4926 mds_command: new command op to 4265 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.339+0000 7f9a211ab740 1 -- 172.21.15.52:0/2369251336 --> [v2:172.21.15.102:6836/1980846137,v1:172.21.15.102:6839/1980846137] -- command(tid 0: {"prefix": "status"}) -- 0x55ea71a1b4e0 con 0x55ea71af22e0 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f9a177fe640 1 --2- 172.21.15.52:0/2369251336 >> [v2:172.21.15.102:6836/1980846137,v1:172.21.15.102:6839/1980846137] conn(0x55ea71af22e0 0x55ea71af26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f99f6ffd640 10 client.4926 ms_handle_connect on v2:172.21.15.102:6836/1980846137 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f9a177fe640 1 --2- 172.21.15.52:0/2369251336 >> [v2:172.21.15.102:6836/1980846137,v1:172.21.15.102:6839/1980846137] conn(0x55ea71af22e0 0x55ea71af26c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=99f9baf0ccdbc626 server_cookie=bb3a3c1aeb99fe0b in_seq=0 out_seq=0 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f99f6ffd640 1 -- 172.21.15.52:0/2369251336 <== mds.3 v2:172.21.15.102:6836/1980846137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ea71a1b4e0 con 0x55ea71af22e0 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f99f6ffd640 10 client.4926 handle_command_reply: tid=0 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f9a211ab740 1 client.4926 shutdown 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f9a211ab740 1 -- 172.21.15.52:0/2369251336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 msgr2=0x55ea71b151a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f9a211ab740 1 --2- 172.21.15.52:0/2369251336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 0x55ea71b151a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c08a170 tx=0x7f9a0c089ff0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f9a211ab740 1 -- 172.21.15.52:0/2369251336 shutdown_connections 2024-04-25T13:17:02.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f9a211ab740 1 --2- 172.21.15.52:0/2369251336 >> [v2:172.21.15.102:6836/1980846137,v1:172.21.15.102:6839/1980846137] conn(0x55ea71af22e0 0x55ea71af26c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f9a211ab740 1 --2- 172.21.15.52:0/2369251336 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ea71aaaa70 0x55ea71b6ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f99f6ffd640 0 client.4926 ms_handle_reset on v2:172.21.15.102:6836/1980846137 2024-04-25T13:17:02.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f9a211ab740 1 --2- 172.21.15.52:0/2369251336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ea71ad8ac0 0x55ea71b64e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f9a211ab740 1 --2- 172.21.15.52:0/2369251336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea71aaa690 0x55ea71b151a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.340+0000 7f9a211ab740 1 -- 172.21.15.52:0/2369251336 >> 172.21.15.52:0/2369251336 conn(0x55ea71aa9fc0 msgr2=0x55ea71aae510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a211ab740 1 -- 172.21.15.52:0/2369251336 shutdown_connections 2024-04-25T13:17:02.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a211ab740 1 -- 172.21.15.52:0/2369251336 wait complete. 2024-04-25T13:17:02.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a211ab740 20 client.4926 trim_cache size 0 max 16384 2024-04-25T13:17:02.347 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:02.347 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "223f60a6-8e09-4413-a2a5-fc4244f2a674", 2024-04-25T13:17:02.347 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 3, 2024-04-25T13:17:02.347 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4265, 2024-04-25T13:17:02.347 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-04-25T13:17:02.347 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-04-25T13:17:02.347 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-04-25T13:17:02.347 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 16.217678020000001, 2024-04-25T13:17:02.347 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 18, 2024-04-25T13:17:02.347 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 27, 2024-04-25T13:17:02.348 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 27, 2024-04-25T13:17:02.348 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 60.912178746000002 2024-04-25T13:17:02.348 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:02.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9a0406c8f0 msgr2=0x7f9a0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a1e3bb640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9a0406c8f0 0x7f9a0406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9a08034000 tx=0x7f9a0802e000 comp rx=0 tx=0).stop 2024-04-25T13:17:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/4178526783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a180cb9e0 msgr2=0x7f9a181f1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a1e3bb640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a180cb9e0 0x7f9a181f1970 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00e9e0 tx=0x7f9a0c00eea0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/4178526783 shutdown_connections 2024-04-25T13:17:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a1e3bb640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9a0406c8f0 0x7f9a0406edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a1e3bb640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a18155550 0x7f9a18153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a1e3bb640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a18155170 0x7f9a180c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a1e3bb640 1 --2- 172.21.15.52:0/4178526783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a180cb9e0 0x7f9a181f1970 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/4178526783 >> 172.21.15.52:0/4178526783 conn(0x7f9a18072570 msgr2=0x7f9a180b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/4178526783 shutdown_connections 2024-04-25T13:17:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.341+0000 7f9a1e3bb640 1 -- 172.21.15.52:0/4178526783 wait complete. 2024-04-25T13:17:02.352 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T13:17:02.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.453+0000 7fb6c4929640 1 Processor -- start 2024-04-25T13:17:02.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.453+0000 7fb6c4929640 1 -- start start 2024-04-25T13:17:02.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.454+0000 7fb6c4929640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6c0155170 0x7fb6c015eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.454+0000 7fb6c4929640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c00ccf00 con 0x7fb6c0155550 2024-04-25T13:17:02.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.454+0000 7fb6c4929640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c00cd1e0 con 0x7fb6c00cb9e0 2024-04-25T13:17:02.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.454+0000 7fb6c4929640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c00cddf0 con 0x7fb6c0155170 2024-04-25T13:17:02.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.454+0000 7fb6be59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6c0155170 0x7fb6c015eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.454+0000 7fb6b7fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb6c0155550 0x7fb6c00d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41126/0 (socket says 172.21.15.52:41126) 2024-04-25T13:17:02.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.454+0000 7fb6be59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6c0155170 0x7fb6c015eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57208/0 (socket says 172.21.15.52:57208) 2024-04-25T13:17:02.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.454+0000 7fb6b7fff640 1 -- 172.21.15.52:0/1174046662 learned_addr learned my addr 172.21.15.52:0/1174046662 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:02.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.455+0000 7fb6be59c640 1 -- 172.21.15.52:0/1174046662 >> v1:172.21.15.102:6789/0 conn(0x7fb6c00cb9e0 legacy=0x7fb6c00c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.455+0000 7fb6be59c640 1 -- 172.21.15.52:0/1174046662 >> v1:172.21.15.52:6789/0 conn(0x7fb6c0155550 legacy=0x7fb6c00d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.455+0000 7fb6be59c640 1 -- 172.21.15.52:0/1174046662 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c00cd4c0 con 0x7fb6c0155170 2024-04-25T13:17:02.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.455+0000 7fb6be59c640 1 --2- 172.21.15.52:0/1174046662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6c0155170 0x7fb6c015eef0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00cdf70 tx=0x7fb6b002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d1d4eb4e9e8435 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.456+0000 7fb6bdd9b640 1 -- 172.21.15.52:0/1174046662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0037070 con 0x7fb6c0155170 2024-04-25T13:17:02.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.456+0000 7fb6bdd9b640 1 -- 172.21.15.52:0/1174046662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b0032440 con 0x7fb6c0155170 2024-04-25T13:17:02.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.456+0000 7fb6bdd9b640 1 -- 172.21.15.52:0/1174046662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0032810 con 0x7fb6c0155170 2024-04-25T13:17:02.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.456+0000 7fb6c4929640 1 -- 172.21.15.52:0/1174046662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6c0155170 msgr2=0x7fb6c015eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.456+0000 7fb6c4929640 1 --2- 172.21.15.52:0/1174046662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6c0155170 0x7fb6c015eef0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00cdf70 tx=0x7fb6b002a250 comp rx=0 tx=0).stop 2024-04-25T13:17:02.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.456+0000 7fb6c4929640 1 -- 172.21.15.52:0/1174046662 shutdown_connections 2024-04-25T13:17:02.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.456+0000 7fb6c4929640 1 --2- 172.21.15.52:0/1174046662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6c0155170 0x7fb6c015eef0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.456+0000 7fb6c4929640 1 -- 172.21.15.52:0/1174046662 >> 172.21.15.52:0/1174046662 conn(0x7fb6c0072570 msgr2=0x7fb6c0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.456+0000 7fb6c4929640 1 -- 172.21.15.52:0/1174046662 shutdown_connections 2024-04-25T13:17:02.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.456+0000 7fb6c4929640 1 -- 172.21.15.52:0/1174046662 wait complete. 2024-04-25T13:17:02.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.458+0000 7fb6c4929640 1 Processor -- start 2024-04-25T13:17:02.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.458+0000 7fb6c4929640 1 -- start start 2024-04-25T13:17:02.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.458+0000 7fb6c4929640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6c00cb9e0 0x7fb6c0151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.458+0000 7fb6c4929640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6c0155170 0x7fb6c015db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.458+0000 7fb6c4929640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6c0155550 0x7fb6c0150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.458+0000 7fb6c4929640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c00cda80 con 0x7fb6c0155170 2024-04-25T13:17:02.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.458+0000 7fb6c4929640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c015f430 con 0x7fb6c0155550 2024-04-25T13:17:02.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.458+0000 7fb6c4929640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c00ccae0 con 0x7fb6c00cb9e0 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.458+0000 7fb6b7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6c0155170 0x7fb6c015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.458+0000 7fb6b7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6c0155170 0x7fb6c015db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57222/0 (socket says 172.21.15.52:57222) 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.458+0000 7fb6b7fff640 1 -- 172.21.15.52:0/2101169815 learned_addr learned my addr 172.21.15.52:0/2101169815 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6be59c640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6c00cb9e0 0x7fb6c0151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6bed9d640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6c0155550 0x7fb6c0150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6b7fff640 1 -- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6c00cb9e0 msgr2=0x7fb6c0151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6c00cb9e0 0x7fb6c0151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6b7fff640 1 -- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6c0155550 msgr2=0x7fb6c0150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6c0155550 0x7fb6c0150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6b7fff640 1 -- 172.21.15.52:0/2101169815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c01e5640 con 0x7fb6c0155170 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6be59c640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6c00cb9e0 0x7fb6c0151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6c0155170 0x7fb6c015db90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800c530 tx=0x7fb6a800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6b6ffd640 1 -- 172.21.15.52:0/2101169815 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8017070 con 0x7fb6c0155170 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6b6ffd640 1 -- 172.21.15.52:0/2101169815 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a8005ce0 con 0x7fb6c0155170 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6c4929640 1 -- 172.21.15.52:0/2101169815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c01e5920 con 0x7fb6c0155170 2024-04-25T13:17:02.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6b6ffd640 1 -- 172.21.15.52:0/2101169815 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8007270 con 0x7fb6c0155170 2024-04-25T13:17:02.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.459+0000 7fb6c4929640 1 -- 172.21.15.52:0/2101169815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c01e5ee0 con 0x7fb6c0155170 2024-04-25T13:17:02.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.461+0000 7fb6b6ffd640 1 -- 172.21.15.52:0/2101169815 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6a801a070 con 0x7fb6c0155170 2024-04-25T13:17:02.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.461+0000 7fb6b6ffd640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb6a006c8f0 0x7fb6a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.461+0000 7fb6b6ffd640 1 -- 172.21.15.52:0/2101169815 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fb6a808b0a0 con 0x7fb6c0155170 2024-04-25T13:17:02.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.461+0000 7fb6be59c640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb6a006c8f0 0x7fb6a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.462+0000 7fb6be59c640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb6a006c8f0 0x7fb6a006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0034000 tx=0x7fb6b002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.462+0000 7fb6c7643740 1 Processor -- start 2024-04-25T13:17:02.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.462+0000 7fb6c7643740 1 -- start start 2024-04-25T13:17:02.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6c7643740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56b690 0x5601dc5afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6c7643740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56afc0 0x5601dc56ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6c7643740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc56ba70 0x5601dc5b98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6c7643740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5601dc4d4c50 con 0x5601dc56afc0 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6c7643740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5601dc471830 con 0x5601dc56ba70 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6c7643740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5601dc4d0c10 con 0x5601dc56b690 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6b7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56afc0 0x5601dc56ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6b7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56afc0 0x5601dc56ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57226/0 (socket says 172.21.15.52:57226) 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6b7fff640 1 -- 172.21.15.52:0/3163770579 learned_addr learned my addr 172.21.15.52:0/3163770579 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6be59c640 1 --2- 172.21.15.52:0/3163770579 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56b690 0x5601dc5afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6bed9d640 1 --2- 172.21.15.52:0/3163770579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc56ba70 0x5601dc5b98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6b7fff640 1 -- 172.21.15.52:0/3163770579 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56b690 msgr2=0x5601dc5afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/3163770579 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56b690 0x5601dc5afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6b7fff640 1 -- 172.21.15.52:0/3163770579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc56ba70 msgr2=0x5601dc5b98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/3163770579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc56ba70 0x5601dc5b98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6b7fff640 1 -- 172.21.15.52:0/3163770579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601dc1e72d0 con 0x5601dc56afc0 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.463+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/3163770579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56afc0 0x5601dc56ef40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8089180 tx=0x7fb6a8058bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09c2bd85797ecf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.464+0000 7fb69ffff640 1 -- 172.21.15.52:0/3163770579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8056df0 con 0x5601dc56afc0 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.464+0000 7fb69ffff640 1 -- 172.21.15.52:0/3163770579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a8055160 con 0x5601dc56afc0 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.464+0000 7fb69ffff640 1 -- 172.21.15.52:0/3163770579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8061390 con 0x5601dc56afc0 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.464+0000 7fb6c7643740 1 -- 172.21.15.52:0/3163770579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56afc0 msgr2=0x5601dc56ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.464+0000 7fb6c7643740 1 --2- 172.21.15.52:0/3163770579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56afc0 0x5601dc56ef40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8089180 tx=0x7fb6a8058bb0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.464+0000 7fb6c7643740 1 -- 172.21.15.52:0/3163770579 shutdown_connections 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.464+0000 7fb6c7643740 1 --2- 172.21.15.52:0/3163770579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc56ba70 0x5601dc5b98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.464+0000 7fb6c7643740 1 --2- 172.21.15.52:0/3163770579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56afc0 0x5601dc56ef40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.464+0000 7fb6c7643740 1 --2- 172.21.15.52:0/3163770579 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56b690 0x5601dc5afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.464+0000 7fb6c7643740 1 -- 172.21.15.52:0/3163770579 >> 172.21.15.52:0/3163770579 conn(0x5601dc56cc80 msgr2=0x5601dc56f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.464+0000 7fb6c7643740 1 -- 172.21.15.52:0/3163770579 shutdown_connections 2024-04-25T13:17:02.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.464+0000 7fb6c7643740 1 -- 172.21.15.52:0/3163770579 wait complete. 2024-04-25T13:17:02.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.465+0000 7fb6c7643740 1 -- start start 2024-04-25T13:17:02.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.465+0000 7fb6c7643740 1 Processor -- start 2024-04-25T13:17:02.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6c7643740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 0x5601dc570ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6c7643740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56ba70 0x5601dc58eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6c7643740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc5c4530 0x5601dc58f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6c7643740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5601dc5b0700 con 0x5601dc56b690 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6c7643740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5601dc46f470 con 0x5601dc5c4530 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6c7643740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5601dc56e0e0 con 0x5601dc56ba70 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6c7643740 10 client.0 _ll_register_callbacks cb 0x5601dc494f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6be59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 0x5601dc570ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6be59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 0x5601dc570ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57238/0 (socket says 172.21.15.52:57238) 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6be59c640 1 -- 172.21.15.52:0/874508109 learned_addr learned my addr 172.21.15.52:0/874508109 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6bed9d640 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc5c4530 0x5601dc58f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56ba70 0x5601dc58eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6be59c640 1 -- 172.21.15.52:0/874508109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56ba70 msgr2=0x5601dc58eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6be59c640 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56ba70 0x5601dc58eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6be59c640 1 -- 172.21.15.52:0/874508109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc5c4530 msgr2=0x5601dc58f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6be59c640 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc5c4530 0x5601dc58f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6be59c640 1 -- 172.21.15.52:0/874508109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601dc2b16b0 con 0x5601dc56b690 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56ba70 0x5601dc58eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb6be59c640 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 0x5601dc570ba0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00098c0 tx=0x7fb6b002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8583a02df3062bcb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.466+0000 7fb69d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb69d7fa640 1 -- 172.21.15.52:0/874508109 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b004f060 con 0x5601dc56b690 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb69d7fa640 1 -- 172.21.15.52:0/874508109 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fb6b003ee00 con 0x5601dc56b690 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb6c7643740 1 -- 172.21.15.52:0/874508109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6a8055160 con 0x5601dc56b690 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb69d7fa640 1 -- 172.21.15.52:0/874508109 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb6b0055050 con 0x5601dc56b690 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb6c7643740 10 client.4941 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb6c7643740 1 -- 172.21.15.52:0/874508109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5601dc5908f0 con 0x5601dc56b690 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb69d7fa640 1 -- 172.21.15.52:0/874508109 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a8055160 con 0x5601dc56b690 2024-04-25T13:17:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb69d7fa640 1 -- 172.21.15.52:0/874508109 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fb6b0058020 con 0x5601dc56b690 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb6c7643740 10 client.4941 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb6c7643740 10 client.4941 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb6c7643740 20 client.4941 populate_metadata read hostname 'smithi052' 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb6c7643740 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.52:6833/714334205,v1:172.21.15.52:6835/714334205] conn(0x5601dc5baec0 0x5601dc5d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb6c7643740 4 client.4941 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb6c7643740 1 -- 172.21.15.52:0/874508109 --> [v2:172.21.15.52:6833/714334205,v1:172.21.15.52:6835/714334205] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601dc4e2670 con 0x5601dc5baec0 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.467+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.52:6833/714334205,v1:172.21.15.52:6835/714334205] conn(0x5601dc5baec0 0x5601dc5d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.468+0000 7fb69d7fa640 10 client.4941 ms_handle_connect on v2:172.21.15.52:6833/714334205 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.468+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.52:6833/714334205,v1:172.21.15.52:6835/714334205] conn(0x5601dc5baec0 0x5601dc5d0330 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=25b95214bc92e16b server_cookie=604e17b4ccb5e2b4 in_seq=0 out_seq=0 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.468+0000 7fb69d7fa640 1 -- 172.21.15.52:0/874508109 <== mds.2 v2:172.21.15.52:6833/714334205 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5601dc4e2670 con 0x5601dc5baec0 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.468+0000 7fb69d7fa640 10 client.4941 handle_command_reply: tid=0 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.468+0000 7fb6c7643740 1 client.4941 shutdown 2024-04-25T13:17:02.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.468+0000 7fb6c7643740 1 -- 172.21.15.52:0/874508109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 msgr2=0x5601dc570ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.468+0000 7fb6c7643740 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 0x5601dc570ba0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00098c0 tx=0x7fb6b002c070 comp rx=0 tx=0).stop 2024-04-25T13:17:02.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.469+0000 7fb6c7643740 1 -- 172.21.15.52:0/874508109 shutdown_connections 2024-04-25T13:17:02.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.469+0000 7fb6c7643740 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.52:6833/714334205,v1:172.21.15.52:6835/714334205] conn(0x5601dc5baec0 0x5601dc5d0330 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.469+0000 7fb6c7643740 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56ba70 0x5601dc58eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.469+0000 7fb6c7643740 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc5c4530 0x5601dc58f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.469+0000 7fb69d7fa640 0 client.4941 ms_handle_reset on v2:172.21.15.52:6833/714334205 2024-04-25T13:17:02.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.469+0000 7fb6c7643740 1 --2- 172.21.15.52:0/874508109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 0x5601dc570ba0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.469+0000 7fb6c7643740 1 -- 172.21.15.52:0/874508109 >> 172.21.15.52:0/874508109 conn(0x5601dc56afc0 msgr2=0x5601dc56a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.469+0000 7fb6c7643740 1 -- 172.21.15.52:0/874508109 shutdown_connections 2024-04-25T13:17:02.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.469+0000 7fb6c7643740 1 -- 172.21.15.52:0/874508109 wait complete. 2024-04-25T13:17:02.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.469+0000 7fb6c7643740 20 client.4941 trim_cache size 0 max 16384 2024-04-25T13:17:02.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.487+0000 7fb6c7643740 1 Processor -- start 2024-04-25T13:17:02.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.487+0000 7fb6c7643740 1 -- start start 2024-04-25T13:17:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6c7643740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56b690 0x5601dc566060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6c7643740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56ba70 0x5601dc5d5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6c7643740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc5c4530 0x5601dc5d5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6c7643740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c01fd170 con 0x5601dc56ba70 2024-04-25T13:17:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6c7643740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5601dc591990 con 0x5601dc5c4530 2024-04-25T13:17:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6c7643740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5601dc5c4a90 con 0x5601dc56b690 2024-04-25T13:17:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6b7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56ba70 0x5601dc5d5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6b7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56ba70 0x5601dc5d5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57254/0 (socket says 172.21.15.52:57254) 2024-04-25T13:17:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6b7fff640 1 -- 172.21.15.52:0/373397984 learned_addr learned my addr 172.21.15.52:0/373397984 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6b7fff640 1 -- 172.21.15.52:0/373397984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56b690 msgr2=0x5601dc566060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/373397984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56b690 0x5601dc566060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6b7fff640 1 -- 172.21.15.52:0/373397984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc5c4530 msgr2=0x5601dc5d5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/373397984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc5c4530 0x5601dc5d5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6b7fff640 1 -- 172.21.15.52:0/373397984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601dc5c5390 con 0x5601dc56ba70 2024-04-25T13:17:02.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/373397984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56ba70 0x5601dc5d5590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8089290 tx=0x7fb6a805cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58ea777faf1981c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.488+0000 7fb69f7fe640 1 -- 172.21.15.52:0/373397984 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8061190 con 0x5601dc56ba70 2024-04-25T13:17:02.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.489+0000 7fb69f7fe640 1 -- 172.21.15.52:0/373397984 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a8061330 con 0x5601dc56ba70 2024-04-25T13:17:02.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.489+0000 7fb69f7fe640 1 -- 172.21.15.52:0/373397984 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a805f2d0 con 0x5601dc56ba70 2024-04-25T13:17:02.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.489+0000 7fb6c7643740 1 -- 172.21.15.52:0/373397984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56ba70 msgr2=0x5601dc5d5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.489+0000 7fb6c7643740 1 --2- 172.21.15.52:0/373397984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56ba70 0x5601dc5d5590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8089290 tx=0x7fb6a805cf70 comp rx=0 tx=0).stop 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.489+0000 7fb6c7643740 1 -- 172.21.15.52:0/373397984 shutdown_connections 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.489+0000 7fb6c7643740 1 --2- 172.21.15.52:0/373397984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc5c4530 0x5601dc5d5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.489+0000 7fb6c7643740 1 --2- 172.21.15.52:0/373397984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56ba70 0x5601dc5d5590 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.489+0000 7fb6c7643740 1 --2- 172.21.15.52:0/373397984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc56b690 0x5601dc566060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.489+0000 7fb6c7643740 1 -- 172.21.15.52:0/373397984 >> 172.21.15.52:0/373397984 conn(0x5601dc56afc0 msgr2=0x5601dc5b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.489+0000 7fb6c7643740 1 -- 172.21.15.52:0/373397984 shutdown_connections 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.489+0000 7fb6c7643740 1 -- 172.21.15.52:0/373397984 wait complete. 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.490+0000 7fb6c7643740 1 -- start start 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.490+0000 7fb6c7643740 1 Processor -- start 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6c7643740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 0x5601dc5b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6c7643740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc5c4530 0x5601dc5adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6c7643740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc625620 0x5601dc56e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6c7643740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5601dc5bad40 con 0x5601dc56b690 2024-04-25T13:17:02.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6c7643740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5601dc5b32b0 con 0x5601dc625620 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6c7643740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5601dc5bb410 con 0x5601dc5c4530 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6c7643740 10 client.0 _ll_register_callbacks cb 0x7fb6b0009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6be59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 0x5601dc5b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6be59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 0x5601dc5b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57260/0 (socket says 172.21.15.52:57260) 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6be59c640 1 -- 172.21.15.52:0/3116519843 learned_addr learned my addr 172.21.15.52:0/3116519843 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc5c4530 0x5601dc5adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6bed9d640 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc625620 0x5601dc56e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6be59c640 1 -- 172.21.15.52:0/3116519843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc5c4530 msgr2=0x5601dc5adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6be59c640 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc5c4530 0x5601dc5adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6be59c640 1 -- 172.21.15.52:0/3116519843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc625620 msgr2=0x5601dc56e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6be59c640 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc625620 0x5601dc56e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6be59c640 1 -- 172.21.15.52:0/3116519843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601dc5adfe0 con 0x5601dc56b690 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6be59c640 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 0x5601dc5b0bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0000c00 tx=0x7fb6b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61968ed640d4941 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb69d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb69d7fa640 1 -- 172.21.15.52:0/3116519843 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b005e060 con 0x5601dc56b690 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb69d7fa640 1 -- 172.21.15.52:0/3116519843 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fb6b0050910 con 0x5601dc56b690 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6c7643740 1 -- 172.21.15.52:0/3116519843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6a8061330 con 0x5601dc56b690 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb69d7fa640 1 -- 172.21.15.52:0/3116519843 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb6b0064050 con 0x5601dc56b690 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6c7643740 10 client.4947 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.491+0000 7fb6c7643740 1 -- 172.21.15.52:0/3116519843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5601dc62f060 con 0x5601dc56b690 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb69d7fa640 1 -- 172.21.15.52:0/3116519843 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a8061330 con 0x5601dc56b690 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb69d7fa640 1 -- 172.21.15.52:0/3116519843 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fb6b0067020 con 0x5601dc56b690 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb6c7643740 10 client.4947 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb6c7643740 10 client.4947 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb6c7643740 20 client.4947 populate_metadata read hostname 'smithi052' 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb6c7643740 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.52:6833/714334205,v1:172.21.15.52:6835/714334205] conn(0x5601dc6359e0 0x5601dc637dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb6c7643740 4 client.4947 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb6c7643740 1 -- 172.21.15.52:0/3116519843 --> [v2:172.21.15.52:6833/714334205,v1:172.21.15.52:6835/714334205] -- command(tid 0: {"prefix": "status"}) -- 0x5601dc4dc4e0 con 0x5601dc6359e0 2024-04-25T13:17:02.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.52:6833/714334205,v1:172.21.15.52:6835/714334205] conn(0x5601dc6359e0 0x5601dc637dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb69d7fa640 10 client.4947 ms_handle_connect on v2:172.21.15.52:6833/714334205 2024-04-25T13:17:02.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb6b7fff640 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.52:6833/714334205,v1:172.21.15.52:6835/714334205] conn(0x5601dc6359e0 0x5601dc637dd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4146ccd6994a430f server_cookie=f6b6d1935e1ade57 in_seq=0 out_seq=0 2024-04-25T13:17:02.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb69d7fa640 1 -- 172.21.15.52:0/3116519843 <== mds.2 v2:172.21.15.52:6833/714334205 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5601dc4dc4e0 con 0x5601dc6359e0 2024-04-25T13:17:02.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb69d7fa640 10 client.4947 handle_command_reply: tid=0 2024-04-25T13:17:02.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb6c7643740 1 client.4947 shutdown 2024-04-25T13:17:02.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb6c7643740 1 -- 172.21.15.52:0/3116519843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 msgr2=0x5601dc5b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.492+0000 7fb6c7643740 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 0x5601dc5b0bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0000c00 tx=0x7fb6b00046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c7643740 1 -- 172.21.15.52:0/3116519843 shutdown_connections 2024-04-25T13:17:02.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c7643740 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.52:6833/714334205,v1:172.21.15.52:6835/714334205] conn(0x5601dc6359e0 0x5601dc637dd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c7643740 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5601dc5c4530 0x5601dc5adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c7643740 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601dc625620 0x5601dc56e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c7643740 1 --2- 172.21.15.52:0/3116519843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5601dc56b690 0x5601dc5b0bf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb69d7fa640 0 client.4947 ms_handle_reset on v2:172.21.15.52:6833/714334205 2024-04-25T13:17:02.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c7643740 1 -- 172.21.15.52:0/3116519843 >> 172.21.15.52:0/3116519843 conn(0x5601dc56afc0 msgr2=0x5601dc5b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c7643740 1 -- 172.21.15.52:0/3116519843 shutdown_connections 2024-04-25T13:17:02.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c7643740 1 -- 172.21.15.52:0/3116519843 wait complete. 2024-04-25T13:17:02.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c7643740 20 client.4947 trim_cache size 0 max 16384 2024-04-25T13:17:02.499 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:02.499 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "223f60a6-8e09-4413-a2a5-fc4244f2a674", 2024-04-25T13:17:02.499 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 2, 2024-04-25T13:17:02.499 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4273, 2024-04-25T13:17:02.499 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-04-25T13:17:02.499 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-04-25T13:17:02.500 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-04-25T13:17:02.500 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 22.389772869000002, 2024-04-25T13:17:02.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 18, 2024-04-25T13:17:02.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 27, 2024-04-25T13:17:02.500 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 27, 2024-04-25T13:17:02.500 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 61.078681482 2024-04-25T13:17:02.500 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c4929640 1 -- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb6a006c8f0 msgr2=0x7fb6a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c4929640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb6a006c8f0 0x7fb6a006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0034000 tx=0x7fb6b002e000 comp rx=0 tx=0).stop 2024-04-25T13:17:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c4929640 1 -- 172.21.15.52:0/2101169815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6c0155170 msgr2=0x7fb6c015db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c4929640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6c0155170 0x7fb6c015db90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800c530 tx=0x7fb6a800c9f0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c4929640 1 -- 172.21.15.52:0/2101169815 shutdown_connections 2024-04-25T13:17:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c4929640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb6a006c8f0 0x7fb6a006edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c4929640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6c0155550 0x7fb6c0150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c4929640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6c0155170 0x7fb6c015db90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c4929640 1 --2- 172.21.15.52:0/2101169815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6c00cb9e0 0x7fb6c0151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c4929640 1 -- 172.21.15.52:0/2101169815 >> 172.21.15.52:0/2101169815 conn(0x7fb6c0072570 msgr2=0x7fb6c00cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c4929640 1 -- 172.21.15.52:0/2101169815 shutdown_connections 2024-04-25T13:17:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.493+0000 7fb6c4929640 1 -- 172.21.15.52:0/2101169815 wait complete. 2024-04-25T13:17:02.504 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T13:17:02.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.605+0000 7f36adb0f640 1 Processor -- start 2024-04-25T13:17:02.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.605+0000 7f36adb0f640 1 -- start start 2024-04-25T13:17:02.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.606+0000 7f36adb0f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f36a815cdd0 0x7f36a80caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.606+0000 7f36adb0f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a80c9bb0 con 0x7f36a80cb440 2024-04-25T13:17:02.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.606+0000 7f36adb0f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a80c5cc0 con 0x7f36a80c9fa0 2024-04-25T13:17:02.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.606+0000 7f36adb0f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f36a80c5a70 con 0x7f36a815cdd0 2024-04-25T13:17:02.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.606+0000 7f36a6ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f36a815cdd0 0x7f36a80caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.606+0000 7f36a77fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f36a80cb440 0x7f36a815c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41128/0 (socket says 172.21.15.52:41128) 2024-04-25T13:17:02.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.606+0000 7f36a77fe640 1 -- 172.21.15.52:0/1276172349 learned_addr learned my addr 172.21.15.52:0/1276172349 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:02.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.606+0000 7f36a6ffd640 1 -- 172.21.15.52:0/1276172349 >> v1:172.21.15.102:6789/0 conn(0x7f36a80c9fa0 legacy=0x7f36a81636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.606+0000 7f36a6ffd640 1 -- 172.21.15.52:0/1276172349 >> v1:172.21.15.52:6789/0 conn(0x7f36a80cb440 legacy=0x7f36a815c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.606+0000 7f36a6ffd640 1 -- 172.21.15.52:0/1276172349 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a80c5fa0 con 0x7f36a815cdd0 2024-04-25T13:17:02.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.607+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/1276172349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a815cdd0 0x7f36a80caa30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f369c0097d0 tx=0x7f369c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9240146210f66be3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.607+0000 7f36a67fc640 1 -- 172.21.15.52:0/1276172349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c037070 con 0x7f36a815cdd0 2024-04-25T13:17:02.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.607+0000 7f36a67fc640 1 -- 172.21.15.52:0/1276172349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369c032440 con 0x7f36a815cdd0 2024-04-25T13:17:02.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.607+0000 7f36a67fc640 1 -- 172.21.15.52:0/1276172349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c032810 con 0x7f36a815cdd0 2024-04-25T13:17:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.608+0000 7f36adb0f640 1 -- 172.21.15.52:0/1276172349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a815cdd0 msgr2=0x7f36a80caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.608+0000 7f36adb0f640 1 --2- 172.21.15.52:0/1276172349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a815cdd0 0x7f36a80caa30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f369c0097d0 tx=0x7f369c02a210 comp rx=0 tx=0).stop 2024-04-25T13:17:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.608+0000 7f36adb0f640 1 -- 172.21.15.52:0/1276172349 shutdown_connections 2024-04-25T13:17:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.608+0000 7f36adb0f640 1 --2- 172.21.15.52:0/1276172349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a815cdd0 0x7f36a80caa30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.608+0000 7f36adb0f640 1 -- 172.21.15.52:0/1276172349 >> 172.21.15.52:0/1276172349 conn(0x7f36a8074f30 msgr2=0x7f36a8075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.608+0000 7f36adb0f640 1 -- 172.21.15.52:0/1276172349 shutdown_connections 2024-04-25T13:17:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.608+0000 7f36adb0f640 1 -- 172.21.15.52:0/1276172349 wait complete. 2024-04-25T13:17:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.609+0000 7f36adb0f640 1 Processor -- start 2024-04-25T13:17:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.609+0000 7f36adb0f640 1 -- start start 2024-04-25T13:17:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36adb0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a80c9fa0 0x7f36a81f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36adb0f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36a80cb440 0x7f36a80cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36adb0f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f36a815cdd0 0x7f36a814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36adb0f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80c9850 con 0x7f36a80c9fa0 2024-04-25T13:17:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36adb0f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80ca720 con 0x7f36a80cb440 2024-04-25T13:17:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36adb0f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f36a8153360 con 0x7f36a815cdd0 2024-04-25T13:17:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36a77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a80c9fa0 0x7f36a81f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36a77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a80c9fa0 0x7f36a81f0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57280/0 (socket says 172.21.15.52:57280) 2024-04-25T13:17:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36a77fe640 1 -- 172.21.15.52:0/1097055556 learned_addr learned my addr 172.21.15.52:0/1097055556 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36a80cb440 0x7f36a80cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36a7fff640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f36a815cdd0 0x7f36a814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36a77fe640 1 -- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f36a815cdd0 msgr2=0x7f36a814fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36a77fe640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f36a815cdd0 0x7f36a814fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36a77fe640 1 -- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36a80cb440 msgr2=0x7f36a80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36a77fe640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36a80cb440 0x7f36a80cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36a77fe640 1 -- 172.21.15.52:0/1097055556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a806cce0 con 0x7f36a80c9fa0 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36a80cb440 0x7f36a80cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.610+0000 7f36a7fff640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f36a815cdd0 0x7f36a814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.611+0000 7f36a77fe640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a80c9fa0 0x7f36a81f0a70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f369800c400 tx=0x7f369800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.611+0000 7f368ffff640 1 -- 172.21.15.52:0/1097055556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698017070 con 0x7f36a80c9fa0 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.611+0000 7f368ffff640 1 -- 172.21.15.52:0/1097055556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3698005ce0 con 0x7f36a80c9fa0 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.611+0000 7f36adb0f640 1 -- 172.21.15.52:0/1097055556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a81f49a0 con 0x7f36a80c9fa0 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.611+0000 7f368ffff640 1 -- 172.21.15.52:0/1097055556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36980072f0 con 0x7f36a80c9fa0 2024-04-25T13:17:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.611+0000 7f36adb0f640 1 -- 172.21.15.52:0/1097055556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a806cf70 con 0x7f36a80c9fa0 2024-04-25T13:17:02.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.612+0000 7f368ffff640 1 -- 172.21.15.52:0/1097055556 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f369801a070 con 0x7f36a80c9fa0 2024-04-25T13:17:02.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.613+0000 7f368ffff640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f369406c8f0 0x7f369406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.613+0000 7f368ffff640 1 -- 172.21.15.52:0/1097055556 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f369808b260 con 0x7f36a80c9fa0 2024-04-25T13:17:02.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.613+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f369406c8f0 0x7f369406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.613+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f369406c8f0 0x7f369406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f369c034000 tx=0x7f369c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.613+0000 7f36b0821740 1 Processor -- start 2024-04-25T13:17:02.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.614+0000 7f36b0821740 1 -- start start 2024-04-25T13:17:02.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.614+0000 7f36b0821740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28690 0x55ac5df6ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.614+0000 7f36b0821740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df27fc0 0x55ac5df2bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.614+0000 7f36b0821740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 0x55ac5df768a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.614+0000 7f36b0821740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ac5de91c50 con 0x55ac5df28a70 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.614+0000 7f36b0821740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac5de2e830 con 0x55ac5df28690 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.614+0000 7f36b0821740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55ac5de8dc10 con 0x55ac5df27fc0 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 0x55ac5df768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 0x55ac5df768a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57288/0 (socket says 172.21.15.52:57288) 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f36a7fff640 1 -- 172.21.15.52:0/1064710779 learned_addr learned my addr 172.21.15.52:0/1064710779 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f36a77fe640 1 --2- 172.21.15.52:0/1064710779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28690 0x55ac5df6ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/1064710779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df27fc0 0x55ac5df2bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f36a7fff640 1 -- 172.21.15.52:0/1064710779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df27fc0 msgr2=0x55ac5df2bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f36a7fff640 1 --2- 172.21.15.52:0/1064710779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df27fc0 0x55ac5df2bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f36a7fff640 1 -- 172.21.15.52:0/1064710779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28690 msgr2=0x55ac5df6ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f36a7fff640 1 --2- 172.21.15.52:0/1064710779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28690 0x55ac5df6ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f36a7fff640 1 -- 172.21.15.52:0/1064710779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac5dba42d0 con 0x55ac5df28a70 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f36a77fe640 1 --2- 172.21.15.52:0/1064710779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28690 0x55ac5df6ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:02.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f36a7fff640 1 --2- 172.21.15.52:0/1064710779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 0x55ac5df768a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f36a0007f40 tx=0x7f36a000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d50a1d5dc1ffba4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f368d7fa640 1 -- 172.21.15.52:0/1064710779 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0014070 con 0x55ac5df28a70 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f368d7fa640 1 -- 172.21.15.52:0/1064710779 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a000f830 con 0x55ac5df28a70 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.615+0000 7f368d7fa640 1 -- 172.21.15.52:0/1064710779 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a000fc00 con 0x55ac5df28a70 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.616+0000 7f36b0821740 1 -- 172.21.15.52:0/1064710779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 msgr2=0x55ac5df768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.616+0000 7f36b0821740 1 --2- 172.21.15.52:0/1064710779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 0x55ac5df768a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f36a0007f40 tx=0x7f36a000c730 comp rx=0 tx=0).stop 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.616+0000 7f36b0821740 1 -- 172.21.15.52:0/1064710779 shutdown_connections 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.616+0000 7f36b0821740 1 --2- 172.21.15.52:0/1064710779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df27fc0 0x55ac5df2bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.616+0000 7f36b0821740 1 --2- 172.21.15.52:0/1064710779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 0x55ac5df768a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.616+0000 7f36b0821740 1 --2- 172.21.15.52:0/1064710779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28690 0x55ac5df6ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.616+0000 7f36b0821740 1 -- 172.21.15.52:0/1064710779 >> 172.21.15.52:0/1064710779 conn(0x55ac5df29c80 msgr2=0x55ac5df2c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.616+0000 7f36b0821740 1 -- 172.21.15.52:0/1064710779 shutdown_connections 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.616+0000 7f36b0821740 1 -- 172.21.15.52:0/1064710779 wait complete. 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.617+0000 7f36b0821740 1 -- start start 2024-04-25T13:17:02.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.617+0000 7f36b0821740 1 Processor -- start 2024-04-25T13:17:02.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.617+0000 7f36b0821740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28690 0x55ac5df56380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.617+0000 7f36b0821740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 0x55ac5df49f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.617+0000 7f36b0821740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df493b0 0x55ac5df53310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.617+0000 7f36b0821740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ac5df6d700 con 0x55ac5df28a70 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.617+0000 7f36b0821740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac5de2c470 con 0x55ac5df28690 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.617+0000 7f36b0821740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55ac5df2b0e0 con 0x55ac5df493b0 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.617+0000 7f36b0821740 10 client.0 _ll_register_callbacks cb 0x55ac5de51f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.617+0000 7f36a6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 0x55ac5df49f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36a6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 0x55ac5df49f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57292/0 (socket says 172.21.15.52:57292) 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36a6ffd640 1 -- 172.21.15.52:0/3028750635 learned_addr learned my addr 172.21.15.52:0/3028750635 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36a77fe640 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28690 0x55ac5df56380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36a7fff640 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df493b0 0x55ac5df53310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36a6ffd640 1 -- 172.21.15.52:0/3028750635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df493b0 msgr2=0x55ac5df53310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df493b0 0x55ac5df53310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36a6ffd640 1 -- 172.21.15.52:0/3028750635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28690 msgr2=0x55ac5df56380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28690 0x55ac5df56380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36a6ffd640 1 -- 172.21.15.52:0/3028750635 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac5dc6e6b0 con 0x55ac5df28a70 2024-04-25T13:17:02.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36a7fff640 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df493b0 0x55ac5df53310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36a77fe640 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28690 0x55ac5df56380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 0x55ac5df49f60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f369c02a800 tx=0x7f369c02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e1331fb045a38a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36867fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36867fc640 1 -- 172.21.15.52:0/3028750635 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c04f060 con 0x55ac5df28a70 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36867fc640 1 -- 172.21.15.52:0/3028750635 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f369c03ed40 con 0x55ac5df28a70 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36b0821740 1 -- 172.21.15.52:0/3028750635 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36a000f830 con 0x55ac5df28a70 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36867fc640 1 -- 172.21.15.52:0/3028750635 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f369c055050 con 0x55ac5df28a70 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36b0821740 10 client.4962 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36b0821740 1 -- 172.21.15.52:0/3028750635 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55ac5df4a4a0 con 0x55ac5df28a70 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.618+0000 7f36867fc640 1 -- 172.21.15.52:0/3028750635 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a000f830 con 0x55ac5df28a70 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.619+0000 7f36867fc640 1 -- 172.21.15.52:0/3028750635 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f369c058020 con 0x55ac5df28a70 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.619+0000 7f36b0821740 10 client.4962 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.619+0000 7f36b0821740 10 client.4962 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.619+0000 7f36b0821740 20 client.4962 populate_metadata read hostname 'smithi052' 2024-04-25T13:17:02.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.619+0000 7f36b0821740 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.52:6832/3228537118,v1:172.21.15.52:6834/3228537118] conn(0x55ac5df53cc0 0x55ac5df8d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.619+0000 7f36b0821740 4 client.4962 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.619+0000 7f36b0821740 1 -- 172.21.15.52:0/3028750635 --> [v2:172.21.15.52:6832/3228537118,v1:172.21.15.52:6834/3228537118] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac5de9f670 con 0x55ac5df53cc0 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.619+0000 7f36a77fe640 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.52:6832/3228537118,v1:172.21.15.52:6834/3228537118] conn(0x55ac5df53cc0 0x55ac5df8d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.619+0000 7f36a77fe640 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.52:6832/3228537118,v1:172.21.15.52:6834/3228537118] conn(0x55ac5df53cc0 0x55ac5df8d3e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e385d1a23ef83a58 server_cookie=632875fb5e133982 in_seq=0 out_seq=0 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.619+0000 7f36867fc640 10 client.4962 ms_handle_connect on v2:172.21.15.52:6832/3228537118 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36867fc640 1 -- 172.21.15.52:0/3028750635 <== mds.1 v2:172.21.15.52:6832/3228537118 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ac5de9f670 con 0x55ac5df53cc0 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36867fc640 10 client.4962 handle_command_reply: tid=0 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36b0821740 1 client.4962 shutdown 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36b0821740 1 -- 172.21.15.52:0/3028750635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 msgr2=0x55ac5df49f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36b0821740 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 0x55ac5df49f60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f369c02a800 tx=0x7f369c02c070 comp rx=0 tx=0).stop 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36b0821740 1 -- 172.21.15.52:0/3028750635 shutdown_connections 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36b0821740 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.52:6832/3228537118,v1:172.21.15.52:6834/3228537118] conn(0x55ac5df53cc0 0x55ac5df8d3e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36b0821740 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df493b0 0x55ac5df53310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36b0821740 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df28a70 0x55ac5df49f60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36867fc640 0 client.4962 ms_handle_reset on v2:172.21.15.52:6832/3228537118 2024-04-25T13:17:02.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36b0821740 1 --2- 172.21.15.52:0/3028750635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28690 0x55ac5df56380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36b0821740 1 -- 172.21.15.52:0/3028750635 >> 172.21.15.52:0/3028750635 conn(0x55ac5df27fc0 msgr2=0x55ac5df6c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36b0821740 1 -- 172.21.15.52:0/3028750635 shutdown_connections 2024-04-25T13:17:02.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36b0821740 1 -- 172.21.15.52:0/3028750635 wait complete. 2024-04-25T13:17:02.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.620+0000 7f36b0821740 20 client.4962 trim_cache size 0 max 16384 2024-04-25T13:17:02.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.639+0000 7f36b0821740 1 Processor -- start 2024-04-25T13:17:02.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.639+0000 7f36b0821740 1 -- start start 2024-04-25T13:17:02.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.639+0000 7f36b0821740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df28690 0x55ac5df54840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.639+0000 7f36b0821740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28a70 0x55ac5df54d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36b0821740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 0x55ac5df90410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36b0821740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f36a81fcfd0 con 0x55ac5df493b0 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36b0821740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac5df4ac20 con 0x55ac5df28a70 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36b0821740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55ac5df4e150 con 0x55ac5df28690 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 0x55ac5df90410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 0x55ac5df90410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57294/0 (socket says 172.21.15.52:57294) 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a7fff640 1 -- 172.21.15.52:0/3055224698 learned_addr learned my addr 172.21.15.52:0/3055224698 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a77fe640 1 --2- 172.21.15.52:0/3055224698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df28690 0x55ac5df54840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/3055224698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28a70 0x55ac5df54d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a7fff640 1 -- 172.21.15.52:0/3055224698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df28690 msgr2=0x55ac5df54840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a7fff640 1 --2- 172.21.15.52:0/3055224698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df28690 0x55ac5df54840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a7fff640 1 -- 172.21.15.52:0/3055224698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28a70 msgr2=0x55ac5df54d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a7fff640 1 --2- 172.21.15.52:0/3055224698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28a70 0x55ac5df54d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a7fff640 1 -- 172.21.15.52:0/3055224698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac5df4b110 con 0x55ac5df493b0 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a77fe640 1 --2- 172.21.15.52:0/3055224698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df28690 0x55ac5df54840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/3055224698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28a70 0x55ac5df54d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f36a7fff640 1 --2- 172.21.15.52:0/3055224698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 0x55ac5df90410 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f36a0013000 tx=0x7f36a0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c59697af2ec308 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f368cff9640 1 -- 172.21.15.52:0/3055224698 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0014070 con 0x55ac5df493b0 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f368cff9640 1 -- 172.21.15.52:0/3055224698 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a0003970 con 0x55ac5df493b0 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.640+0000 7f368cff9640 1 -- 172.21.15.52:0/3055224698 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0003d60 con 0x55ac5df493b0 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.641+0000 7f36b0821740 1 -- 172.21.15.52:0/3055224698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 msgr2=0x55ac5df90410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.641+0000 7f36b0821740 1 --2- 172.21.15.52:0/3055224698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 0x55ac5df90410 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f36a0013000 tx=0x7f36a0011000 comp rx=0 tx=0).stop 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.641+0000 7f36b0821740 1 -- 172.21.15.52:0/3055224698 shutdown_connections 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.641+0000 7f36b0821740 1 --2- 172.21.15.52:0/3055224698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 0x55ac5df90410 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.641+0000 7f36b0821740 1 --2- 172.21.15.52:0/3055224698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28a70 0x55ac5df54d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.641+0000 7f36b0821740 1 --2- 172.21.15.52:0/3055224698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df28690 0x55ac5df54840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.641+0000 7f36b0821740 1 -- 172.21.15.52:0/3055224698 >> 172.21.15.52:0/3055224698 conn(0x55ac5df27fc0 msgr2=0x55ac5df53100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.641+0000 7f36b0821740 1 -- 172.21.15.52:0/3055224698 shutdown_connections 2024-04-25T13:17:02.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.641+0000 7f36b0821740 1 -- 172.21.15.52:0/3055224698 wait complete. 2024-04-25T13:17:02.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.641+0000 7f36b0821740 1 -- start start 2024-04-25T13:17:02.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.642+0000 7f36b0821740 1 Processor -- start 2024-04-25T13:17:02.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.642+0000 7f36b0821740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df28690 0x55ac5df76900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.642+0000 7f36b0821740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28a70 0x55ac5df67be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.642+0000 7f36b0821740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 0x55ac5df87c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.642+0000 7f36b0821740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ac5df447b0 con 0x55ac5df493b0 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.642+0000 7f36b0821740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac5df53b40 con 0x55ac5df28a70 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.642+0000 7f36b0821740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55ac5df44e80 con 0x55ac5df28690 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.642+0000 7f36b0821740 10 client.0 _ll_register_callbacks cb 0x7f369c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.642+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 0x55ac5df87c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.642+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 0x55ac5df87c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57298/0 (socket says 172.21.15.52:57298) 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.642+0000 7f36a7fff640 1 -- 172.21.15.52:0/2621708037 learned_addr learned my addr 172.21.15.52:0/2621708037 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36a7fff640 1 -- 172.21.15.52:0/2621708037 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df28690 msgr2=0x55ac5df76900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36a7fff640 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df28690 0x55ac5df76900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36a7fff640 1 -- 172.21.15.52:0/2621708037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28a70 msgr2=0x55ac5df67be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28a70 0x55ac5df67be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36a7fff640 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28a70 0x55ac5df67be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36a7fff640 1 -- 172.21.15.52:0/2621708037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac5dfebc90 con 0x55ac5df493b0 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36a6ffd640 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28a70 0x55ac5df67be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36a7fff640 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 0x55ac5df87c30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f36a0007ee0 tx=0x7f36a000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db61af47e6f1f455 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36867fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36867fc640 1 -- 172.21.15.52:0/2621708037 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0014040 con 0x55ac5df493b0 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36867fc640 1 -- 172.21.15.52:0/2621708037 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f36a0007900 con 0x55ac5df493b0 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36b0821740 1 -- 172.21.15.52:0/2621708037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36a0003970 con 0x55ac5df493b0 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36867fc640 1 -- 172.21.15.52:0/2621708037 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f36a0035050 con 0x55ac5df493b0 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36b0821740 10 client.4968 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36b0821740 1 -- 172.21.15.52:0/2621708037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55ac5df2b120 con 0x55ac5df493b0 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36867fc640 1 -- 172.21.15.52:0/2621708037 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a0003970 con 0x55ac5df493b0 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36867fc640 1 -- 172.21.15.52:0/2621708037 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f36a0038020 con 0x55ac5df493b0 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36b0821740 10 client.4968 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36b0821740 10 client.4968 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36b0821740 20 client.4968 populate_metadata read hostname 'smithi052' 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36b0821740 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.52:6832/3228537118,v1:172.21.15.52:6834/3228537118] conn(0x55ac5df417d0 0x55ac5dff4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36b0821740 4 client.4968 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.643+0000 7f36b0821740 1 -- 172.21.15.52:0/2621708037 --> [v2:172.21.15.52:6832/3228537118,v1:172.21.15.52:6834/3228537118] -- command(tid 0: {"prefix": "status"}) -- 0x55ac5de994e0 con 0x55ac5df417d0 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36a77fe640 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.52:6832/3228537118,v1:172.21.15.52:6834/3228537118] conn(0x55ac5df417d0 0x55ac5dff4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36a77fe640 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.52:6832/3228537118,v1:172.21.15.52:6834/3228537118] conn(0x55ac5df417d0 0x55ac5dff4fd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ff29ac4e155fb8e server_cookie=2fb5781e26ecc6e8 in_seq=0 out_seq=0 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36867fc640 10 client.4968 ms_handle_connect on v2:172.21.15.52:6832/3228537118 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36867fc640 1 -- 172.21.15.52:0/2621708037 <== mds.1 v2:172.21.15.52:6832/3228537118 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ac5de994e0 con 0x55ac5df417d0 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36867fc640 10 client.4968 handle_command_reply: tid=0 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36b0821740 1 client.4968 shutdown 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36b0821740 1 -- 172.21.15.52:0/2621708037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 msgr2=0x55ac5df87c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36b0821740 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 0x55ac5df87c30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f36a0007ee0 tx=0x7f36a000f000 comp rx=0 tx=0).stop 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36b0821740 1 -- 172.21.15.52:0/2621708037 shutdown_connections 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36b0821740 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.52:6832/3228537118,v1:172.21.15.52:6834/3228537118] conn(0x55ac5df417d0 0x55ac5dff4fd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36b0821740 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac5df493b0 0x55ac5df87c30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36b0821740 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac5df28a70 0x55ac5df67be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36867fc640 0 client.4968 ms_handle_reset on v2:172.21.15.52:6832/3228537118 2024-04-25T13:17:02.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36b0821740 1 --2- 172.21.15.52:0/2621708037 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55ac5df28690 0x55ac5df76900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36b0821740 1 -- 172.21.15.52:0/2621708037 >> 172.21.15.52:0/2621708037 conn(0x55ac5df27fc0 msgr2=0x55ac5df54630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36b0821740 1 -- 172.21.15.52:0/2621708037 shutdown_connections 2024-04-25T13:17:02.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36b0821740 1 -- 172.21.15.52:0/2621708037 wait complete. 2024-04-25T13:17:02.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.644+0000 7f36b0821740 20 client.4968 trim_cache size 0 max 16384 2024-04-25T13:17:02.651 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:02.651 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "223f60a6-8e09-4413-a2a5-fc4244f2a674", 2024-04-25T13:17:02.651 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 1, 2024-04-25T13:17:02.651 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4284, 2024-04-25T13:17:02.651 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-04-25T13:17:02.651 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-04-25T13:17:02.652 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-04-25T13:17:02.652 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 28.564030292000002, 2024-04-25T13:17:02.652 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 18, 2024-04-25T13:17:02.652 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 27, 2024-04-25T13:17:02.652 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 27, 2024-04-25T13:17:02.652 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 61.230803524999999 2024-04-25T13:17:02.652 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.645+0000 7f36adb0f640 1 -- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f369406c8f0 msgr2=0x7f369406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.645+0000 7f36adb0f640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f369406c8f0 0x7f369406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f369c034000 tx=0x7f369c02e000 comp rx=0 tx=0).stop 2024-04-25T13:17:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.645+0000 7f36adb0f640 1 -- 172.21.15.52:0/1097055556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a80c9fa0 msgr2=0x7f36a81f0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.645+0000 7f36adb0f640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a80c9fa0 0x7f36a81f0a70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f369800c400 tx=0x7f369800c8c0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.645+0000 7f36adb0f640 1 -- 172.21.15.52:0/1097055556 shutdown_connections 2024-04-25T13:17:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.645+0000 7f36adb0f640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f369406c8f0 0x7f369406edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.645+0000 7f36adb0f640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f36a815cdd0 0x7f36a814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.645+0000 7f36adb0f640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36a80cb440 0x7f36a80cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.645+0000 7f36adb0f640 1 --2- 172.21.15.52:0/1097055556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a80c9fa0 0x7f36a81f0a70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.645+0000 7f36adb0f640 1 -- 172.21.15.52:0/1097055556 >> 172.21.15.52:0/1097055556 conn(0x7f36a8074f30 msgr2=0x7f36a814e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.645+0000 7f36adb0f640 1 -- 172.21.15.52:0/1097055556 shutdown_connections 2024-04-25T13:17:02.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.645+0000 7f36adb0f640 1 -- 172.21.15.52:0/1097055556 wait complete. 2024-04-25T13:17:02.656 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-25T13:17:02.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.757+0000 7fb6a077d640 1 Processor -- start 2024-04-25T13:17:02.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.757+0000 7fb6a077d640 1 -- start start 2024-04-25T13:17:02.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.758+0000 7fb6a077d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb6980c8e10 0x7fb69815e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.758+0000 7fb6a077d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6980c8070 0x7fb69815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.758+0000 7fb6a077d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69806c850 con 0x7fb6981553a0 2024-04-25T13:17:02.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.758+0000 7fb6a077d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb69806cb30 con 0x7fb6980c8070 2024-04-25T13:17:02.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.758+0000 7fb6a077d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb69806ce10 con 0x7fb6980c8e10 2024-04-25T13:17:02.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.758+0000 7fb69ed1a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6980c8070 0x7fb69815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.758+0000 7fb69e519640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb6981553a0 0x7fb6980c8700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41134/0 (socket says 172.21.15.52:41134) 2024-04-25T13:17:02.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.758+0000 7fb69e519640 1 -- 172.21.15.52:0/3891833234 learned_addr learned my addr 172.21.15.52:0/3891833234 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.759+0000 7fb69dd18640 1 --2- 172.21.15.52:0/3891833234 >> v2:172.21.15.102:3300/0 conn(0x7fb6980c8e10 0x7fb69815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.759+0000 7fb69ed1a640 1 -- 172.21.15.52:0/3891833234 >> v2:172.21.15.102:3300/0 conn(0x7fb6980c8e10 msgr2=0x7fb69815e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.759+0000 7fb69ed1a640 1 --2- 172.21.15.52:0/3891833234 >> v2:172.21.15.102:3300/0 conn(0x7fb6980c8e10 0x7fb69815e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.759+0000 7fb69ed1a640 1 -- 172.21.15.52:0/3891833234 >> v1:172.21.15.52:6789/0 conn(0x7fb6981553a0 legacy=0x7fb6980c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.759+0000 7fb69d517640 1 -- 172.21.15.52:0/3891833234 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 346108470 0 0) 0x7fb69806c850 con 0x7fb6981553a0 2024-04-25T13:17:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.759+0000 7fb69ed1a640 1 -- 172.21.15.52:0/3891833234 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69806d0f0 con 0x7fb6980c8070 2024-04-25T13:17:02.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.760+0000 7fb69ed1a640 1 --2- 172.21.15.52:0/3891833234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6980c8070 0x7fb69815ebb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb698071fd0 tx=0x7fb68802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e635fdd8ac84e85b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.760+0000 7fb69d517640 1 -- 172.21.15.52:0/3891833234 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688007740 con 0x7fb6980c8070 2024-04-25T13:17:02.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.760+0000 7fb69d517640 1 -- 172.21.15.52:0/3891833234 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6880078e0 con 0x7fb6980c8070 2024-04-25T13:17:02.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.760+0000 7fb69d517640 1 -- 172.21.15.52:0/3891833234 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688007cb0 con 0x7fb6980c8070 2024-04-25T13:17:02.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.760+0000 7fb6a077d640 1 -- 172.21.15.52:0/3891833234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6980c8070 msgr2=0x7fb69815ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.760+0000 7fb6a077d640 1 --2- 172.21.15.52:0/3891833234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6980c8070 0x7fb69815ebb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb698071fd0 tx=0x7fb68802a710 comp rx=0 tx=0).stop 2024-04-25T13:17:02.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.760+0000 7fb6a077d640 1 -- 172.21.15.52:0/3891833234 shutdown_connections 2024-04-25T13:17:02.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.760+0000 7fb6a077d640 1 --2- 172.21.15.52:0/3891833234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6980c8070 0x7fb69815ebb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.760+0000 7fb6a077d640 1 --2- 172.21.15.52:0/3891833234 >> v2:172.21.15.102:3300/0 conn(0x7fb6980c8e10 0x7fb69815e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.760+0000 7fb6a077d640 1 -- 172.21.15.52:0/3891833234 >> 172.21.15.52:0/3891833234 conn(0x7fb698073010 msgr2=0x7fb698073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.760+0000 7fb6a077d640 1 -- 172.21.15.52:0/3891833234 shutdown_connections 2024-04-25T13:17:02.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.760+0000 7fb6a077d640 1 -- 172.21.15.52:0/3891833234 wait complete. 2024-04-25T13:17:02.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.761+0000 7fb6a077d640 1 Processor -- start 2024-04-25T13:17:02.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.761+0000 7fb6a077d640 1 -- start start 2024-04-25T13:17:02.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.762+0000 7fb6a077d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6980c8070 0x7fb698153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.762+0000 7fb6a077d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6980c8e10 0x7fb698153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.762+0000 7fb6a077d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6981553a0 0x7fb69814db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.762+0000 7fb6a077d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb69815bb80 con 0x7fb6981553a0 2024-04-25T13:17:02.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.762+0000 7fb6a077d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb698155780 con 0x7fb6980c8070 2024-04-25T13:17:02.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.762+0000 7fb6a077d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb69815bd00 con 0x7fb6980c8e10 2024-04-25T13:17:02.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.762+0000 7fb69ed1a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6981553a0 0x7fb69814db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.762+0000 7fb69ed1a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6981553a0 0x7fb69814db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57308/0 (socket says 172.21.15.52:57308) 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.762+0000 7fb69ed1a640 1 -- 172.21.15.52:0/2945978874 learned_addr learned my addr 172.21.15.52:0/2945978874 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb69e519640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6980c8070 0x7fb698153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb69dd18640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6980c8e10 0x7fb698153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb69ed1a640 1 -- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6980c8e10 msgr2=0x7fb698153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb69ed1a640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6980c8e10 0x7fb698153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb69ed1a640 1 -- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6980c8070 msgr2=0x7fb698153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb69ed1a640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6980c8070 0x7fb698153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb69ed1a640 1 -- 172.21.15.52:0/2945978874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6980d0770 con 0x7fb6981553a0 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb69dd18640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6980c8e10 0x7fb698153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb69e519640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6980c8070 0x7fb698153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb69ed1a640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6981553a0 0x7fb69814db90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb68802ad00 tx=0x7fb688004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb696ffd640 1 -- 172.21.15.52:0/2945978874 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688040070 con 0x7fb6981553a0 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb696ffd640 1 -- 172.21.15.52:0/2945978874 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb688031bc0 con 0x7fb6981553a0 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb6a077d640 1 -- 172.21.15.52:0/2945978874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6980cf230 con 0x7fb6981553a0 2024-04-25T13:17:02.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb696ffd640 1 -- 172.21.15.52:0/2945978874 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688045460 con 0x7fb6981553a0 2024-04-25T13:17:02.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.763+0000 7fb6a077d640 1 -- 172.21.15.52:0/2945978874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6980cef50 con 0x7fb6981553a0 2024-04-25T13:17:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.765+0000 7fb696ffd640 1 -- 172.21.15.52:0/2945978874 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb688039040 con 0x7fb6981553a0 2024-04-25T13:17:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.765+0000 7fb696ffd640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb68406c920 0x7fb68406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.765+0000 7fb696ffd640 1 -- 172.21.15.52:0/2945978874 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fb6880ad790 con 0x7fb6981553a0 2024-04-25T13:17:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.765+0000 7fb69e519640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb68406c920 0x7fb68406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.766+0000 7fb69e519640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb68406c920 0x7fb68406ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb690000f60 tx=0x7fb690007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.766+0000 7fb6a3573740 1 Processor -- start 2024-04-25T13:17:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.766+0000 7fb6a3573740 1 -- start start 2024-04-25T13:17:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb6a3573740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 0x55c46bdc6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb6a3573740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd81fc0 0x55c46bd85f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb6a3573740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bd82a70 0x55c46bdd08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb6a3573740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c46bcebc50 con 0x55c46bd82690 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb6a3573740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c46bc88830 con 0x55c46bd82a70 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb6a3573740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55c46bce7c10 con 0x55c46bd81fc0 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb69e519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 0x55c46bdc6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb69e519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 0x55c46bdc6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57316/0 (socket says 172.21.15.52:57316) 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb69e519640 1 -- 172.21.15.52:0/2922882949 learned_addr learned my addr 172.21.15.52:0/2922882949 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb69dd18640 1 --2- 172.21.15.52:0/2922882949 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd81fc0 0x55c46bd85f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb69ed1a640 1 --2- 172.21.15.52:0/2922882949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bd82a70 0x55c46bdd08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb69e519640 1 -- 172.21.15.52:0/2922882949 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd81fc0 msgr2=0x55c46bd85f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb69e519640 1 --2- 172.21.15.52:0/2922882949 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd81fc0 0x55c46bd85f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb69e519640 1 -- 172.21.15.52:0/2922882949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bd82a70 msgr2=0x55c46bdd08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb69e519640 1 --2- 172.21.15.52:0/2922882949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bd82a70 0x55c46bdd08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb69e519640 1 -- 172.21.15.52:0/2922882949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c46b9fe2d0 con 0x55c46bd82690 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb69e519640 1 --2- 172.21.15.52:0/2922882949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 0x55c46bdc6a90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb690005f80 tx=0x7fb690012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d915c9bee68c7d60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb67ffff640 1 -- 172.21.15.52:0/2922882949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690001d20 con 0x55c46bd82690 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb67ffff640 1 -- 172.21.15.52:0/2922882949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6900159c0 con 0x55c46bd82690 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.767+0000 7fb67ffff640 1 -- 172.21.15.52:0/2922882949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690015d70 con 0x55c46bd82690 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.768+0000 7fb6a3573740 1 -- 172.21.15.52:0/2922882949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 msgr2=0x55c46bdc6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.768+0000 7fb6a3573740 1 --2- 172.21.15.52:0/2922882949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 0x55c46bdc6a90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb690005f80 tx=0x7fb690012000 comp rx=0 tx=0).stop 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.768+0000 7fb6a3573740 1 -- 172.21.15.52:0/2922882949 shutdown_connections 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.768+0000 7fb6a3573740 1 --2- 172.21.15.52:0/2922882949 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd81fc0 0x55c46bd85f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.768+0000 7fb6a3573740 1 --2- 172.21.15.52:0/2922882949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bd82a70 0x55c46bdd08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.768+0000 7fb6a3573740 1 --2- 172.21.15.52:0/2922882949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 0x55c46bdc6a90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.768+0000 7fb6a3573740 1 -- 172.21.15.52:0/2922882949 >> 172.21.15.52:0/2922882949 conn(0x55c46bd83c80 msgr2=0x55c46bd86580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.768+0000 7fb6a3573740 1 -- 172.21.15.52:0/2922882949 shutdown_connections 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.768+0000 7fb6a3573740 1 -- 172.21.15.52:0/2922882949 wait complete. 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.769+0000 7fb6a3573740 1 -- start start 2024-04-25T13:17:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.769+0000 7fb6a3573740 1 Processor -- start 2024-04-25T13:17:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.769+0000 7fb6a3573740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd82690 0x55c46bdcb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.769+0000 7fb6a3573740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 0x55c46bdd84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.769+0000 7fb6a3573740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bda6ca0 0x55c46bdac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.769+0000 7fb6a3573740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c46bdc7700 con 0x55c46bd82a70 2024-04-25T13:17:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb6a3573740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c46bc86470 con 0x55c46bda6ca0 2024-04-25T13:17:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb6a3573740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55c46bd850e0 con 0x55c46bd82690 2024-04-25T13:17:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb6a3573740 10 client.0 _ll_register_callbacks cb 0x55c46bcabf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb69dd18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 0x55c46bdd84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb69dd18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 0x55c46bdd84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57320/0 (socket says 172.21.15.52:57320) 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb69dd18640 1 -- 172.21.15.52:0/2471104938 learned_addr learned my addr 172.21.15.52:0/2471104938 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb69e519640 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd82690 0x55c46bdcb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb69ed1a640 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bda6ca0 0x55c46bdac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb69dd18640 1 -- 172.21.15.52:0/2471104938 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd82690 msgr2=0x55c46bdcb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb69dd18640 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd82690 0x55c46bdcb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb69dd18640 1 -- 172.21.15.52:0/2471104938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bda6ca0 msgr2=0x55c46bdac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb69dd18640 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bda6ca0 0x55c46bdac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb69dd18640 1 -- 172.21.15.52:0/2471104938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c46bac86b0 con 0x55c46bd82a70 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb69dd18640 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 0x55c46bdd84b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb68c012320 tx=0x7fb68c0127e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fe7c426d2646d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb67d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb67d7fa640 1 -- 172.21.15.52:0/2471104938 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c019070 con 0x55c46bd82a70 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb6a3573740 1 -- 172.21.15.52:0/2471104938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6900159c0 con 0x55c46bd82a70 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb67d7fa640 1 -- 172.21.15.52:0/2471104938 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fb68c004240 con 0x55c46bd82a70 2024-04-25T13:17:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb67d7fa640 1 -- 172.21.15.52:0/2471104938 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb68c024050 con 0x55c46bd82a70 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb6a3573740 10 client.4983 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.770+0000 7fb6a3573740 1 -- 172.21.15.52:0/2471104938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c46bdd89f0 con 0x55c46bd82a70 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.771+0000 7fb67d7fa640 1 -- 172.21.15.52:0/2471104938 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6900159c0 con 0x55c46bd82a70 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.771+0000 7fb67d7fa640 1 -- 172.21.15.52:0/2471104938 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fb68c027020 con 0x55c46bd82a70 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.771+0000 7fb6a3573740 10 client.4983 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.771+0000 7fb6a3573740 10 client.4983 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.771+0000 7fb6a3573740 20 client.4983 populate_metadata read hostname 'smithi052' 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.771+0000 7fb6a3573740 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x55c46bde5230 0x55c46bde7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.771+0000 7fb6a3573740 4 client.4983 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.771+0000 7fb6a3573740 1 -- 172.21.15.52:0/2471104938 --> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c46bcf9670 con 0x55c46bde5230 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.771+0000 7fb69e519640 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x55c46bde5230 0x55c46bde7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.771+0000 7fb67d7fa640 10 client.4983 ms_handle_connect on v2:172.21.15.52:6836/413759311 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.771+0000 7fb69e519640 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x55c46bde5230 0x55c46bde7620 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0f6ed4ea2d31a9d server_cookie=644627cc62a69411 in_seq=0 out_seq=0 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb67d7fa640 1 -- 172.21.15.52:0/2471104938 <== mds.0 v2:172.21.15.52:6836/413759311 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c46bcf9670 con 0x55c46bde5230 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb67d7fa640 10 client.4983 handle_command_reply: tid=0 2024-04-25T13:17:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb6a3573740 1 client.4983 shutdown 2024-04-25T13:17:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb6a3573740 1 -- 172.21.15.52:0/2471104938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 msgr2=0x55c46bdd84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb6a3573740 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 0x55c46bdd84b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb68c012320 tx=0x7fb68c0127e0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb6a3573740 1 -- 172.21.15.52:0/2471104938 shutdown_connections 2024-04-25T13:17:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb6a3573740 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x55c46bde5230 0x55c46bde7620 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb6a3573740 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bda6ca0 0x55c46bdac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb6a3573740 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 0x55c46bdd84b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb6a3573740 1 --2- 172.21.15.52:0/2471104938 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd82690 0x55c46bdcb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb67d7fa640 0 client.4983 ms_handle_reset on v2:172.21.15.52:6836/413759311 2024-04-25T13:17:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb6a3573740 1 -- 172.21.15.52:0/2471104938 >> 172.21.15.52:0/2471104938 conn(0x55c46bd81fc0 msgr2=0x55c46bd871e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb6a3573740 1 -- 172.21.15.52:0/2471104938 shutdown_connections 2024-04-25T13:17:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb6a3573740 1 -- 172.21.15.52:0/2471104938 wait complete. 2024-04-25T13:17:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.772+0000 7fb6a3573740 20 client.4983 trim_cache size 0 max 16384 2024-04-25T13:17:02.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.791+0000 7fb6a3573740 1 Processor -- start 2024-04-25T13:17:02.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.791+0000 7fb6a3573740 1 -- start start 2024-04-25T13:17:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.791+0000 7fb6a3573740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 0x55c46bd7ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.791+0000 7fb6a3573740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bd82a70 0x55c46bd7d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.791+0000 7fb6a3573740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bda6ca0 0x55c46bdec650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.791+0000 7fb6a3573740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb6981fee80 con 0x55c46bd82690 2024-04-25T13:17:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.791+0000 7fb6a3573740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb6981fcf90 con 0x55c46bd82a70 2024-04-25T13:17:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.791+0000 7fb6a3573740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55c46bda47b0 con 0x55c46bda6ca0 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.791+0000 7fb69e519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 0x55c46bd7ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.791+0000 7fb69e519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 0x55c46bd7ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57332/0 (socket says 172.21.15.52:57332) 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.791+0000 7fb69e519640 1 -- 172.21.15.52:0/1263604380 learned_addr learned my addr 172.21.15.52:0/1263604380 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb69dd18640 1 --2- 172.21.15.52:0/1263604380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bd82a70 0x55c46bd7d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb69ed1a640 1 --2- 172.21.15.52:0/1263604380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bda6ca0 0x55c46bdec650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb69e519640 1 -- 172.21.15.52:0/1263604380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bda6ca0 msgr2=0x55c46bdec650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb69e519640 1 --2- 172.21.15.52:0/1263604380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bda6ca0 0x55c46bdec650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb69e519640 1 -- 172.21.15.52:0/1263604380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bd82a70 msgr2=0x55c46bd7d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb69e519640 1 --2- 172.21.15.52:0/1263604380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bd82a70 0x55c46bd7d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb69e519640 1 -- 172.21.15.52:0/1263604380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c46bda4cd0 con 0x55c46bd82690 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb69e519640 1 --2- 172.21.15.52:0/1263604380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 0x55c46bd7ce70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb690014000 tx=0x7fb69000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2337dd8ac48490f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb67f7fe640 1 -- 172.21.15.52:0/1263604380 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690010040 con 0x55c46bd82690 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb67f7fe640 1 -- 172.21.15.52:0/1263604380 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb690015dd0 con 0x55c46bd82690 2024-04-25T13:17:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb67f7fe640 1 -- 172.21.15.52:0/1263604380 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69002e240 con 0x55c46bd82690 2024-04-25T13:17:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb6a3573740 1 -- 172.21.15.52:0/1263604380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 msgr2=0x55c46bd7ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.792+0000 7fb6a3573740 1 --2- 172.21.15.52:0/1263604380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 0x55c46bd7ce70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb690014000 tx=0x7fb69000a000 comp rx=0 tx=0).stop 2024-04-25T13:17:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.793+0000 7fb6a3573740 1 -- 172.21.15.52:0/1263604380 shutdown_connections 2024-04-25T13:17:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.793+0000 7fb6a3573740 1 --2- 172.21.15.52:0/1263604380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bda6ca0 0x55c46bdec650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.793+0000 7fb6a3573740 1 --2- 172.21.15.52:0/1263604380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bd82a70 0x55c46bd7d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.793+0000 7fb6a3573740 1 --2- 172.21.15.52:0/1263604380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82690 0x55c46bd7ce70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.793+0000 7fb6a3573740 1 -- 172.21.15.52:0/1263604380 >> 172.21.15.52:0/1263604380 conn(0x55c46bd81fc0 msgr2=0x55c46bd80940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.793+0000 7fb6a3573740 1 -- 172.21.15.52:0/1263604380 shutdown_connections 2024-04-25T13:17:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.793+0000 7fb6a3573740 1 -- 172.21.15.52:0/1263604380 wait complete. 2024-04-25T13:17:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.793+0000 7fb6a3573740 1 -- start start 2024-04-25T13:17:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.793+0000 7fb6a3573740 1 Processor -- start 2024-04-25T13:17:02.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb6a3573740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd82690 0x55c46bdb00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb6a3573740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 0x55c46bd88850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb6a3573740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bda6ca0 0x55c46bd88d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb6a3573740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c46bdac7d0 con 0x55c46bd82a70 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb6a3573740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c46bdcbe70 con 0x55c46bda6ca0 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb6a3573740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55c46bddbf20 con 0x55c46bd82690 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb6a3573740 10 client.0 _ll_register_callbacks cb 0x7fb68c007700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb69dd18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 0x55c46bd88850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb69dd18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 0x55c46bd88850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57340/0 (socket says 172.21.15.52:57340) 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb69dd18640 1 -- 172.21.15.52:0/1930434448 learned_addr learned my addr 172.21.15.52:0/1930434448 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb69ed1a640 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bda6ca0 0x55c46bd88d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb69e519640 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd82690 0x55c46bdb00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb69dd18640 1 -- 172.21.15.52:0/1930434448 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd82690 msgr2=0x55c46bdb00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb69dd18640 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd82690 0x55c46bdb00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb69dd18640 1 -- 172.21.15.52:0/1930434448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bda6ca0 msgr2=0x55c46bd88d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:02.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb69dd18640 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bda6ca0 0x55c46bd88d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb69dd18640 1 -- 172.21.15.52:0/1930434448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c46bdb0610 con 0x55c46bd82a70 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.794+0000 7fb69e519640 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd82690 0x55c46bdb00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb69dd18640 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 0x55c46bd88850 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb68c007e00 tx=0x7fb68c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c624c42f97085ff7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb67d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb67d7fa640 1 -- 172.21.15.52:0/1930434448 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c019040 con 0x55c46bd82a70 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb67d7fa640 1 -- 172.21.15.52:0/1930434448 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fb68c004240 con 0x55c46bd82a70 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb6a3573740 1 -- 172.21.15.52:0/1930434448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb690015dd0 con 0x55c46bd82a70 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb67d7fa640 1 -- 172.21.15.52:0/1930434448 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb68c034050 con 0x55c46bd82a70 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb6a3573740 10 client.4989 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb6a3573740 1 -- 172.21.15.52:0/1930434448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c46bdd1020 con 0x55c46bd82a70 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb67d7fa640 1 -- 172.21.15.52:0/1930434448 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb690015dd0 con 0x55c46bd82a70 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb67d7fa640 1 -- 172.21.15.52:0/1930434448 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fb68c037020 con 0x55c46bd82a70 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb6a3573740 10 client.4989 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:02.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb6a3573740 10 client.4989 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb6a3573740 20 client.4989 populate_metadata read hostname 'smithi052' 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb6a3573740 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x55c46be4d4f0 0x55c46be4f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb6a3573740 4 client.4989 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb6a3573740 1 -- 172.21.15.52:0/1930434448 --> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] -- command(tid 0: {"prefix": "status"}) -- 0x55c46bcf34e0 con 0x55c46be4d4f0 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.795+0000 7fb69e519640 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x55c46be4d4f0 0x55c46be4f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb69e519640 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x55c46be4d4f0 0x55c46be4f8e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e67f48fdc33b8a6 server_cookie=12987d9a685ab2e3 in_seq=0 out_seq=0 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb67d7fa640 10 client.4989 ms_handle_connect on v2:172.21.15.52:6836/413759311 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb67d7fa640 1 -- 172.21.15.52:0/1930434448 <== mds.0 v2:172.21.15.52:6836/413759311 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55c46bcf34e0 con 0x55c46be4d4f0 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb67d7fa640 10 client.4989 handle_command_reply: tid=0 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb6a3573740 1 client.4989 shutdown 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb6a3573740 1 -- 172.21.15.52:0/1930434448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 msgr2=0x55c46bd88850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb6a3573740 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 0x55c46bd88850 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb68c007e00 tx=0x7fb68c0046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb6a3573740 1 -- 172.21.15.52:0/1930434448 shutdown_connections 2024-04-25T13:17:02.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb6a3573740 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.52:6836/413759311,v1:172.21.15.52:6837/413759311] conn(0x55c46be4d4f0 0x55c46be4f8e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb6a3573740 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c46bda6ca0 0x55c46bd88d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb6a3573740 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c46bd82a70 0x55c46bd88850 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb67d7fa640 0 client.4989 ms_handle_reset on v2:172.21.15.52:6836/413759311 2024-04-25T13:17:02.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb6a3573740 1 --2- 172.21.15.52:0/1930434448 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c46bd82690 0x55c46bdb00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb6a3573740 1 -- 172.21.15.52:0/1930434448 >> 172.21.15.52:0/1930434448 conn(0x55c46bd81fc0 msgr2=0x55c46bda34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb6a3573740 1 -- 172.21.15.52:0/1930434448 shutdown_connections 2024-04-25T13:17:02.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb6a3573740 1 -- 172.21.15.52:0/1930434448 wait complete. 2024-04-25T13:17:02.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.796+0000 7fb6a3573740 20 client.4989 trim_cache size 0 max 16384 2024-04-25T13:17:02.803 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:02.803 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "223f60a6-8e09-4413-a2a5-fc4244f2a674", 2024-04-25T13:17:02.804 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-04-25T13:17:02.804 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4290, 2024-04-25T13:17:02.804 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-04-25T13:17:02.804 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-04-25T13:17:02.804 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-04-25T13:17:02.804 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 54.791739686, 2024-04-25T13:17:02.804 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 18, 2024-04-25T13:17:02.804 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 27, 2024-04-25T13:17:02.804 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 27, 2024-04-25T13:17:02.804 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 61.378465714999997 2024-04-25T13:17:02.804 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:02.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.797+0000 7fb6a077d640 1 -- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb68406c920 msgr2=0x7fb68406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.797+0000 7fb6a077d640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb68406c920 0x7fb68406ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb690000f60 tx=0x7fb690007ca0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.797+0000 7fb6a077d640 1 -- 172.21.15.52:0/2945978874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6981553a0 msgr2=0x7fb69814db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:02.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.797+0000 7fb6a077d640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6981553a0 0x7fb69814db90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb68802ad00 tx=0x7fb688004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:02.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.797+0000 7fb6a077d640 1 -- 172.21.15.52:0/2945978874 shutdown_connections 2024-04-25T13:17:02.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.797+0000 7fb6a077d640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fb68406c920 0x7fb68406ede0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.797+0000 7fb6a077d640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6980c8e10 0x7fb698153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.797+0000 7fb6a077d640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6981553a0 0x7fb69814db90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.797+0000 7fb6a077d640 1 --2- 172.21.15.52:0/2945978874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6980c8070 0x7fb698153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:02.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.797+0000 7fb6a077d640 1 -- 172.21.15.52:0/2945978874 >> 172.21.15.52:0/2945978874 conn(0x7fb698073010 msgr2=0x7fb698158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:02.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.797+0000 7fb6a077d640 1 -- 172.21.15.52:0/2945978874 shutdown_connections 2024-04-25T13:17:02.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:02.797+0000 7fb6a077d640 1 -- 172.21.15.52:0/2945978874 wait complete. 2024-04-25T13:17:02.808 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T13:17:02.818 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T13:17:02.818 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T13:17:02.818 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T13:17:02.819 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T13:17:02.860 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T13:17:02.860 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T13:17:02.861 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T13:17:02.861 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:17:02.861 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:02.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:02.861 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-04-25T13:17:02.877 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T13:17:02.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:02.877 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:17:02.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:02.942 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-04-25T13:17:03.038 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T13:17:03.038 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:17:03.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.140+0000 7f9f92744640 1 Processor -- start 2024-04-25T13:17:03.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.140+0000 7f9f92744640 1 -- start start 2024-04-25T13:17:03.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f92744640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f8c151ea0 0x7f9f8c0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:03.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f92744640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f8c0c3cb0 0x7f9f8c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:03.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f92744640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8c15b610 con 0x7f9f8c152280 2024-04-25T13:17:03.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f92744640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9f8c06f300 con 0x7f9f8c0c3cb0 2024-04-25T13:17:03.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f92744640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9f8c06e6f0 con 0x7f9f8c151ea0 2024-04-25T13:17:03.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f90ce1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f8c0c3cb0 0x7f9f8c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:03.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f90ce1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f8c0c3cb0 0x7f9f8c0c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57346/0 (socket says 172.21.15.52:57346) 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f90ce1640 1 -- 172.21.15.52:0/828535669 learned_addr learned my addr 172.21.15.52:0/828535669 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f8bfff640 1 --2- 172.21.15.52:0/828535669 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f8c151ea0 0x7f9f8c0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f90ce1640 1 -- 172.21.15.52:0/828535669 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f8c151ea0 msgr2=0x7f9f8c0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f90ce1640 1 --2- 172.21.15.52:0/828535669 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f8c151ea0 0x7f9f8c0c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f90ce1640 1 -- 172.21.15.52:0/828535669 >> v1:172.21.15.102:6789/0 conn(0x7f9f8c152280 legacy=0x7f9f8c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f90ce1640 1 -- 172.21.15.52:0/828535669 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8c06e9d0 con 0x7f9f8c0c3cb0 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.141+0000 7f9f8bfff640 1 --2- 172.21.15.52:0/828535669 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f8c151ea0 0x7f9f8c0c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.142+0000 7f9f90ce1640 1 --2- 172.21.15.52:0/828535669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f8c0c3cb0 0x7f9f8c0c8450 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c06f480 tx=0x7f9f8402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7650acd57bf6346 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.142+0000 7f9f8affd640 1 -- 172.21.15.52:0/828535669 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f84036070 con 0x7f9f8c0c3cb0 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.142+0000 7f9f8affd640 1 -- 172.21.15.52:0/828535669 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f84031600 con 0x7f9f8c0c3cb0 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.142+0000 7f9f8affd640 1 -- 172.21.15.52:0/828535669 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f840319d0 con 0x7f9f8c0c3cb0 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.143+0000 7f9f92744640 1 -- 172.21.15.52:0/828535669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f8c0c3cb0 msgr2=0x7f9f8c0c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.143+0000 7f9f92744640 1 --2- 172.21.15.52:0/828535669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f8c0c3cb0 0x7f9f8c0c8450 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c06f480 tx=0x7f9f8402a7a0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.143+0000 7f9f92744640 1 -- 172.21.15.52:0/828535669 shutdown_connections 2024-04-25T13:17:03.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.143+0000 7f9f92744640 1 --2- 172.21.15.52:0/828535669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f8c0c3cb0 0x7f9f8c0c8450 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.143+0000 7f9f92744640 1 --2- 172.21.15.52:0/828535669 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f8c151ea0 0x7f9f8c0c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.143+0000 7f9f92744640 1 -- 172.21.15.52:0/828535669 >> 172.21.15.52:0/828535669 conn(0x7f9f8c0c8f00 msgr2=0x7f9f8c0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:03.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.143+0000 7f9f92744640 1 -- 172.21.15.52:0/828535669 shutdown_connections 2024-04-25T13:17:03.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.143+0000 7f9f92744640 1 -- 172.21.15.52:0/828535669 wait complete. 2024-04-25T13:17:03.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.144+0000 7f9f92744640 1 Processor -- start 2024-04-25T13:17:03.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.144+0000 7f9f92744640 1 -- start start 2024-04-25T13:17:03.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f92744640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f8c0c3cb0 0x7f9f8c158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:03.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f92744640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f8c151ea0 0x7f9f8c0c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:03.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f92744640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f8c0c5060 0x7f9f8c1ef450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:03.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f92744640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8c0c8cb0 con 0x7f9f8c151ea0 2024-04-25T13:17:03.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f92744640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8c06ef90 con 0x7f9f8c0c5060 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f92744640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9f8c15b2d0 con 0x7f9f8c0c3cb0 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f8b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f8c151ea0 0x7f9f8c0c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f8b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f8c151ea0 0x7f9f8c0c4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57348/0 (socket says 172.21.15.52:57348) 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f8b7fe640 1 -- 172.21.15.52:0/3893739752 learned_addr learned my addr 172.21.15.52:0/3893739752 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f90ce1640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f8c0c5060 0x7f9f8c1ef450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f8bfff640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f8c0c3cb0 0x7f9f8c158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f8b7fe640 1 -- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f8c0c3cb0 msgr2=0x7f9f8c158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f8b7fe640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f8c0c3cb0 0x7f9f8c158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f8b7fe640 1 -- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f8c0c5060 msgr2=0x7f9f8c1ef450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f8b7fe640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f8c0c5060 0x7f9f8c1ef450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.145+0000 7f9f8b7fe640 1 -- 172.21.15.52:0/3893739752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8c0c54f0 con 0x7f9f8c151ea0 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.146+0000 7f9f8b7fe640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f8c151ea0 0x7f9f8c0c4b20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400c3c0 tx=0x7f9f7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.146+0000 7f9f88ff9640 1 -- 172.21.15.52:0/3893739752 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f740052d0 con 0x7f9f8c151ea0 2024-04-25T13:17:03.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.146+0000 7f9f88ff9640 1 -- 172.21.15.52:0/3893739752 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f74005490 con 0x7f9f8c151ea0 2024-04-25T13:17:03.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.146+0000 7f9f92744640 1 -- 172.21.15.52:0/3893739752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f8c0cb600 con 0x7f9f8c151ea0 2024-04-25T13:17:03.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.146+0000 7f9f88ff9640 1 -- 172.21.15.52:0/3893739752 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f74007260 con 0x7f9f8c151ea0 2024-04-25T13:17:03.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.146+0000 7f9f92744640 1 -- 172.21.15.52:0/3893739752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f8c0cbba0 con 0x7f9f8c151ea0 2024-04-25T13:17:03.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.147+0000 7f9f92744640 1 -- 172.21.15.52:0/3893739752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f8c068e40 con 0x7f9f8c151ea0 2024-04-25T13:17:03.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.147+0000 7f9f88ff9640 1 -- 172.21.15.52:0/3893739752 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f74007400 con 0x7f9f8c151ea0 2024-04-25T13:17:03.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.148+0000 7f9f88ff9640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9f6c06c8f0 0x7f9f6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:03.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.148+0000 7f9f88ff9640 1 -- 172.21.15.52:0/3893739752 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f9f7408b350 con 0x7f9f8c151ea0 2024-04-25T13:17:03.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.148+0000 7f9f8bfff640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9f6c06c8f0 0x7f9f6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:03.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.148+0000 7f9f8bfff640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9f6c06c8f0 0x7f9f6c06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c006fd0 tx=0x7f9f7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:03.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.152+0000 7f9f88ff9640 1 -- 172.21.15.52:0/3893739752 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9f74058da0 con 0x7f9f8c151ea0 2024-04-25T13:17:03.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.378+0000 7f9f92744640 1 -- 172.21.15.52:0/3893739752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9f8c15c170 con 0x7f9f8c151ea0 2024-04-25T13:17:03.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.378+0000 7f9f88ff9640 1 -- 172.21.15.52:0/3893739752 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+88 (secure 0 0 0) 0x7f9f7405d0a0 con 0x7f9f8c151ea0 2024-04-25T13:17:03.379 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T13:17:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.380+0000 7f9f92744640 1 -- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9f6c06c8f0 msgr2=0x7f9f6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.380+0000 7f9f92744640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9f6c06c8f0 0x7f9f6c06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c006fd0 tx=0x7f9f7c008040 comp rx=0 tx=0).stop 2024-04-25T13:17:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.380+0000 7f9f92744640 1 -- 172.21.15.52:0/3893739752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f8c151ea0 msgr2=0x7f9f8c0c4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.380+0000 7f9f92744640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f8c151ea0 0x7f9f8c0c4b20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400c3c0 tx=0x7f9f7400c880 comp rx=0 tx=0).stop 2024-04-25T13:17:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.380+0000 7f9f92744640 1 -- 172.21.15.52:0/3893739752 shutdown_connections 2024-04-25T13:17:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.380+0000 7f9f92744640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9f6c06c8f0 0x7f9f6c06edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.380+0000 7f9f92744640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f8c0c5060 0x7f9f8c1ef450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.380+0000 7f9f92744640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f8c151ea0 0x7f9f8c0c4b20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.380+0000 7f9f92744640 1 --2- 172.21.15.52:0/3893739752 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f8c0c3cb0 0x7f9f8c158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.380+0000 7f9f92744640 1 -- 172.21.15.52:0/3893739752 >> 172.21.15.52:0/3893739752 conn(0x7f9f8c0c8f00 msgr2=0x7f9f8c150ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.381+0000 7f9f92744640 1 -- 172.21.15.52:0/3893739752 shutdown_connections 2024-04-25T13:17:03.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03.381+0000 7f9f92744640 1 -- 172.21.15.52:0/3893739752 wait complete. 2024-04-25T13:17:03.392 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T13:17:03.392 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:17:03.392 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-04-25T13:17:03.392 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T13:17:03.392 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:03.392 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T13:17:03.392 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:17:03.392 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:17:03.392 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:17:03.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:03.393 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-04-25T13:17:03.408 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:17:03.408 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:17:03.408 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:17:03.408 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:17:03.408 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42664sec preferred_lft 42664sec 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link noprefixroute 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:17:03.409 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:17:03.410 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-04-25T13:17:03.410 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-04-25T13:17:03.410 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:17:03.410 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:03.410 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T13:17:03.410 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:17:03.410 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2024-04-25T13:17:03.410 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2024-04-25T13:17:03.410 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:17:03.410 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T13:17:03.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:03.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:03.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:03.547 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:17:03.570 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-04-25T13:17:03.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:03.572 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-04-25T13:17:03.628 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-04-25T13:17:03.628 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:17:03.628 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T13:17:03.628 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T13:17:03.628 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:17:03.629 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:03.629 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T13:17:03.629 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T13:17:03.629 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T13:17:03.629 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T13:17:03.629 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T13:17:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:03.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:03.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:03.755 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-04-25T13:17:03.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:03.771 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2024-04-25T13:17:03.826 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:03.826 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T13:17:03.827 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:03.827 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T13:17:03.827 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T13:17:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:03.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:03.944 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T13:17:03.944 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:03.944 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T13:17:03.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T13:17:03.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:17:03.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T13:17:03.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T13:17:03.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T13:17:03.944 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T13:17:03.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:04.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:04.059 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:04.059 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T13:17:04.059 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-04-25T13:17:04.059 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:17:04.059 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T13:17:04.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:04.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:04.137 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T13:17:04.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:17:04.137 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:04.153 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:17:04.153 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:17:04.153 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:04.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-04-25T13:17:04.275 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:17:04.332 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2024-04-25T13:17:04.332 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2024-04-25T13:17:04.332 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2024-04-25T13:17:04.332 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2024-04-25T13:17:04.332 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2024-04-25T13:17:04.332 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2024-04-25T13:17:04.332 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2024-04-25T13:17:04.332 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2024-04-25T13:17:04.332 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/selinux 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:17:04.333 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:17:04.334 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:17:04.334 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:17:04.334 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2024-04-25T13:17:04.334 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2024-04-25T13:17:04.334 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:17:04.334 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:17:04.334 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:17:04.334 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:17:04.334 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2024-04-25T13:17:04.334 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:04.334 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:04.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:04.335 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-04-25T13:17:04.387 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T13:17:04.387 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T13:17:04.429 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-04-25T13:17:04.453 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:17:04.509 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2024-04-25T13:17:04.509 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2024-04-25T13:17:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2024-04-25T13:17:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2024-04-25T13:17:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2024-04-25T13:17:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2024-04-25T13:17:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2024-04-25T13:17:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2024-04-25T13:17:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2024-04-25T13:17:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2024-04-25T13:17:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2024-04-25T13:17:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/selinux 2024-04-25T13:17:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:17:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:17:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:17:04.512 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2024-04-25T13:17:04.512 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:04.512 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:04.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:04.513 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-04-25T13:17:04.513 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:2024-04-25T13:17:04.510+0000 7f3c2740f480 -1 init, newargv = 0x556c63dd2970 newargc=15 2024-04-25T13:17:04.513 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[45144]: starting ceph client 2024-04-25T13:17:04.522 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[45144]: starting fuse 2024-04-25T13:17:04.537 INFO:teuthology.orchestra.run.smithi052.stdout:43 2024-04-25T13:17:04.537 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-25T13:17:04.538 DEBUG:teuthology.orchestra.run.smithi052:> sudo stdin-killer -- python3 -c ' 2024-04-25T13:17:04.538 DEBUG:teuthology.orchestra.run.smithi052:> import glob 2024-04-25T13:17:04.538 DEBUG:teuthology.orchestra.run.smithi052:> import re 2024-04-25T13:17:04.538 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-04-25T13:17:04.538 DEBUG:teuthology.orchestra.run.smithi052:> import subprocess 2024-04-25T13:17:04.538 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-25T13:17:04.538 DEBUG:teuthology.orchestra.run.smithi052:> def _find_admin_socket(client_name): 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> files = glob.glob(asok_path) 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> # Given a non-glob path, it better be there 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> if "*" not in asok_path: 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> assert(len(files) == 1) 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> return files[0] 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> for f in files: 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> contents = proc_f.read() 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> if mountpoint in contents: 2024-04-25T13:17:04.539 DEBUG:teuthology.orchestra.run.smithi052:> return f 2024-04-25T13:17:04.540 DEBUG:teuthology.orchestra.run.smithi052:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T13:17:04.540 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-25T13:17:04.540 DEBUG:teuthology.orchestra.run.smithi052:> print(_find_admin_socket("client.0")) 2024-04-25T13:17:04.540 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-04-25T13:17:04.656 INFO:teuthology.orchestra.run.smithi052.stdout:/var/run/ceph/ceph-client.0.45144.asok 2024-04-25T13:17:04.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:04.666 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45144.asok 2024-04-25T13:17:04.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:04.666 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45144.asok status 2024-04-25T13:17:04.801 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:04.801 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": { 2024-04-25T13:17:04.801 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "entity_id": "0", 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "hostname": "smithi052", 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "pid": "45144", 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "root": "/" 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_count": 0, 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_pinned_count": 0, 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 5001, 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "inst": { 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "name": { 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "client", 2024-04-25T13:17:04.802 INFO:teuthology.orchestra.run.smithi052.stdout: "num": 5001 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 335227259 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 335227259 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: "inst_str": "client.5001 192.168.0.1:0/335227259", 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: "addr_str": "192.168.0.1:0/335227259", 2024-04-25T13:17:04.803 INFO:teuthology.orchestra.run.smithi052.stdout: "inode_count": 1, 2024-04-25T13:17:04.804 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_epoch": 18, 2024-04-25T13:17:04.804 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch": 27, 2024-04-25T13:17:04.804 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch_barrier": 0, 2024-04-25T13:17:04.804 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklisted": false, 2024-04-25T13:17:04.804 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs" 2024-04-25T13:17:04.804 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:04.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:04.810 DEBUG:teuthology.orchestra.run.smithi052:> stat --file-system '--printf=%T 2024-04-25T13:17:04.810 DEBUG:teuthology.orchestra.run.smithi052:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:04.825 INFO:teuthology.orchestra.run.smithi052.stdout:fuseblk 2024-04-25T13:17:04.825 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:04.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:04.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:04.890 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-25T13:17:04.903 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa/tasks/quiescer.py", line 387, in task cluster_name = config.get('cluster', 'ceph') AttributeError: 'NoneType' object has no attribute 'get' 2024-04-25T13:17:05.141 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=0f96263e11274a48b2d9ec40b1ce2076 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa/tasks/quiescer.py", line 387, in task cluster_name = config.get('cluster', 'ceph') AttributeError: 'NoneType' object has no attribute 'get' 2024-04-25T13:17:05.143 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-25T13:17:05.152 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T13:17:05.166 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T13:17:05.167 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:17:05.167 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:17:05.187 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:17:05.187 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:17:05.243 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:05.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.386+0000 7f24f0e9a640 1 Processor -- start 2024-04-25T13:17:05.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.386+0000 7f24f0e9a640 1 -- start start 2024-04-25T13:17:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.387+0000 7f24f0e9a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0b3c00 0x7f24ec0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.387+0000 7f24f0e9a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f24ec0b5450 0x7f24ec0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.387+0000 7f24f0e9a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24ec1558c0 con 0x7f24ec1554e0 2024-04-25T13:17:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.387+0000 7f24f0e9a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f24ec0b4a80 con 0x7f24ec0b5450 2024-04-25T13:17:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.387+0000 7f24f0e9a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f24ec0cb8c0 con 0x7f24ec0b3c00 2024-04-25T13:17:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.387+0000 7f24ea59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f24ec1554e0 0x7f24ec15f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41148/0 (socket says 172.21.15.52:41148) 2024-04-25T13:17:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.387+0000 7f24ea59c640 1 -- 172.21.15.52:0/360552158 learned_addr learned my addr 172.21.15.52:0/360552158 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24ead9d640 1 --2- 172.21.15.52:0/360552158 >> v2:172.21.15.102:3300/0 conn(0x7f24ec0b5450 0x7f24ec0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2961400182 0 0) 0x7f24e4001110 con 0x7f24ec1554e0 2024-04-25T13:17:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e9d9b640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0b3c00 0x7f24ec0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24d8003520 con 0x7f24ec1554e0 2024-04-25T13:17:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1830146800 0 0) 0x7f24d8003520 con 0x7f24ec1554e0 2024-04-25T13:17:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0b3c00 msgr2=0x7f24ec0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0b3c00 0x7f24ec0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 >> v2:172.21.15.102:3300/0 conn(0x7f24ec0b5450 msgr2=0x7f24ec0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 --2- 172.21.15.52:0/360552158 >> v2:172.21.15.102:3300/0 conn(0x7f24ec0b5450 0x7f24ec0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ec0cbba0 con 0x7f24ec1554e0 2024-04-25T13:17:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f24e4001840 con 0x7f24ec1554e0 2024-04-25T13:17:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 >> v1:172.21.15.52:6789/0 conn(0x7f24ec1554e0 legacy=0x7f24ec15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24d80039b0 0x7f24d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24d8004800 0x7f24d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0b3c00 0x7f24d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec0b4a80 con 0x7f24d80039b0 2024-04-25T13:17:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec0cb8c0 con 0x7f24d8004800 2024-04-25T13:17:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f24d800b9c0 con 0x7f24ec0b3c00 2024-04-25T13:17:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24ea59c640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24d80039b0 0x7f24d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24ead9d640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0b3c00 0x7f24d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e9d9b640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24d8004800 0x7f24d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24ea59c640 1 -- 172.21.15.52:0/360552158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0b3c00 msgr2=0x7f24d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:05.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24ea59c640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0b3c00 0x7f24d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24ea59c640 1 -- 172.21.15.52:0/360552158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24d8004800 msgr2=0x7f24d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:05.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24ea59c640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24d8004800 0x7f24d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24ea59c640 1 -- 172.21.15.52:0/360552158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d8003520 con 0x7f24d80039b0 2024-04-25T13:17:05.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.388+0000 7f24e9d9b640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24d8004800 0x7f24d8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:05.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.389+0000 7f24ea59c640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24d80039b0 0x7f24d8003dd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f24e400c3e0 tx=0x7f24d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c404cde99ec55b8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:05.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.389+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4032020 con 0x7f24d80039b0 2024-04-25T13:17:05.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.389+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e4005ad0 con 0x7f24d80039b0 2024-04-25T13:17:05.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.389+0000 7f24e959a640 1 -- 172.21.15.52:0/360552158 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e400c0e0 con 0x7f24d80039b0 2024-04-25T13:17:05.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.390+0000 7f24f0e9a640 1 -- 172.21.15.52:0/360552158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24d80039b0 msgr2=0x7f24d8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.390+0000 7f24f0e9a640 1 --2- 172.21.15.52:0/360552158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24d80039b0 0x7f24d8003dd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f24e400c3e0 tx=0x7f24d8005830 comp rx=0 tx=0).stop 2024-04-25T13:17:05.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.390+0000 7f24ead9d640 1 -- 172.21.15.52:0/360552158 reap_dead start 2024-04-25T13:17:05.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.390+0000 7f24f0e9a640 1 -- 172.21.15.52:0/360552158 shutdown_connections 2024-04-25T13:17:05.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.390+0000 7f24f0e9a640 1 -- 172.21.15.52:0/360552158 >> 172.21.15.52:0/360552158 conn(0x7f24ec074d50 msgr2=0x7f24ec075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:05.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.390+0000 7f24f0e9a640 1 -- 172.21.15.52:0/360552158 shutdown_connections 2024-04-25T13:17:05.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.390+0000 7f24f0e9a640 1 -- 172.21.15.52:0/360552158 wait complete. 2024-04-25T13:17:05.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.391+0000 7f24f0e9a640 1 Processor -- start 2024-04-25T13:17:05.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.391+0000 7f24f0e9a640 1 -- start start 2024-04-25T13:17:05.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24f0e9a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24d80039b0 0x7f24ec1f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24f0e9a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0cab10 0x7f24ec154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24f0e9a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24ec1f2d90 0x7f24ec1f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24f0e9a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec0b4710 con 0x7f24ec1f2d90 2024-04-25T13:17:05.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24f0e9a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec0b4430 con 0x7f24d80039b0 2024-04-25T13:17:05.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24f0e9a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f24ec0b3580 con 0x7f24ec0cab10 2024-04-25T13:17:05.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24ec1f2d90 0x7f24ec1f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24ec1f2d90 0x7f24ec1f3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57360/0 (socket says 172.21.15.52:57360) 2024-04-25T13:17:05.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24ead9d640 1 -- 172.21.15.52:0/2008391169 learned_addr learned my addr 172.21.15.52:0/2008391169 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:05.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24e9d9b640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0cab10 0x7f24ec154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24ea59c640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24d80039b0 0x7f24ec1f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24ead9d640 1 -- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0cab10 msgr2=0x7f24ec154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24ead9d640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0cab10 0x7f24ec154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24ead9d640 1 -- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24d80039b0 msgr2=0x7f24ec1f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24ead9d640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24d80039b0 0x7f24ec1f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24ead9d640 1 -- 172.21.15.52:0/2008391169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ec0c9aa0 con 0x7f24ec1f2d90 2024-04-25T13:17:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24ea59c640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24d80039b0 0x7f24ec1f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24ead9d640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24ec1f2d90 0x7f24ec1f3240 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0b58c0 tx=0x7f24dc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.392+0000 7f24e2ffd640 1 -- 172.21.15.52:0/2008391169 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc011e90 con 0x7f24ec1f2d90 2024-04-25T13:17:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.393+0000 7f24e2ffd640 1 -- 172.21.15.52:0/2008391169 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24dc01c070 con 0x7f24ec1f2d90 2024-04-25T13:17:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.393+0000 7f24f0e9a640 1 -- 172.21.15.52:0/2008391169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ec0c9d80 con 0x7f24ec1f2d90 2024-04-25T13:17:05.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.393+0000 7f24e2ffd640 1 -- 172.21.15.52:0/2008391169 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc003bd0 con 0x7f24ec1f2d90 2024-04-25T13:17:05.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.393+0000 7f24f0e9a640 1 -- 172.21.15.52:0/2008391169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ec0ca340 con 0x7f24ec1f2d90 2024-04-25T13:17:05.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.394+0000 7f24f0e9a640 1 -- 172.21.15.52:0/2008391169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24ec0cddd0 con 0x7f24ec1f2d90 2024-04-25T13:17:05.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.394+0000 7f24e2ffd640 1 -- 172.21.15.52:0/2008391169 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24dc004030 con 0x7f24ec1f2d90 2024-04-25T13:17:05.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.394+0000 7f24e2ffd640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f24cc06cac0 0x7f24cc06ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.394+0000 7f24e2ffd640 1 -- 172.21.15.52:0/2008391169 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f24dc08c860 con 0x7f24ec1f2d90 2024-04-25T13:17:05.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.395+0000 7f24ea59c640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f24cc06cac0 0x7f24cc06ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.395+0000 7f24ea59c640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f24cc06cac0 0x7f24cc06ef80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f24e4033000 tx=0x7f24e403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:05.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.399+0000 7f24e2ffd640 1 -- 172.21.15.52:0/2008391169 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f24ec0cddd0 con 0x7f24ec1f2d90 2024-04-25T13:17:05.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.587+0000 7f24f0e9a640 1 -- 172.21.15.52:0/2008391169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24ec068e40 con 0x7f24ec1f2d90 2024-04-25T13:17:05.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.588+0000 7f24e2ffd640 1 -- 172.21.15.52:0/2008391169 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18927 (secure 0 0 0) 0x7f24dc010040 con 0x7f24ec1f2d90 2024-04-25T13:17:05.589 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:17:05.589 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:49.125761+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:05.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.590+0000 7f24f0e9a640 1 -- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f24cc06cac0 msgr2=0x7f24cc06ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.590+0000 7f24f0e9a640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f24cc06cac0 0x7f24cc06ef80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f24e4033000 tx=0x7f24e403b040 comp rx=0 tx=0).stop 2024-04-25T13:17:05.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.590+0000 7f24f0e9a640 1 -- 172.21.15.52:0/2008391169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24ec1f2d90 msgr2=0x7f24ec1f3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.590+0000 7f24f0e9a640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24ec1f2d90 0x7f24ec1f3240 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0b58c0 tx=0x7f24dc00f580 comp rx=0 tx=0).stop 2024-04-25T13:17:05.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.590+0000 7f24f0e9a640 1 -- 172.21.15.52:0/2008391169 shutdown_connections 2024-04-25T13:17:05.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.590+0000 7f24f0e9a640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f24cc06cac0 0x7f24cc06ef80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.590+0000 7f24f0e9a640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24ec0cab10 0x7f24ec154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.590+0000 7f24f0e9a640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24ec1f2d90 0x7f24ec1f3240 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.590+0000 7f24f0e9a640 1 --2- 172.21.15.52:0/2008391169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24d80039b0 0x7f24ec1f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.590+0000 7f24f0e9a640 1 -- 172.21.15.52:0/2008391169 >> 172.21.15.52:0/2008391169 conn(0x7f24ec074d50 msgr2=0x7f24ec0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:05.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.590+0000 7f24f0e9a640 1 -- 172.21.15.52:0/2008391169 shutdown_connections 2024-04-25T13:17:05.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.590+0000 7f24f0e9a640 1 -- 172.21.15.52:0/2008391169 wait complete. 2024-04-25T13:17:05.602 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.833544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:05.935596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:06.297991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:10.015464+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:17:05.603 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:17:05.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.706+0000 7f3964662640 1 Processor -- start 2024-04-25T13:17:05.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.706+0000 7f3964662640 1 -- start start 2024-04-25T13:17:05.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f3964662640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f395c158b10 0x7f395c15b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f3964662640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f395c0c8720 0x7f395c151b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f3964662640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f395c157d70 con 0x7f395c0c8340 2024-04-25T13:17:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f3964662640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f395c158680 con 0x7f395c0c8720 2024-04-25T13:17:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f3964662640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f395c15be10 con 0x7f395c158b10 2024-04-25T13:17:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f3962bff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f395c0c8720 0x7f395c151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f39623fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f395c0c8340 0x7f395c0723b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41164/0 (socket says 172.21.15.52:41164) 2024-04-25T13:17:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f39623fe640 1 -- 172.21.15.52:0/1967129872 learned_addr learned my addr 172.21.15.52:0/1967129872 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f3961bfd640 1 --2- 172.21.15.52:0/1967129872 >> v2:172.21.15.102:3300/0 conn(0x7f395c158b10 0x7f395c15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f3962bff640 1 -- 172.21.15.52:0/1967129872 >> v2:172.21.15.102:3300/0 conn(0x7f395c158b10 msgr2=0x7f395c15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:05.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f3962bff640 1 --2- 172.21.15.52:0/1967129872 >> v2:172.21.15.102:3300/0 conn(0x7f395c158b10 0x7f395c15b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f3962bff640 1 -- 172.21.15.52:0/1967129872 >> v1:172.21.15.52:6789/0 conn(0x7f395c0c8340 legacy=0x7f395c0723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f3962bff640 1 -- 172.21.15.52:0/1967129872 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c15c0f0 con 0x7f395c0c8720 2024-04-25T13:17:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.707+0000 7f39613fc640 1 -- 172.21.15.52:0/1967129872 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 811018111 0 0) 0x7f395c157d70 con 0x7f395c0c8340 2024-04-25T13:17:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.708+0000 7f3962bff640 1 --2- 172.21.15.52:0/1967129872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f395c0c8720 0x7f395c151b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f395c0c94c0 tx=0x7f395402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5396789329336fd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.708+0000 7f39613fc640 1 -- 172.21.15.52:0/1967129872 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954007740 con 0x7f395c0c8720 2024-04-25T13:17:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.708+0000 7f39613fc640 1 -- 172.21.15.52:0/1967129872 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39540078e0 con 0x7f395c0c8720 2024-04-25T13:17:05.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.708+0000 7f39613fc640 1 -- 172.21.15.52:0/1967129872 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954007cb0 con 0x7f395c0c8720 2024-04-25T13:17:05.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.709+0000 7f3964662640 1 -- 172.21.15.52:0/1967129872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f395c0c8720 msgr2=0x7f395c151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.709+0000 7f3964662640 1 --2- 172.21.15.52:0/1967129872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f395c0c8720 0x7f395c151b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f395c0c94c0 tx=0x7f395402a680 comp rx=0 tx=0).stop 2024-04-25T13:17:05.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.709+0000 7f3964662640 1 -- 172.21.15.52:0/1967129872 shutdown_connections 2024-04-25T13:17:05.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.709+0000 7f3964662640 1 --2- 172.21.15.52:0/1967129872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f395c0c8720 0x7f395c151b10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.709+0000 7f3964662640 1 --2- 172.21.15.52:0/1967129872 >> v2:172.21.15.102:3300/0 conn(0x7f395c158b10 0x7f395c15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.709+0000 7f3964662640 1 -- 172.21.15.52:0/1967129872 >> 172.21.15.52:0/1967129872 conn(0x7f395c06d660 msgr2=0x7f395c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:05.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.709+0000 7f3964662640 1 -- 172.21.15.52:0/1967129872 shutdown_connections 2024-04-25T13:17:05.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.709+0000 7f3964662640 1 -- 172.21.15.52:0/1967129872 wait complete. 2024-04-25T13:17:05.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.710+0000 7f3964662640 1 Processor -- start 2024-04-25T13:17:05.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.710+0000 7f3964662640 1 -- start start 2024-04-25T13:17:05.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f3964662640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f395c0c8340 0x7f395c14d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f3964662640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f395c0c8720 0x7f395c1f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f3964662640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f395c158b10 0x7f395c1f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f3964662640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f395c15b8a0 con 0x7f395c0c8340 2024-04-25T13:17:05.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f3964662640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f395c158310 con 0x7f395c0c8720 2024-04-25T13:17:05.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f3964662640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f395c15ba20 con 0x7f395c158b10 2024-04-25T13:17:05.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f39623fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f395c0c8340 0x7f395c14d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f39623fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f395c0c8340 0x7f395c14d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57372/0 (socket says 172.21.15.52:57372) 2024-04-25T13:17:05.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f39623fe640 1 -- 172.21.15.52:0/474215566 learned_addr learned my addr 172.21.15.52:0/474215566 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:05.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f3962bff640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f395c158b10 0x7f395c1f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f3961bfd640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f395c0c8720 0x7f395c1f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f39623fe640 1 -- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f395c158b10 msgr2=0x7f395c1f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f39623fe640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f395c158b10 0x7f395c1f2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f39623fe640 1 -- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f395c0c8720 msgr2=0x7f395c1f1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f39623fe640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f395c0c8720 0x7f395c1f1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f39623fe640 1 -- 172.21.15.52:0/474215566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c0ca460 con 0x7f395c0c8340 2024-04-25T13:17:05.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f39623fe640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f395c0c8340 0x7f395c14d510 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f395800c500 tx=0x7f395800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:05.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f3952ffd640 1 -- 172.21.15.52:0/474215566 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958018070 con 0x7f395c0c8340 2024-04-25T13:17:05.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f3952ffd640 1 -- 172.21.15.52:0/474215566 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3958007580 con 0x7f395c0c8340 2024-04-25T13:17:05.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f3952ffd640 1 -- 172.21.15.52:0/474215566 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958004a20 con 0x7f395c0c8340 2024-04-25T13:17:05.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.711+0000 7f3964662640 1 -- 172.21.15.52:0/474215566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395c15ad70 con 0x7f395c0c8340 2024-04-25T13:17:05.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.712+0000 7f3964662640 1 -- 172.21.15.52:0/474215566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395c0ca6d0 con 0x7f395c0c8340 2024-04-25T13:17:05.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.713+0000 7f3964662640 1 -- 172.21.15.52:0/474215566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395c068f50 con 0x7f395c0c8340 2024-04-25T13:17:05.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.713+0000 7f3952ffd640 1 -- 172.21.15.52:0/474215566 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f395801b070 con 0x7f395c0c8340 2024-04-25T13:17:05.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.713+0000 7f3952ffd640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f394006c8f0 0x7f394006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:05.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.714+0000 7f3952ffd640 1 -- 172.21.15.52:0/474215566 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f395808b1b0 con 0x7f395c0c8340 2024-04-25T13:17:05.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.714+0000 7f3961bfd640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f394006c8f0 0x7f394006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:05.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.714+0000 7f3961bfd640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f394006c8f0 0x7f394006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f395c14e130 tx=0x7f394c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:05.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.718+0000 7f3952ffd640 1 -- 172.21.15.52:0/474215566 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f395c15ad70 con 0x7f395c0c8340 2024-04-25T13:17:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.901+0000 7f3964662640 1 -- 172.21.15.52:0/474215566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f395c0c6120 con 0x7f395c0c8340 2024-04-25T13:17:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.902+0000 7f3952ffd640 1 -- 172.21.15.52:0/474215566 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f3958059250 con 0x7f395c0c8340 2024-04-25T13:17:05.902 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T13:17:05.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.904+0000 7f3964662640 1 -- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f394006c8f0 msgr2=0x7f394006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.904+0000 7f3964662640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f394006c8f0 0x7f394006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f395c14e130 tx=0x7f394c008040 comp rx=0 tx=0).stop 2024-04-25T13:17:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.904+0000 7f3964662640 1 -- 172.21.15.52:0/474215566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f395c0c8340 msgr2=0x7f395c14d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.904+0000 7f3964662640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f395c0c8340 0x7f395c14d510 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f395800c500 tx=0x7f395800c9c0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.904+0000 7f3964662640 1 -- 172.21.15.52:0/474215566 shutdown_connections 2024-04-25T13:17:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.904+0000 7f3964662640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f394006c8f0 0x7f394006edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.904+0000 7f3964662640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f395c158b10 0x7f395c1f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.904+0000 7f3964662640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f395c0c8720 0x7f395c1f1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.904+0000 7f3964662640 1 --2- 172.21.15.52:0/474215566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f395c0c8340 0x7f395c14d510 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.904+0000 7f3964662640 1 -- 172.21.15.52:0/474215566 >> 172.21.15.52:0/474215566 conn(0x7f395c06d660 msgr2=0x7f395c072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.904+0000 7f3964662640 1 -- 172.21.15.52:0/474215566 shutdown_connections 2024-04-25T13:17:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:05.904+0000 7f3964662640 1 -- 172.21.15.52:0/474215566 wait complete. 2024-04-25T13:17:05.915 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:17:06.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.019+0000 7fda5a39b640 1 Processor -- start 2024-04-25T13:17:06.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.019+0000 7fda5a39b640 1 -- start start 2024-04-25T13:17:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda5a39b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda54155260 0x7fda540cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda5a39b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fda5415bd00 0x7fda5415e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda5a39b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda540ce850 con 0x7fda540740b0 2024-04-25T13:17:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda5a39b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fda5415b160 con 0x7fda5415bd00 2024-04-25T13:17:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda5a39b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fda540ceb10 con 0x7fda54155260 2024-04-25T13:17:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda58938640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fda5415bd00 0x7fda5415e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda537fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fda540740b0 0x7fda5415b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41172/0 (socket says 172.21.15.52:41172) 2024-04-25T13:17:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda537fe640 1 -- 172.21.15.52:0/3563868657 learned_addr learned my addr 172.21.15.52:0/3563868657 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda53fff640 1 --2- 172.21.15.52:0/3563868657 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda54155260 0x7fda540cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda58938640 1 -- 172.21.15.52:0/3563868657 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda54155260 msgr2=0x7fda540cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda58938640 1 --2- 172.21.15.52:0/3563868657 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda54155260 0x7fda540cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda58938640 1 -- 172.21.15.52:0/3563868657 >> v1:172.21.15.52:6789/0 conn(0x7fda540740b0 legacy=0x7fda5415b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda58938640 1 -- 172.21.15.52:0/3563868657 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda540cedf0 con 0x7fda5415bd00 2024-04-25T13:17:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.020+0000 7fda52ffd640 1 -- 172.21.15.52:0/3563868657 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149507471 0 0) 0x7fda540ce850 con 0x7fda540740b0 2024-04-25T13:17:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.021+0000 7fda58938640 1 --2- 172.21.15.52:0/3563868657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5415bd00 0x7fda5415e650 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009d90 tx=0x7fda4c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa5e5ad0a7c8ec5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.021+0000 7fda52ffd640 1 -- 172.21.15.52:0/3563868657 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c007740 con 0x7fda5415bd00 2024-04-25T13:17:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.021+0000 7fda52ffd640 1 -- 172.21.15.52:0/3563868657 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda4c0078e0 con 0x7fda5415bd00 2024-04-25T13:17:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.021+0000 7fda52ffd640 1 -- 172.21.15.52:0/3563868657 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c007cb0 con 0x7fda5415bd00 2024-04-25T13:17:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.022+0000 7fda5a39b640 1 -- 172.21.15.52:0/3563868657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5415bd00 msgr2=0x7fda5415e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.022+0000 7fda5a39b640 1 --2- 172.21.15.52:0/3563868657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5415bd00 0x7fda5415e650 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009d90 tx=0x7fda4c02a660 comp rx=0 tx=0).stop 2024-04-25T13:17:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.022+0000 7fda5a39b640 1 -- 172.21.15.52:0/3563868657 shutdown_connections 2024-04-25T13:17:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.022+0000 7fda5a39b640 1 --2- 172.21.15.52:0/3563868657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5415bd00 0x7fda5415e650 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.022+0000 7fda5a39b640 1 --2- 172.21.15.52:0/3563868657 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda54155260 0x7fda540cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.022+0000 7fda5a39b640 1 -- 172.21.15.52:0/3563868657 >> 172.21.15.52:0/3563868657 conn(0x7fda54073590 msgr2=0x7fda540739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.022+0000 7fda5a39b640 1 -- 172.21.15.52:0/3563868657 shutdown_connections 2024-04-25T13:17:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.022+0000 7fda5a39b640 1 -- 172.21.15.52:0/3563868657 wait complete. 2024-04-25T13:17:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.023+0000 7fda5a39b640 1 Processor -- start 2024-04-25T13:17:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.023+0000 7fda5a39b640 1 -- start start 2024-04-25T13:17:06.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda5a39b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda540740b0 0x7fda540c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda5a39b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda54155260 0x7fda5415d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda5a39b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda5415bd00 0x7fda5415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda5a39b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda54155640 con 0x7fda540740b0 2024-04-25T13:17:06.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda5a39b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fda540cf3b0 con 0x7fda54155260 2024-04-25T13:17:06.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda5a39b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fda541557c0 con 0x7fda5415bd00 2024-04-25T13:17:06.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda53fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda540740b0 0x7fda540c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda53fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda540740b0 0x7fda540c55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57376/0 (socket says 172.21.15.52:57376) 2024-04-25T13:17:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda53fff640 1 -- 172.21.15.52:0/1741274396 learned_addr learned my addr 172.21.15.52:0/1741274396 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda537fe640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda54155260 0x7fda5415d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda58938640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda5415bd00 0x7fda5415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda53fff640 1 -- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda5415bd00 msgr2=0x7fda5415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda53fff640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda5415bd00 0x7fda5415d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda53fff640 1 -- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda54155260 msgr2=0x7fda5415d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda53fff640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda54155260 0x7fda5415d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda53fff640 1 -- 172.21.15.52:0/1741274396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda541f1430 con 0x7fda540740b0 2024-04-25T13:17:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.024+0000 7fda58938640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda5415bd00 0x7fda5415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.025+0000 7fda53fff640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda540740b0 0x7fda540c55b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00e9e0 tx=0x7fda3c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.025+0000 7fda50ff9640 1 -- 172.21.15.52:0/1741274396 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3c017070 con 0x7fda540740b0 2024-04-25T13:17:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.025+0000 7fda50ff9640 1 -- 172.21.15.52:0/1741274396 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3c00c9d0 con 0x7fda540740b0 2024-04-25T13:17:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.025+0000 7fda5a39b640 1 -- 172.21.15.52:0/1741274396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5415c3a0 con 0x7fda540740b0 2024-04-25T13:17:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.025+0000 7fda50ff9640 1 -- 172.21.15.52:0/1741274396 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3c00cdc0 con 0x7fda540740b0 2024-04-25T13:17:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.025+0000 7fda5a39b640 1 -- 172.21.15.52:0/1741274396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5415c960 con 0x7fda540740b0 2024-04-25T13:17:06.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.026+0000 7fda5a39b640 1 -- 172.21.15.52:0/1741274396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda540cc280 con 0x7fda540740b0 2024-04-25T13:17:06.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.026+0000 7fda50ff9640 1 -- 172.21.15.52:0/1741274396 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda3c01a070 con 0x7fda540740b0 2024-04-25T13:17:06.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.027+0000 7fda50ff9640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fda3406c8f0 0x7fda3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.027+0000 7fda50ff9640 1 -- 172.21.15.52:0/1741274396 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fda3c08c260 con 0x7fda540740b0 2024-04-25T13:17:06.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.027+0000 7fda537fe640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fda3406c8f0 0x7fda3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.027+0000 7fda537fe640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fda3406c8f0 0x7fda3406edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda540ca5c0 tx=0x7fda44007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:06.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.031+0000 7fda50ff9640 1 -- 172.21.15.52:0/1741274396 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fda540cc280 con 0x7fda540740b0 2024-04-25T13:17:06.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.220+0000 7fda5a39b640 1 -- 172.21.15.52:0/1741274396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fda54068e40 con 0x7fda540740b0 2024-04-25T13:17:06.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.221+0000 7fda50ff9640 1 -- 172.21.15.52:0/1741274396 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fda3c059c20 con 0x7fda540740b0 2024-04-25T13:17:06.221 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T13:17:06.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.223+0000 7fda5a39b640 1 -- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fda3406c8f0 msgr2=0x7fda3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.223+0000 7fda5a39b640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fda3406c8f0 0x7fda3406edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda540ca5c0 tx=0x7fda44007d50 comp rx=0 tx=0).stop 2024-04-25T13:17:06.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.223+0000 7fda5a39b640 1 -- 172.21.15.52:0/1741274396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda540740b0 msgr2=0x7fda540c55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.223+0000 7fda5a39b640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda540740b0 0x7fda540c55b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00e9e0 tx=0x7fda3c00eea0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.223+0000 7fda5a39b640 1 -- 172.21.15.52:0/1741274396 shutdown_connections 2024-04-25T13:17:06.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.223+0000 7fda5a39b640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fda3406c8f0 0x7fda3406edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.223+0000 7fda5a39b640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda5415bd00 0x7fda5415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.223+0000 7fda5a39b640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda54155260 0x7fda5415d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.223+0000 7fda5a39b640 1 --2- 172.21.15.52:0/1741274396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda540740b0 0x7fda540c55b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.223+0000 7fda5a39b640 1 -- 172.21.15.52:0/1741274396 >> 172.21.15.52:0/1741274396 conn(0x7fda54073590 msgr2=0x7fda540cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:06.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.223+0000 7fda5a39b640 1 -- 172.21.15.52:0/1741274396 shutdown_connections 2024-04-25T13:17:06.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.223+0000 7fda5a39b640 1 -- 172.21.15.52:0/1741274396 wait complete. 2024-04-25T13:17:06.234 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:17:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.337+0000 7f48059cd640 1 Processor -- start 2024-04-25T13:17:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.337+0000 7f48059cd640 1 -- start start 2024-04-25T13:17:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.338+0000 7f48059cd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f480006cc00 0x7f480015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.338+0000 7f48059cd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f480015f500 con 0x7f48000cbc00 2024-04-25T13:17:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.338+0000 7f48059cd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f480015b190 con 0x7f480006cfe0 2024-04-25T13:17:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.338+0000 7f48059cd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f48000cd140 con 0x7f480006cc00 2024-04-25T13:17:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.338+0000 7f47ff7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f48000cbc00 0x7f48000c5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41184/0 (socket says 172.21.15.52:41184) 2024-04-25T13:17:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.338+0000 7f47ff7fe640 1 -- 172.21.15.52:0/1821359984 learned_addr learned my addr 172.21.15.52:0/1821359984 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483689412 0 0) 0x7f47f0001110 con 0x7f48000cbc00 2024-04-25T13:17:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47feffd640 1 --2- 172.21.15.52:0/1821359984 >> v2:172.21.15.102:3300/0 conn(0x7f480006cc00 0x7f480015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47e8003520 con 0x7f48000cbc00 2024-04-25T13:17:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2866254100 0 0) 0x7f47e8003520 con 0x7f48000cbc00 2024-04-25T13:17:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 >> v2:172.21.15.102:3300/0 conn(0x7f480006cc00 msgr2=0x7f480015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 --2- 172.21.15.52:0/1821359984 >> v2:172.21.15.102:3300/0 conn(0x7f480006cc00 0x7f480015efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 >> v1:172.21.15.102:6789/0 conn(0x7f480006cfe0 legacy=0x7f4800154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480015b470 con 0x7f48000cbc00 2024-04-25T13:17:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f47f0001840 con 0x7f48000cbc00 2024-04-25T13:17:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 >> v1:172.21.15.52:6789/0 conn(0x7f48000cbc00 legacy=0x7f48000c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 --2- 172.21.15.52:0/1821359984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e80039e0 0x7f47e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 --2- 172.21.15.52:0/1821359984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47e8004800 0x7f47e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 --2- 172.21.15.52:0/1821359984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47e80051c0 0x7f47e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f48000cd140 con 0x7f47e80039e0 2024-04-25T13:17:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f47e800c070 con 0x7f47e80051c0 2024-04-25T13:17:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f47e800c270 con 0x7f47e8004800 2024-04-25T13:17:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47feffd640 1 --2- 172.21.15.52:0/1821359984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e80039e0 0x7f47e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47ff7fe640 1 --2- 172.21.15.52:0/1821359984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47e80051c0 0x7f47e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47fe7fc640 1 --2- 172.21.15.52:0/1821359984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47e8004800 0x7f47e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47feffd640 1 -- 172.21.15.52:0/1821359984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47e8004800 msgr2=0x7f47e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47feffd640 1 --2- 172.21.15.52:0/1821359984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47e8004800 0x7f47e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47feffd640 1 -- 172.21.15.52:0/1821359984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47e80051c0 msgr2=0x7f47e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47feffd640 1 --2- 172.21.15.52:0/1821359984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47e80051c0 0x7f47e800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.339+0000 7f47feffd640 1 -- 172.21.15.52:0/1821359984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e8003520 con 0x7f47e80039e0 2024-04-25T13:17:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.340+0000 7f47ff7fe640 1 -- 172.21.15.52:0/1821359984 reap_dead start 2024-04-25T13:17:06.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.340+0000 7f47fe7fc640 1 --2- 172.21.15.52:0/1821359984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47e8004800 0x7f47e8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:06.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.340+0000 7f47feffd640 1 --2- 172.21.15.52:0/1821359984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e80039e0 0x7f47e8003e00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009fc0 tx=0x7f47e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df9785c32b5352c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:06.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.340+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f8009c10 con 0x7f47e80039e0 2024-04-25T13:17:06.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.340+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f8036070 con 0x7f47e80039e0 2024-04-25T13:17:06.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.340+0000 7f47fdffb640 1 -- 172.21.15.52:0/1821359984 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f8031880 con 0x7f47e80039e0 2024-04-25T13:17:06.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.341+0000 7f48059cd640 1 -- 172.21.15.52:0/1821359984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e80039e0 msgr2=0x7f47e8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.341+0000 7f48059cd640 1 --2- 172.21.15.52:0/1821359984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e80039e0 0x7f47e8003e00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009fc0 tx=0x7f47e8005830 comp rx=0 tx=0).stop 2024-04-25T13:17:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.341+0000 7f48059cd640 1 -- 172.21.15.52:0/1821359984 shutdown_connections 2024-04-25T13:17:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.341+0000 7f48059cd640 1 --2- 172.21.15.52:0/1821359984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47e80039e0 0x7f47e8003e00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.341+0000 7f48059cd640 1 -- 172.21.15.52:0/1821359984 >> 172.21.15.52:0/1821359984 conn(0x7f4800075570 msgr2=0x7f4800073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.341+0000 7f48059cd640 1 -- 172.21.15.52:0/1821359984 shutdown_connections 2024-04-25T13:17:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.341+0000 7f48059cd640 1 -- 172.21.15.52:0/1821359984 wait complete. 2024-04-25T13:17:06.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.342+0000 7f48059cd640 1 Processor -- start 2024-04-25T13:17:06.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.342+0000 7f48059cd640 1 -- start start 2024-04-25T13:17:06.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f48059cd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47e80039e0 0x7f48001f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f48059cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48000cea00 0x7f48000c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f48059cd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48000d0600 0x7f480014b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f48059cd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f480015bd10 con 0x7f48000d0600 2024-04-25T13:17:06.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f48059cd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f480015ba30 con 0x7f48000cea00 2024-04-25T13:17:06.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f48059cd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f48000ccbe0 con 0x7f47e80039e0 2024-04-25T13:17:06.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f47ff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48000d0600 0x7f480014b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f47ff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48000d0600 0x7f480014b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57406/0 (socket says 172.21.15.52:57406) 2024-04-25T13:17:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f47ff7fe640 1 -- 172.21.15.52:0/4267924777 learned_addr learned my addr 172.21.15.52:0/4267924777 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f47fe7fc640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48000cea00 0x7f48000c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f47feffd640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47e80039e0 0x7f48001f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f47ff7fe640 1 -- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47e80039e0 msgr2=0x7f48001f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f47ff7fe640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47e80039e0 0x7f48001f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f47ff7fe640 1 -- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48000cea00 msgr2=0x7f48000c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f47ff7fe640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48000cea00 0x7f48000c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.343+0000 7f47ff7fe640 1 -- 172.21.15.52:0/4267924777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48001596c0 con 0x7f48000d0600 2024-04-25T13:17:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.344+0000 7f47ff7fe640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48000d0600 0x7f480014b110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f48000b44a0 tx=0x7f47f0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.344+0000 7f47e7fff640 1 -- 172.21.15.52:0/4267924777 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f001a070 con 0x7f48000d0600 2024-04-25T13:17:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.344+0000 7f47e7fff640 1 -- 172.21.15.52:0/4267924777 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f000f680 con 0x7f48000d0600 2024-04-25T13:17:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.344+0000 7f48059cd640 1 -- 172.21.15.52:0/4267924777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4800159960 con 0x7f48000d0600 2024-04-25T13:17:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.344+0000 7f47e7fff640 1 -- 172.21.15.52:0/4267924777 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f000fa70 con 0x7f48000d0600 2024-04-25T13:17:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.344+0000 7f48059cd640 1 -- 172.21.15.52:0/4267924777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48000cfe00 con 0x7f48000d0600 2024-04-25T13:17:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.345+0000 7f48059cd640 1 -- 172.21.15.52:0/4267924777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4800159e80 con 0x7f48000d0600 2024-04-25T13:17:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.345+0000 7f47e7fff640 1 -- 172.21.15.52:0/4267924777 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f47f001d070 con 0x7f48000d0600 2024-04-25T13:17:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.346+0000 7f47e7fff640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f47ec06c920 0x7f47ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.346+0000 7f47e7fff640 1 -- 172.21.15.52:0/4267924777 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f47f008b2f0 con 0x7f48000d0600 2024-04-25T13:17:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.346+0000 7f47feffd640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f47ec06c920 0x7f47ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.346+0000 7f47feffd640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f47ec06c920 0x7f47ec06ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f47f8035000 tx=0x7f47f802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.350+0000 7f47e7fff640 1 -- 172.21.15.52:0/4267924777 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4800159e80 con 0x7f48000d0600 2024-04-25T13:17:06.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.535+0000 7f48059cd640 1 -- 172.21.15.52:0/4267924777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4800068f50 con 0x7f48000d0600 2024-04-25T13:17:06.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.535+0000 7f47e7fff640 1 -- 172.21.15.52:0/4267924777 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f480015f500 con 0x7f48000d0600 2024-04-25T13:17:06.536 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-25T13:17:06.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.537+0000 7f48059cd640 1 -- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f47ec06c920 msgr2=0x7f47ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.537+0000 7f48059cd640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f47ec06c920 0x7f47ec06ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f47f8035000 tx=0x7f47f802f000 comp rx=0 tx=0).stop 2024-04-25T13:17:06.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.537+0000 7f48059cd640 1 -- 172.21.15.52:0/4267924777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48000d0600 msgr2=0x7f480014b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.537+0000 7f48059cd640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48000d0600 0x7f480014b110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f48000b44a0 tx=0x7f47f0007430 comp rx=0 tx=0).stop 2024-04-25T13:17:06.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.537+0000 7f48059cd640 1 -- 172.21.15.52:0/4267924777 shutdown_connections 2024-04-25T13:17:06.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.537+0000 7f48059cd640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f47ec06c920 0x7f47ec06ede0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.537+0000 7f48059cd640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48000d0600 0x7f480014b110 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.537+0000 7f48059cd640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48000cea00 0x7f48000c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.537+0000 7f48059cd640 1 --2- 172.21.15.52:0/4267924777 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47e80039e0 0x7f48001f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.537+0000 7f48059cd640 1 -- 172.21.15.52:0/4267924777 >> 172.21.15.52:0/4267924777 conn(0x7f4800075570 msgr2=0x7f480015dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:06.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.537+0000 7f48059cd640 1 -- 172.21.15.52:0/4267924777 shutdown_connections 2024-04-25T13:17:06.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.537+0000 7f48059cd640 1 -- 172.21.15.52:0/4267924777 wait complete. 2024-04-25T13:17:06.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:17:06.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.652+0000 7f5d36a49640 1 Processor -- start 2024-04-25T13:17:06.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.652+0000 7f5d36a49640 1 -- start start 2024-04-25T13:17:06.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d36a49640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d3006f970 0x7f5d300c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d36a49640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d300c8d20 0x7f5d300715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d36a49640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d300c6250 con 0x7f5d301517d0 2024-04-25T13:17:06.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d36a49640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5d300c64f0 con 0x7f5d300c8d20 2024-04-25T13:17:06.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d36a49640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5d300c67d0 con 0x7f5d3006f970 2024-04-25T13:17:06.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d2ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5d301517d0 0x7f5d30157e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41198/0 (socket says 172.21.15.52:41198) 2024-04-25T13:17:06.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d2ffff640 1 -- 172.21.15.52:0/338126915 learned_addr learned my addr 172.21.15.52:0/338126915 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:06.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d34fe6640 1 --2- 172.21.15.52:0/338126915 >> v2:172.21.15.52:3300/0 conn(0x7f5d300c8d20 0x7f5d300715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d2f7fe640 1 --2- 172.21.15.52:0/338126915 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d3006f970 0x7f5d300c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d2effd640 1 -- 172.21.15.52:0/338126915 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2367448942 0 0) 0x7f5d300c6250 con 0x7f5d301517d0 2024-04-25T13:17:06.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d2effd640 1 -- 172.21.15.52:0/338126915 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d18003520 con 0x7f5d301517d0 2024-04-25T13:17:06.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d34fe6640 1 -- 172.21.15.52:0/338126915 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d3006f970 msgr2=0x7f5d300c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:06.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d34fe6640 1 --2- 172.21.15.52:0/338126915 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d3006f970 0x7f5d300c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d34fe6640 1 -- 172.21.15.52:0/338126915 >> v1:172.21.15.52:6789/0 conn(0x7f5d301517d0 legacy=0x7f5d30157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d34fe6640 1 -- 172.21.15.52:0/338126915 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d300c6ab0 con 0x7f5d300c8d20 2024-04-25T13:17:06.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.653+0000 7f5d2f7fe640 1 --2- 172.21.15.52:0/338126915 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d3006f970 0x7f5d300c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:06.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.654+0000 7f5d34fe6640 1 --2- 172.21.15.52:0/338126915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d300c8d20 0x7f5d300715d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009d90 tx=0x7f5d2802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8ad42468b3d84f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:06.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.654+0000 7f5d2effd640 1 -- 172.21.15.52:0/338126915 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28007740 con 0x7f5d300c8d20 2024-04-25T13:17:06.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.654+0000 7f5d2effd640 1 -- 172.21.15.52:0/338126915 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d280078e0 con 0x7f5d300c8d20 2024-04-25T13:17:06.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.654+0000 7f5d2effd640 1 -- 172.21.15.52:0/338126915 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28007cb0 con 0x7f5d300c8d20 2024-04-25T13:17:06.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.654+0000 7f5d36a49640 1 -- 172.21.15.52:0/338126915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d300c8d20 msgr2=0x7f5d300715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.654+0000 7f5d36a49640 1 --2- 172.21.15.52:0/338126915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d300c8d20 0x7f5d300715d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009d90 tx=0x7f5d2802a660 comp rx=0 tx=0).stop 2024-04-25T13:17:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.655+0000 7f5d36a49640 1 -- 172.21.15.52:0/338126915 shutdown_connections 2024-04-25T13:17:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.655+0000 7f5d36a49640 1 --2- 172.21.15.52:0/338126915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d300c8d20 0x7f5d300715d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.655+0000 7f5d36a49640 1 --2- 172.21.15.52:0/338126915 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d3006f970 0x7f5d300c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.655+0000 7f5d36a49640 1 -- 172.21.15.52:0/338126915 >> 172.21.15.52:0/338126915 conn(0x7f5d30068360 msgr2=0x7f5d30074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.655+0000 7f5d36a49640 1 -- 172.21.15.52:0/338126915 shutdown_connections 2024-04-25T13:17:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.655+0000 7f5d36a49640 1 -- 172.21.15.52:0/338126915 wait complete. 2024-04-25T13:17:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.656+0000 7f5d36a49640 1 Processor -- start 2024-04-25T13:17:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.656+0000 7f5d36a49640 1 -- start start 2024-04-25T13:17:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.656+0000 7f5d36a49640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3006f970 0x7f5d301401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.656+0000 7f5d36a49640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d300c8d20 0x7f5d30140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d36a49640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d301517d0 0x7f5d30143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d36a49640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30151bb0 con 0x7f5d3006f970 2024-04-25T13:17:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d36a49640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30157920 con 0x7f5d301517d0 2024-04-25T13:17:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d36a49640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5d300c70a0 con 0x7f5d300c8d20 2024-04-25T13:17:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3006f970 0x7f5d301401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3006f970 0x7f5d301401d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57416/0 (socket says 172.21.15.52:57416) 2024-04-25T13:17:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2ffff640 1 -- 172.21.15.52:0/4236798637 learned_addr learned my addr 172.21.15.52:0/4236798637 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d34fe6640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d301517d0 0x7f5d30143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2f7fe640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d300c8d20 0x7f5d30140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2ffff640 1 -- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d300c8d20 msgr2=0x7f5d30140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2ffff640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d300c8d20 0x7f5d30140710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2ffff640 1 -- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d301517d0 msgr2=0x7f5d30143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2ffff640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d301517d0 0x7f5d30143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2ffff640 1 -- 172.21.15.52:0/4236798637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d301565e0 con 0x7f5d3006f970 2024-04-25T13:17:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2ffff640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3006f970 0x7f5d301401d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000c3c0 tx=0x7f5d2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2cff9640 1 -- 172.21.15.52:0/4236798637 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20017070 con 0x7f5d3006f970 2024-04-25T13:17:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2cff9640 1 -- 172.21.15.52:0/4236798637 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d20005ce0 con 0x7f5d3006f970 2024-04-25T13:17:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d36a49640 1 -- 172.21.15.52:0/4236798637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d301568a0 con 0x7f5d3006f970 2024-04-25T13:17:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d2cff9640 1 -- 172.21.15.52:0/4236798637 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d200072f0 con 0x7f5d3006f970 2024-04-25T13:17:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.657+0000 7f5d36a49640 1 -- 172.21.15.52:0/4236798637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d30156e60 con 0x7f5d3006f970 2024-04-25T13:17:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.658+0000 7f5d36a49640 1 -- 172.21.15.52:0/4236798637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d30157060 con 0x7f5d3006f970 2024-04-25T13:17:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.659+0000 7f5d2cff9640 1 -- 172.21.15.52:0/4236798637 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5d2001a070 con 0x7f5d3006f970 2024-04-25T13:17:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.659+0000 7f5d2cff9640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5d1c06c8f0 0x7f5d1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.659+0000 7f5d2cff9640 1 -- 172.21.15.52:0/4236798637 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f5d2008b440 con 0x7f5d3006f970 2024-04-25T13:17:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.659+0000 7f5d2f7fe640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5d1c06c8f0 0x7f5d1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.660+0000 7f5d2f7fe640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5d1c06c8f0 0x7f5d1c06edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009560 tx=0x7f5d24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.664+0000 7f5d2cff9640 1 -- 172.21.15.52:0/4236798637 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5d30157060 con 0x7f5d3006f970 2024-04-25T13:17:06.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.849+0000 7f5d36a49640 1 -- 172.21.15.52:0/4236798637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5d30068e40 con 0x7f5d3006f970 2024-04-25T13:17:06.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.849+0000 7f5d2cff9640 1 -- 172.21.15.52:0/4236798637 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f5d20058c50 con 0x7f5d3006f970 2024-04-25T13:17:06.850 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T13:17:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.851+0000 7f5d36a49640 1 -- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5d1c06c8f0 msgr2=0x7f5d1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.851+0000 7f5d36a49640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5d1c06c8f0 0x7f5d1c06edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009560 tx=0x7f5d24008040 comp rx=0 tx=0).stop 2024-04-25T13:17:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.851+0000 7f5d36a49640 1 -- 172.21.15.52:0/4236798637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3006f970 msgr2=0x7f5d301401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.851+0000 7f5d36a49640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3006f970 0x7f5d301401d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000c3c0 tx=0x7f5d2000c880 comp rx=0 tx=0).stop 2024-04-25T13:17:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.851+0000 7f5d36a49640 1 -- 172.21.15.52:0/4236798637 shutdown_connections 2024-04-25T13:17:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.851+0000 7f5d36a49640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5d1c06c8f0 0x7f5d1c06edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.851+0000 7f5d36a49640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d300c8d20 0x7f5d30140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.851+0000 7f5d36a49640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d301517d0 0x7f5d30143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.851+0000 7f5d36a49640 1 --2- 172.21.15.52:0/4236798637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3006f970 0x7f5d301401d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.851+0000 7f5d36a49640 1 -- 172.21.15.52:0/4236798637 >> 172.21.15.52:0/4236798637 conn(0x7f5d30068360 msgr2=0x7f5d300c52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.851+0000 7f5d36a49640 1 -- 172.21.15.52:0/4236798637 shutdown_connections 2024-04-25T13:17:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.851+0000 7f5d36a49640 1 -- 172.21.15.52:0/4236798637 wait complete. 2024-04-25T13:17:06.863 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:17:06.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.963+0000 7feeaf330640 1 Processor -- start 2024-04-25T13:17:06.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.964+0000 7feeaf330640 1 -- start start 2024-04-25T13:17:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.964+0000 7feeaf330640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feea81553a0 0x7feea80c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.964+0000 7feeaf330640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feea815bb80 0x7feea80c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.964+0000 7feeaf330640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea806c850 con 0x7feea80c8070 2024-04-25T13:17:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.964+0000 7feeaf330640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7feea806cb30 con 0x7feea815bb80 2024-04-25T13:17:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.964+0000 7feeaf330640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feea806ce10 con 0x7feea81553a0 2024-04-25T13:17:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.964+0000 7feeac8cb640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7feea80c8070 0x7feea80ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41212/0 (socket says 172.21.15.52:41212) 2024-04-25T13:17:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.964+0000 7feeac8cb640 1 -- 172.21.15.52:0/553610141 learned_addr learned my addr 172.21.15.52:0/553610141 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.965+0000 7feead0cc640 1 --2- 172.21.15.52:0/553610141 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feea81553a0 0x7feea80c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.965+0000 7feead8cd640 1 --2- 172.21.15.52:0/553610141 >> v2:172.21.15.102:3300/0 conn(0x7feea815bb80 0x7feea80c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.965+0000 7feea7fff640 1 -- 172.21.15.52:0/553610141 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231389 0 0) 0x7feea806c850 con 0x7feea80c8070 2024-04-25T13:17:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.965+0000 7feea7fff640 1 -- 172.21.15.52:0/553610141 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee90003520 con 0x7feea80c8070 2024-04-25T13:17:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.965+0000 7feead8cd640 1 -- 172.21.15.52:0/553610141 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feea81553a0 msgr2=0x7feea80c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.965+0000 7feead8cd640 1 --2- 172.21.15.52:0/553610141 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feea81553a0 0x7feea80c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.965+0000 7feead8cd640 1 -- 172.21.15.52:0/553610141 >> v1:172.21.15.52:6789/0 conn(0x7feea80c8070 legacy=0x7feea80ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.965+0000 7feead8cd640 1 -- 172.21.15.52:0/553610141 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea806d0f0 con 0x7feea815bb80 2024-04-25T13:17:06.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.966+0000 7feead8cd640 1 --2- 172.21.15.52:0/553610141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea815bb80 0x7feea80c8c40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fee98009d90 tx=0x7fee9802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=212edbbb11fcda64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:06.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.966+0000 7feea7fff640 1 -- 172.21.15.52:0/553610141 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee98007740 con 0x7feea815bb80 2024-04-25T13:17:06.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.966+0000 7feea7fff640 1 -- 172.21.15.52:0/553610141 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee980078e0 con 0x7feea815bb80 2024-04-25T13:17:06.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.966+0000 7feea7fff640 1 -- 172.21.15.52:0/553610141 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee98007cb0 con 0x7feea815bb80 2024-04-25T13:17:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.966+0000 7feeaf330640 1 -- 172.21.15.52:0/553610141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea815bb80 msgr2=0x7feea80c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.966+0000 7feeaf330640 1 --2- 172.21.15.52:0/553610141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea815bb80 0x7feea80c8c40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fee98009d90 tx=0x7fee9802a6f0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.966+0000 7feeaf330640 1 -- 172.21.15.52:0/553610141 shutdown_connections 2024-04-25T13:17:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.966+0000 7feeaf330640 1 --2- 172.21.15.52:0/553610141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea815bb80 0x7feea80c8c40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.966+0000 7feeaf330640 1 --2- 172.21.15.52:0/553610141 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feea81553a0 0x7feea80c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.966+0000 7feeaf330640 1 -- 172.21.15.52:0/553610141 >> 172.21.15.52:0/553610141 conn(0x7feea8073010 msgr2=0x7feea8073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.966+0000 7feeaf330640 1 -- 172.21.15.52:0/553610141 shutdown_connections 2024-04-25T13:17:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.966+0000 7feeaf330640 1 -- 172.21.15.52:0/553610141 wait complete. 2024-04-25T13:17:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.968+0000 7feeaf330640 1 Processor -- start 2024-04-25T13:17:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.968+0000 7feeaf330640 1 -- start start 2024-04-25T13:17:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.968+0000 7feeaf330640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feea80c8070 0x7feea80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.968+0000 7feeaf330640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea81553a0 0x7feea8150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.968+0000 7feeaf330640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea815bb80 0x7feea80c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.968+0000 7feeaf330640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feea80cd4d0 con 0x7feea81553a0 2024-04-25T13:17:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.968+0000 7feeaf330640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feea8155780 con 0x7feea815bb80 2024-04-25T13:17:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.968+0000 7feeaf330640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feea80cd650 con 0x7feea80c8070 2024-04-25T13:17:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.968+0000 7feeac8cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea81553a0 0x7feea8150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.968+0000 7feeac8cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea81553a0 0x7feea8150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57422/0 (socket says 172.21.15.52:57422) 2024-04-25T13:17:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.968+0000 7feeac8cb640 1 -- 172.21.15.52:0/2968398506 learned_addr learned my addr 172.21.15.52:0/2968398506 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feead8cd640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea815bb80 0x7feea80c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feead0cc640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feea80c8070 0x7feea80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feeac8cb640 1 -- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feea80c8070 msgr2=0x7feea80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feeac8cb640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feea80c8070 0x7feea80d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feeac8cb640 1 -- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea815bb80 msgr2=0x7feea80c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feeac8cb640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea815bb80 0x7feea80c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feeac8cb640 1 -- 172.21.15.52:0/2968398506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea80d1620 con 0x7feea81553a0 2024-04-25T13:17:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feead8cd640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea815bb80 0x7feea80c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feeac8cb640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea81553a0 0x7feea8150c00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c430 tx=0x7fee9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feea5ffb640 1 -- 172.21.15.52:0/2968398506 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c017070 con 0x7feea81553a0 2024-04-25T13:17:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feea5ffb640 1 -- 172.21.15.52:0/2968398506 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9c005ce0 con 0x7feea81553a0 2024-04-25T13:17:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feeaf330640 1 -- 172.21.15.52:0/2968398506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea80c4630 con 0x7feea81553a0 2024-04-25T13:17:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feea5ffb640 1 -- 172.21.15.52:0/2968398506 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c0072f0 con 0x7feea81553a0 2024-04-25T13:17:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.969+0000 7feeaf330640 1 -- 172.21.15.52:0/2968398506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea80c4bf0 con 0x7feea81553a0 2024-04-25T13:17:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.970+0000 7feeaf330640 1 -- 172.21.15.52:0/2968398506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea80caee0 con 0x7feea81553a0 2024-04-25T13:17:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.971+0000 7feea5ffb640 1 -- 172.21.15.52:0/2968398506 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee9c01a070 con 0x7feea81553a0 2024-04-25T13:17:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.971+0000 7feea5ffb640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fee9406c8f0 0x7fee9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.971+0000 7feea5ffb640 1 -- 172.21.15.52:0/2968398506 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fee9c08b430 con 0x7feea81553a0 2024-04-25T13:17:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.971+0000 7feead0cc640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fee9406c8f0 0x7fee9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.972+0000 7feead0cc640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fee9406c8f0 0x7fee9406edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feea0009ad0 tx=0x7feea0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:06.975+0000 7feea5ffb640 1 -- 172.21.15.52:0/2968398506 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feea80caee0 con 0x7feea81553a0 2024-04-25T13:17:07.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.171+0000 7feeaf330640 1 -- 172.21.15.52:0/2968398506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feea8069310 con 0x7feea81553a0 2024-04-25T13:17:07.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.171+0000 7feea5ffb640 1 -- 172.21.15.52:0/2968398506 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7feea8069310 con 0x7feea81553a0 2024-04-25T13:17:07.172 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-04-25T13:17:07.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.173+0000 7feeaf330640 1 -- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fee9406c8f0 msgr2=0x7fee9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.173+0000 7feeaf330640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fee9406c8f0 0x7fee9406edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feea0009ad0 tx=0x7feea0008040 comp rx=0 tx=0).stop 2024-04-25T13:17:07.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.173+0000 7feeaf330640 1 -- 172.21.15.52:0/2968398506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea81553a0 msgr2=0x7feea8150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.173+0000 7feeaf330640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea81553a0 0x7feea8150c00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c430 tx=0x7fee9c00c8f0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.174+0000 7feeaf330640 1 -- 172.21.15.52:0/2968398506 shutdown_connections 2024-04-25T13:17:07.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.174+0000 7feeaf330640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fee9406c8f0 0x7fee9406edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.174+0000 7feeaf330640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feea815bb80 0x7feea80c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.174+0000 7feeaf330640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea81553a0 0x7feea8150c00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.174+0000 7feeaf330640 1 --2- 172.21.15.52:0/2968398506 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feea80c8070 0x7feea80d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.174+0000 7feeaf330640 1 -- 172.21.15.52:0/2968398506 >> 172.21.15.52:0/2968398506 conn(0x7feea8073010 msgr2=0x7feea80c85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:07.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.174+0000 7feeaf330640 1 -- 172.21.15.52:0/2968398506 shutdown_connections 2024-04-25T13:17:07.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.174+0000 7feeaf330640 1 -- 172.21.15.52:0/2968398506 wait complete. 2024-04-25T13:17:07.185 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T13:17:07.185 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:17:07.201 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.341+0000 7f6ebfa72640 1 Processor -- start 2024-04-25T13:17:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.341+0000 7f6ebfa72640 1 -- start start 2024-04-25T13:17:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebfa72640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6eb806e850 0x7f6eb806f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebfa72640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb806ec30 0x7f6eb8159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebfa72640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb815f6e0 con 0x7f6eb80c4310 2024-04-25T13:17:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebfa72640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6eb80c48b0 con 0x7f6eb806e850 2024-04-25T13:17:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebfa72640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb815f9a0 con 0x7f6eb806ec30 2024-04-25T13:17:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebd80e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6eb806e850 0x7f6eb806f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebe00f640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6eb80c4310 0x7f6eb80c4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41216/0 (socket says 172.21.15.52:41216) 2024-04-25T13:17:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebe00f640 1 -- 172.21.15.52:0/42684380 learned_addr learned my addr 172.21.15.52:0/42684380 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebd00d640 1 --2- 172.21.15.52:0/42684380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb806ec30 0x7f6eb8159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebd80e640 1 -- 172.21.15.52:0/42684380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb806ec30 msgr2=0x7f6eb8159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebd80e640 1 --2- 172.21.15.52:0/42684380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb806ec30 0x7f6eb8159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebd80e640 1 -- 172.21.15.52:0/42684380 >> v1:172.21.15.52:6789/0 conn(0x7f6eb80c4310 legacy=0x7f6eb80c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebd80e640 1 -- 172.21.15.52:0/42684380 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb815fc80 con 0x7f6eb806e850 2024-04-25T13:17:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.342+0000 7f6ebc80c640 1 -- 172.21.15.52:0/42684380 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662647194 0 0) 0x7f6eb815f6e0 con 0x7f6eb80c4310 2024-04-25T13:17:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.343+0000 7f6ebd80e640 1 --2- 172.21.15.52:0/42684380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6eb806e850 0x7f6eb806f4a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40097a0 tx=0x7f6eb402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718f835bc3b5c953 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.343+0000 7f6ebc80c640 1 -- 172.21.15.52:0/42684380 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4037070 con 0x7f6eb806e850 2024-04-25T13:17:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.343+0000 7f6ebc80c640 1 -- 172.21.15.52:0/42684380 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb4032440 con 0x7f6eb806e850 2024-04-25T13:17:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.343+0000 7f6ebc80c640 1 -- 172.21.15.52:0/42684380 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4032810 con 0x7f6eb806e850 2024-04-25T13:17:07.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.344+0000 7f6ebfa72640 1 -- 172.21.15.52:0/42684380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6eb806e850 msgr2=0x7f6eb806f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.344+0000 7f6ebfa72640 1 --2- 172.21.15.52:0/42684380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6eb806e850 0x7f6eb806f4a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40097a0 tx=0x7f6eb402a210 comp rx=0 tx=0).stop 2024-04-25T13:17:07.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.344+0000 7f6ebfa72640 1 -- 172.21.15.52:0/42684380 shutdown_connections 2024-04-25T13:17:07.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.344+0000 7f6ebfa72640 1 --2- 172.21.15.52:0/42684380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb806ec30 0x7f6eb8159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.344+0000 7f6ebfa72640 1 --2- 172.21.15.52:0/42684380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6eb806e850 0x7f6eb806f4a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.344+0000 7f6ebfa72640 1 -- 172.21.15.52:0/42684380 >> 172.21.15.52:0/42684380 conn(0x7f6eb80c8f00 msgr2=0x7f6eb80c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.344+0000 7f6ebfa72640 1 -- 172.21.15.52:0/42684380 shutdown_connections 2024-04-25T13:17:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.344+0000 7f6ebfa72640 1 -- 172.21.15.52:0/42684380 wait complete. 2024-04-25T13:17:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.345+0000 7f6ebfa72640 1 Processor -- start 2024-04-25T13:17:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.345+0000 7f6ebfa72640 1 -- start start 2024-04-25T13:17:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebfa72640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb806e850 0x7f6eb81529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebfa72640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb806ec30 0x7f6eb81e6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebfa72640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6eb80c4310 0x7f6eb81e54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebfa72640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb815f3d0 con 0x7f6eb80c4310 2024-04-25T13:17:07.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebfa72640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb8160240 con 0x7f6eb806ec30 2024-04-25T13:17:07.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebfa72640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb806f9e0 con 0x7f6eb806e850 2024-04-25T13:17:07.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebe00f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6eb80c4310 0x7f6eb81e54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebe00f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6eb80c4310 0x7f6eb81e54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57436/0 (socket says 172.21.15.52:57436) 2024-04-25T13:17:07.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebe00f640 1 -- 172.21.15.52:0/2414030881 learned_addr learned my addr 172.21.15.52:0/2414030881 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:07.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebd80e640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb806e850 0x7f6eb81529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebd00d640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb806ec30 0x7f6eb81e6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebe00f640 1 -- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb806e850 msgr2=0x7f6eb81529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebe00f640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb806e850 0x7f6eb81529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebe00f640 1 -- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb806ec30 msgr2=0x7f6eb81e6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebe00f640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb806ec30 0x7f6eb81e6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebe00f640 1 -- 172.21.15.52:0/2414030881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb815ca40 con 0x7f6eb80c4310 2024-04-25T13:17:07.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebe00f640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6eb80c4310 0x7f6eb81e54b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000c700 tx=0x7f6eb000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:07.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6eae7fc640 1 -- 172.21.15.52:0/2414030881 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0018070 con 0x7f6eb80c4310 2024-04-25T13:17:07.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6eae7fc640 1 -- 172.21.15.52:0/2414030881 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb000ce10 con 0x7f6eb80c4310 2024-04-25T13:17:07.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6eae7fc640 1 -- 172.21.15.52:0/2414030881 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb000a880 con 0x7f6eb80c4310 2024-04-25T13:17:07.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.346+0000 7f6ebfa72640 1 -- 172.21.15.52:0/2414030881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb8152f10 con 0x7f6eb80c4310 2024-04-25T13:17:07.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.347+0000 7f6ebfa72640 1 -- 172.21.15.52:0/2414030881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb815c480 con 0x7f6eb80c4310 2024-04-25T13:17:07.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.348+0000 7f6ebfa72640 1 -- 172.21.15.52:0/2414030881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb8068e40 con 0x7f6eb80c4310 2024-04-25T13:17:07.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.348+0000 7f6eae7fc640 1 -- 172.21.15.52:0/2414030881 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6eb001b070 con 0x7f6eb80c4310 2024-04-25T13:17:07.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.349+0000 7f6eae7fc640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6e9c06c8f0 0x7f6e9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.349+0000 7f6eae7fc640 1 -- 172.21.15.52:0/2414030881 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f6eb008b3a0 con 0x7f6eb80c4310 2024-04-25T13:17:07.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.349+0000 7f6ebd80e640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6e9c06c8f0 0x7f6e9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.349+0000 7f6ebd80e640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6e9c06c8f0 0x7f6e9c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4034000 tx=0x7f6eb402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:07.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.353+0000 7f6eae7fc640 1 -- 172.21.15.52:0/2414030881 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6eb0058d60 con 0x7f6eb80c4310 2024-04-25T13:17:07.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.540+0000 7f6ebfa72640 1 -- 172.21.15.52:0/2414030881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6eb815d880 con 0x7f6eb80c4310 2024-04-25T13:17:07.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.541+0000 7f6eae7fc640 1 -- 172.21.15.52:0/2414030881 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18927 (secure 0 0 0) 0x7f6eb005d060 con 0x7f6eb80c4310 2024-04-25T13:17:07.542 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:17:07.542 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:49.125761+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:07.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.543+0000 7f6ebfa72640 1 -- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6e9c06c8f0 msgr2=0x7f6e9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.543+0000 7f6ebfa72640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6e9c06c8f0 0x7f6e9c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4034000 tx=0x7f6eb402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:07.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.543+0000 7f6ebfa72640 1 -- 172.21.15.52:0/2414030881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6eb80c4310 msgr2=0x7f6eb81e54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.543+0000 7f6ebfa72640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6eb80c4310 0x7f6eb81e54b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000c700 tx=0x7f6eb000cbc0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.543+0000 7f6ebfa72640 1 -- 172.21.15.52:0/2414030881 shutdown_connections 2024-04-25T13:17:07.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.543+0000 7f6ebfa72640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6e9c06c8f0 0x7f6e9c06edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.543+0000 7f6ebfa72640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6eb80c4310 0x7f6eb81e54b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.543+0000 7f6ebfa72640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb806ec30 0x7f6eb81e6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.543+0000 7f6ebfa72640 1 --2- 172.21.15.52:0/2414030881 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb806e850 0x7f6eb81529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.543+0000 7f6ebfa72640 1 -- 172.21.15.52:0/2414030881 >> 172.21.15.52:0/2414030881 conn(0x7f6eb80c8f00 msgr2=0x7f6eb80c3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:07.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.543+0000 7f6ebfa72640 1 -- 172.21.15.52:0/2414030881 shutdown_connections 2024-04-25T13:17:07.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.544+0000 7f6ebfa72640 1 -- 172.21.15.52:0/2414030881 wait complete. 2024-04-25T13:17:07.555 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:15:55.833544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:05.935596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:06.297991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:10.015464+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:17:07.555 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:17:07.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.659+0000 7f75f908a640 1 Processor -- start 2024-04-25T13:17:07.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.659+0000 7f75f908a640 1 -- start start 2024-04-25T13:17:07.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f908a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f75f406cc00 0x7f75f415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f908a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75f406cfe0 0x7f75f4154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f908a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f415f500 con 0x7f75f40cbc00 2024-04-25T13:17:07.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f908a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f75f40cd140 con 0x7f75f406cfe0 2024-04-25T13:17:07.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f908a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f75f415b190 con 0x7f75f406cc00 2024-04-25T13:17:07.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75f406cfe0 0x7f75f4154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f359e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f75f40cbc00 0x7f75f40c5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41222/0 (socket says 172.21.15.52:41222) 2024-04-25T13:17:07.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f359e640 1 -- 172.21.15.52:0/27974281 learned_addr learned my addr 172.21.15.52:0/27974281 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:07.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f2d9d640 1 --2- 172.21.15.52:0/27974281 >> v2:172.21.15.102:3300/0 conn(0x7f75f406cc00 0x7f75f415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f259c640 1 -- 172.21.15.52:0/27974281 >> v2:172.21.15.102:3300/0 conn(0x7f75f406cc00 msgr2=0x7f75f415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:07.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f259c640 1 --2- 172.21.15.52:0/27974281 >> v2:172.21.15.102:3300/0 conn(0x7f75f406cc00 0x7f75f415efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f259c640 1 -- 172.21.15.52:0/27974281 >> v1:172.21.15.52:6789/0 conn(0x7f75f40cbc00 legacy=0x7f75f40c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f259c640 1 -- 172.21.15.52:0/27974281 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f415b470 con 0x7f75f406cfe0 2024-04-25T13:17:07.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.660+0000 7f75f1d9b640 1 -- 172.21.15.52:0/27974281 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284975742 0 0) 0x7f75e4001490 con 0x7f75f40cbc00 2024-04-25T13:17:07.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.661+0000 7f75f259c640 1 --2- 172.21.15.52:0/27974281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75f406cfe0 0x7f75f4154f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f75e80097d0 tx=0x7f75e802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee8a4003b30464 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:07.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.661+0000 7f75f1d9b640 1 -- 172.21.15.52:0/27974281 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e8037070 con 0x7f75f406cfe0 2024-04-25T13:17:07.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.661+0000 7f75f1d9b640 1 -- 172.21.15.52:0/27974281 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e8032440 con 0x7f75f406cfe0 2024-04-25T13:17:07.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.661+0000 7f75f1d9b640 1 -- 172.21.15.52:0/27974281 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e8032810 con 0x7f75f406cfe0 2024-04-25T13:17:07.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.662+0000 7f75f908a640 1 -- 172.21.15.52:0/27974281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75f406cfe0 msgr2=0x7f75f4154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.662+0000 7f75f908a640 1 --2- 172.21.15.52:0/27974281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75f406cfe0 0x7f75f4154f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f75e80097d0 tx=0x7f75e802a290 comp rx=0 tx=0).stop 2024-04-25T13:17:07.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.662+0000 7f75f908a640 1 -- 172.21.15.52:0/27974281 shutdown_connections 2024-04-25T13:17:07.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.662+0000 7f75f908a640 1 --2- 172.21.15.52:0/27974281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75f406cfe0 0x7f75f4154f20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.662+0000 7f75f908a640 1 --2- 172.21.15.52:0/27974281 >> v2:172.21.15.102:3300/0 conn(0x7f75f406cc00 0x7f75f415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.662+0000 7f75f908a640 1 -- 172.21.15.52:0/27974281 >> 172.21.15.52:0/27974281 conn(0x7f75f4075570 msgr2=0x7f75f4073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:07.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.662+0000 7f75f908a640 1 -- 172.21.15.52:0/27974281 shutdown_connections 2024-04-25T13:17:07.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.662+0000 7f75f908a640 1 -- 172.21.15.52:0/27974281 wait complete. 2024-04-25T13:17:07.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.663+0000 7f75f908a640 1 Processor -- start 2024-04-25T13:17:07.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.663+0000 7f75f908a640 1 -- start start 2024-04-25T13:17:07.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f908a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75f406cc00 0x7f75f41f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f908a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75f406cfe0 0x7f75f41e7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f908a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75f40cbc00 0x7f75f415ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f908a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75f415bd10 con 0x7f75f406cc00 2024-04-25T13:17:07.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f908a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f75f415ba30 con 0x7f75f40cbc00 2024-04-25T13:17:07.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f908a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f75f40c6010 con 0x7f75f406cfe0 2024-04-25T13:17:07.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75f406cc00 0x7f75f41f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75f406cc00 0x7f75f41f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57454/0 (socket says 172.21.15.52:57454) 2024-04-25T13:17:07.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f2d9d640 1 -- 172.21.15.52:0/3180396758 learned_addr learned my addr 172.21.15.52:0/3180396758 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:07.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f359e640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75f40cbc00 0x7f75f415ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f259c640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75f406cfe0 0x7f75f41e7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f2d9d640 1 -- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75f406cfe0 msgr2=0x7f75f41e7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f2d9d640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75f406cfe0 0x7f75f41e7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f2d9d640 1 -- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75f40cbc00 msgr2=0x7f75f415ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f2d9d640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75f40cbc00 0x7f75f415ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f2d9d640 1 -- 172.21.15.52:0/3180396758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f41f0da0 con 0x7f75f406cc00 2024-04-25T13:17:07.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75f2d9d640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75f406cc00 0x7f75f41f4c10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00e9e0 tx=0x7f75ec00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:07.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.664+0000 7f75db7fe640 1 -- 172.21.15.52:0/3180396758 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec017070 con 0x7f75f406cc00 2024-04-25T13:17:07.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.665+0000 7f75db7fe640 1 -- 172.21.15.52:0/3180396758 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ec00c9d0 con 0x7f75f406cc00 2024-04-25T13:17:07.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.665+0000 7f75f908a640 1 -- 172.21.15.52:0/3180396758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f41f1040 con 0x7f75f406cc00 2024-04-25T13:17:07.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.665+0000 7f75db7fe640 1 -- 172.21.15.52:0/3180396758 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec00cdc0 con 0x7f75f406cc00 2024-04-25T13:17:07.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.665+0000 7f75f908a640 1 -- 172.21.15.52:0/3180396758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f41f1600 con 0x7f75f406cc00 2024-04-25T13:17:07.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.665+0000 7f75f908a640 1 -- 172.21.15.52:0/3180396758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f4068f50 con 0x7f75f406cc00 2024-04-25T13:17:07.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.666+0000 7f75db7fe640 1 -- 172.21.15.52:0/3180396758 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f75ec01a070 con 0x7f75f406cc00 2024-04-25T13:17:07.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.666+0000 7f75db7fe640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f75e006c920 0x7f75e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.666+0000 7f75db7fe640 1 -- 172.21.15.52:0/3180396758 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f75ec08bf30 con 0x7f75f406cc00 2024-04-25T13:17:07.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.667+0000 7f75f259c640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f75e006c920 0x7f75e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.667+0000 7f75f259c640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f75e006c920 0x7f75e006ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f75e8034000 tx=0x7f75e802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:07.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.671+0000 7f75db7fe640 1 -- 172.21.15.52:0/3180396758 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f75ec059860 con 0x7f75f406cc00 2024-04-25T13:17:07.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.853+0000 7f75f908a640 1 -- 172.21.15.52:0/3180396758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f75f40cc2b0 con 0x7f75f406cc00 2024-04-25T13:17:07.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.854+0000 7f75db7fe640 1 -- 172.21.15.52:0/3180396758 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f75ec05db60 con 0x7f75f406cc00 2024-04-25T13:17:07.855 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T13:17:07.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.855+0000 7f75f908a640 1 -- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f75e006c920 msgr2=0x7f75e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.855+0000 7f75f908a640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f75e006c920 0x7f75e006ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f75e8034000 tx=0x7f75e802e000 comp rx=0 tx=0).stop 2024-04-25T13:17:07.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.855+0000 7f75f908a640 1 -- 172.21.15.52:0/3180396758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75f406cc00 msgr2=0x7f75f41f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.855+0000 7f75f908a640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75f406cc00 0x7f75f41f4c10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00e9e0 tx=0x7f75ec00eea0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.856+0000 7f75f908a640 1 -- 172.21.15.52:0/3180396758 shutdown_connections 2024-04-25T13:17:07.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.856+0000 7f75f908a640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f75e006c920 0x7f75e006ede0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.856+0000 7f75f908a640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75f406cfe0 0x7f75f41e7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.856+0000 7f75f908a640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75f40cbc00 0x7f75f415ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.856+0000 7f75f908a640 1 --2- 172.21.15.52:0/3180396758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75f406cc00 0x7f75f41f4c10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.856+0000 7f75f908a640 1 -- 172.21.15.52:0/3180396758 >> 172.21.15.52:0/3180396758 conn(0x7f75f4075570 msgr2=0x7f75f40cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:07.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.856+0000 7f75f908a640 1 -- 172.21.15.52:0/3180396758 shutdown_connections 2024-04-25T13:17:07.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.856+0000 7f75f908a640 1 -- 172.21.15.52:0/3180396758 wait complete. 2024-04-25T13:17:07.867 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:17:07.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.971+0000 7f71cf79b640 1 Processor -- start 2024-04-25T13:17:07.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.971+0000 7f71cf79b640 1 -- start start 2024-04-25T13:17:07.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71cf79b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71c81531b0 0x7f71c80c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71cf79b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f71c80c58c0 0x7f71c80caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71cf79b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71c80ca310 con 0x7f71c80740b0 2024-04-25T13:17:07.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71cf79b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f71c80c7f20 con 0x7f71c80c58c0 2024-04-25T13:17:07.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71cf79b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f71c80ca5f0 con 0x7f71c81531b0 2024-04-25T13:17:07.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71cdd38640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f71c80740b0 0x7f71c80c5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41226/0 (socket says 172.21.15.52:41226) 2024-04-25T13:17:07.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71cdd38640 1 -- 172.21.15.52:0/3344151666 learned_addr learned my addr 172.21.15.52:0/3344151666 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:07.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71ccd36640 1 --2- 172.21.15.52:0/3344151666 >> v2:172.21.15.102:3300/0 conn(0x7f71c80c58c0 0x7f71c80caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71cd537640 1 --2- 172.21.15.52:0/3344151666 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71c81531b0 0x7f71c80c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71bffff640 1 -- 172.21.15.52:0/3344151666 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737083853 0 0) 0x7f71c80ca310 con 0x7f71c80740b0 2024-04-25T13:17:07.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71bffff640 1 -- 172.21.15.52:0/3344151666 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71b4003520 con 0x7f71c80740b0 2024-04-25T13:17:07.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71ccd36640 1 -- 172.21.15.52:0/3344151666 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71c81531b0 msgr2=0x7f71c80c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:07.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71ccd36640 1 --2- 172.21.15.52:0/3344151666 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71c81531b0 0x7f71c80c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71ccd36640 1 -- 172.21.15.52:0/3344151666 >> v1:172.21.15.52:6789/0 conn(0x7f71c80740b0 legacy=0x7f71c80c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.972+0000 7f71ccd36640 1 -- 172.21.15.52:0/3344151666 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c80ca8d0 con 0x7f71c80c58c0 2024-04-25T13:17:07.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.973+0000 7f71ccd36640 1 --2- 172.21.15.52:0/3344151666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71c80c58c0 0x7f71c80caca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f71b80097a0 tx=0x7f71b802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49677200a73e8789 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:07.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.973+0000 7f71bffff640 1 -- 172.21.15.52:0/3344151666 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8037070 con 0x7f71c80c58c0 2024-04-25T13:17:07.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.973+0000 7f71bffff640 1 -- 172.21.15.52:0/3344151666 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b8032440 con 0x7f71c80c58c0 2024-04-25T13:17:07.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.973+0000 7f71bffff640 1 -- 172.21.15.52:0/3344151666 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8032810 con 0x7f71c80c58c0 2024-04-25T13:17:07.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.974+0000 7f71cf79b640 1 -- 172.21.15.52:0/3344151666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71c80c58c0 msgr2=0x7f71c80caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.974+0000 7f71cf79b640 1 --2- 172.21.15.52:0/3344151666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71c80c58c0 0x7f71c80caca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f71b80097a0 tx=0x7f71b802a210 comp rx=0 tx=0).stop 2024-04-25T13:17:07.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.974+0000 7f71cf79b640 1 -- 172.21.15.52:0/3344151666 shutdown_connections 2024-04-25T13:17:07.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.974+0000 7f71cf79b640 1 --2- 172.21.15.52:0/3344151666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71c80c58c0 0x7f71c80caca0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.974+0000 7f71cf79b640 1 --2- 172.21.15.52:0/3344151666 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71c81531b0 0x7f71c80c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.974+0000 7f71cf79b640 1 -- 172.21.15.52:0/3344151666 >> 172.21.15.52:0/3344151666 conn(0x7f71c8073590 msgr2=0x7f71c80739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:07.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.974+0000 7f71cf79b640 1 -- 172.21.15.52:0/3344151666 shutdown_connections 2024-04-25T13:17:07.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.974+0000 7f71cf79b640 1 -- 172.21.15.52:0/3344151666 wait complete. 2024-04-25T13:17:07.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.975+0000 7f71cf79b640 1 Processor -- start 2024-04-25T13:17:07.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.975+0000 7f71cf79b640 1 -- start start 2024-04-25T13:17:07.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cf79b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c80740b0 0x7f71c81f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cf79b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71c80c58c0 0x7f71c81ee750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cf79b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71c81531b0 0x7f71c8146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cf79b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f71c8153590 con 0x7f71c80740b0 2024-04-25T13:17:07.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cf79b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f71c80c8430 con 0x7f71c80c58c0 2024-04-25T13:17:07.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cf79b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f71c80c64d0 con 0x7f71c81531b0 2024-04-25T13:17:07.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cd537640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c80740b0 0x7f71c81f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cd537640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c80740b0 0x7f71c81f27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57460/0 (socket says 172.21.15.52:57460) 2024-04-25T13:17:07.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cd537640 1 -- 172.21.15.52:0/3256849558 learned_addr learned my addr 172.21.15.52:0/3256849558 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:07.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cd537640 1 -- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71c81531b0 msgr2=0x7f71c8146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cd537640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71c81531b0 0x7f71c8146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cd537640 1 -- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71c80c58c0 msgr2=0x7f71c81ee750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:07.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71ccd36640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71c80c58c0 0x7f71c81ee750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cd537640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71c80c58c0 0x7f71c81ee750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:07.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cd537640 1 -- 172.21.15.52:0/3256849558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c8145ce0 con 0x7f71c80740b0 2024-04-25T13:17:07.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.976+0000 7f71cd537640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c80740b0 0x7f71c81f27a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f71c400e870 tx=0x7f71c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:07.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.977+0000 7f71bdffb640 1 -- 172.21.15.52:0/3256849558 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c4017070 con 0x7f71c80740b0 2024-04-25T13:17:07.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.977+0000 7f71bdffb640 1 -- 172.21.15.52:0/3256849558 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c400c940 con 0x7f71c80740b0 2024-04-25T13:17:07.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.977+0000 7f71bdffb640 1 -- 172.21.15.52:0/3256849558 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c400cd30 con 0x7f71c80740b0 2024-04-25T13:17:07.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.977+0000 7f71cf79b640 1 -- 172.21.15.52:0/3256849558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c8145f50 con 0x7f71c80740b0 2024-04-25T13:17:07.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.977+0000 7f71cf79b640 1 -- 172.21.15.52:0/3256849558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c81f1cc0 con 0x7f71c80740b0 2024-04-25T13:17:07.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.978+0000 7f71cf79b640 1 -- 172.21.15.52:0/3256849558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c8068e40 con 0x7f71c80740b0 2024-04-25T13:17:07.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.978+0000 7f71bdffb640 1 -- 172.21.15.52:0/3256849558 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71c401a070 con 0x7f71c80740b0 2024-04-25T13:17:07.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.979+0000 7f71bdffb640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f71ac06c8f0 0x7f71ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:07.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.979+0000 7f71bdffb640 1 -- 172.21.15.52:0/3256849558 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f71c408bed0 con 0x7f71c80740b0 2024-04-25T13:17:07.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.979+0000 7f71ccd36640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f71ac06c8f0 0x7f71ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:07.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.980+0000 7f71ccd36640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f71ac06c8f0 0x7f71ac06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71b8034000 tx=0x7f71b802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:07.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:07.983+0000 7f71bdffb640 1 -- 172.21.15.52:0/3256849558 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71c4059e50 con 0x7f71c80740b0 2024-04-25T13:17:08.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.170+0000 7f71cf79b640 1 -- 172.21.15.52:0/3256849558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f71c8146540 con 0x7f71c80740b0 2024-04-25T13:17:08.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.171+0000 7f71bdffb640 1 -- 172.21.15.52:0/3256849558 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f71c4059750 con 0x7f71c80740b0 2024-04-25T13:17:08.171 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T13:17:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.173+0000 7f71cf79b640 1 -- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f71ac06c8f0 msgr2=0x7f71ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.173+0000 7f71cf79b640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f71ac06c8f0 0x7f71ac06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71b8034000 tx=0x7f71b802e000 comp rx=0 tx=0).stop 2024-04-25T13:17:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.173+0000 7f71cf79b640 1 -- 172.21.15.52:0/3256849558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c80740b0 msgr2=0x7f71c81f27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.173+0000 7f71cf79b640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c80740b0 0x7f71c81f27a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f71c400e870 tx=0x7f71c400ed30 comp rx=0 tx=0).stop 2024-04-25T13:17:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.173+0000 7f71cf79b640 1 -- 172.21.15.52:0/3256849558 shutdown_connections 2024-04-25T13:17:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.173+0000 7f71cf79b640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f71ac06c8f0 0x7f71ac06edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.173+0000 7f71cf79b640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71c81531b0 0x7f71c8146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.173+0000 7f71cf79b640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71c80c58c0 0x7f71c81ee750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.173+0000 7f71cf79b640 1 --2- 172.21.15.52:0/3256849558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c80740b0 0x7f71c81f27a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.173+0000 7f71cf79b640 1 -- 172.21.15.52:0/3256849558 >> 172.21.15.52:0/3256849558 conn(0x7f71c8073590 msgr2=0x7f71c81518f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.173+0000 7f71cf79b640 1 -- 172.21.15.52:0/3256849558 shutdown_connections 2024-04-25T13:17:08.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.173+0000 7f71cf79b640 1 -- 172.21.15.52:0/3256849558 wait complete. 2024-04-25T13:17:08.184 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:17:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.288+0000 7f9b65210640 1 Processor -- start 2024-04-25T13:17:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.288+0000 7f9b65210640 1 -- start start 2024-04-25T13:17:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b65210640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9b600c8340 0x7f9b600723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b65210640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9b60158b10 0x7f9b6015b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b65210640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b600c8720 0x7f9b60151b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b65210640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9b60158680 con 0x7f9b600c8720 2024-04-25T13:17:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b65210640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9b60157d70 con 0x7f9b60158b10 2024-04-25T13:17:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b65210640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9b6015be10 con 0x7f9b600c8340 2024-04-25T13:17:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b5f59e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b600c8720 0x7f9b60151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b5f59e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b600c8720 0x7f9b60151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57462/0 (socket says 172.21.15.52:57462) 2024-04-25T13:17:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b5f59e640 1 -- 172.21.15.52:0/3608243662 learned_addr learned my addr 172.21.15.52:0/3608243662 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b5e59c640 1 --2- 172.21.15.52:0/3608243662 >> v2:172.21.15.102:3300/0 conn(0x7f9b60158b10 0x7f9b6015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b5ed9d640 1 --2- 172.21.15.52:0/3608243662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9b600c8340 0x7f9b600723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b5f59e640 1 -- 172.21.15.52:0/3608243662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9b600c8340 msgr2=0x7f9b600723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b5f59e640 1 --2- 172.21.15.52:0/3608243662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9b600c8340 0x7f9b600723b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b5f59e640 1 -- 172.21.15.52:0/3608243662 >> v2:172.21.15.102:3300/0 conn(0x7f9b60158b10 msgr2=0x7f9b6015b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b5f59e640 1 --2- 172.21.15.52:0/3608243662 >> v2:172.21.15.102:3300/0 conn(0x7f9b60158b10 0x7f9b6015b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b5f59e640 1 -- 172.21.15.52:0/3608243662 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6015c0f0 con 0x7f9b600c8720 2024-04-25T13:17:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b5e59c640 1 --2- 172.21.15.52:0/3608243662 >> v2:172.21.15.102:3300/0 conn(0x7f9b60158b10 0x7f9b6015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.289+0000 7f9b5ed9d640 1 --2- 172.21.15.52:0/3608243662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9b600c8340 0x7f9b600723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.290+0000 7f9b5f59e640 1 --2- 172.21.15.52:0/3608243662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b600c8720 0x7f9b60151b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b600cd5d0 tx=0x7f9b5002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8813b9a46db52e2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.290+0000 7f9b5dd9b640 1 -- 172.21.15.52:0/3608243662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50036070 con 0x7f9b600c8720 2024-04-25T13:17:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.290+0000 7f9b5dd9b640 1 -- 172.21.15.52:0/3608243662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b50031600 con 0x7f9b600c8720 2024-04-25T13:17:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.290+0000 7f9b5dd9b640 1 -- 172.21.15.52:0/3608243662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b500319d0 con 0x7f9b600c8720 2024-04-25T13:17:08.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.290+0000 7f9b65210640 1 -- 172.21.15.52:0/3608243662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b600c8720 msgr2=0x7f9b60151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.290+0000 7f9b65210640 1 --2- 172.21.15.52:0/3608243662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b600c8720 0x7f9b60151b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b600cd5d0 tx=0x7f9b5002a6a0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.290+0000 7f9b65210640 1 -- 172.21.15.52:0/3608243662 shutdown_connections 2024-04-25T13:17:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.290+0000 7f9b65210640 1 --2- 172.21.15.52:0/3608243662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b600c8720 0x7f9b60151b10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.290+0000 7f9b65210640 1 --2- 172.21.15.52:0/3608243662 >> v2:172.21.15.102:3300/0 conn(0x7f9b60158b10 0x7f9b6015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.290+0000 7f9b65210640 1 --2- 172.21.15.52:0/3608243662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9b600c8340 0x7f9b600723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.290+0000 7f9b65210640 1 -- 172.21.15.52:0/3608243662 >> 172.21.15.52:0/3608243662 conn(0x7f9b6006d660 msgr2=0x7f9b60074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.291+0000 7f9b65210640 1 -- 172.21.15.52:0/3608243662 shutdown_connections 2024-04-25T13:17:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.291+0000 7f9b65210640 1 -- 172.21.15.52:0/3608243662 wait complete. 2024-04-25T13:17:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.292+0000 7f9b65210640 1 Processor -- start 2024-04-25T13:17:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.292+0000 7f9b65210640 1 -- start start 2024-04-25T13:17:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b65210640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b600c8340 0x7f9b601f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b65210640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9b600c8720 0x7f9b60157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b65210640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60158b10 0x7f9b60147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b65210640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9b600728f0 con 0x7f9b60158b10 2024-04-25T13:17:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b65210640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9b60158310 con 0x7f9b600c8340 2024-04-25T13:17:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b65210640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9b6015b8a0 con 0x7f9b600c8720 2024-04-25T13:17:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b5f59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60158b10 0x7f9b60147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b5f59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60158b10 0x7f9b60147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57470/0 (socket says 172.21.15.52:57470) 2024-04-25T13:17:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b5f59e640 1 -- 172.21.15.52:0/3734160516 learned_addr learned my addr 172.21.15.52:0/3734160516 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b5e59c640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9b600c8720 0x7f9b60157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b5ed9d640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b600c8340 0x7f9b601f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b5f59e640 1 -- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9b600c8720 msgr2=0x7f9b60157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b5f59e640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9b600c8720 0x7f9b60157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b5f59e640 1 -- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b600c8340 msgr2=0x7f9b601f06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b5f59e640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b600c8340 0x7f9b601f06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b5f59e640 1 -- 172.21.15.52:0/3734160516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b601f1640 con 0x7f9b60158b10 2024-04-25T13:17:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b5f59e640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60158b10 0x7f9b60147eb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009f40 tx=0x7f9b50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.293+0000 7f9b477fe640 1 -- 172.21.15.52:0/3734160516 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50036050 con 0x7f9b60158b10 2024-04-25T13:17:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.294+0000 7f9b477fe640 1 -- 172.21.15.52:0/3734160516 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b50042070 con 0x7f9b60158b10 2024-04-25T13:17:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.294+0000 7f9b65210640 1 -- 172.21.15.52:0/3734160516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b601f0da0 con 0x7f9b60158b10 2024-04-25T13:17:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.294+0000 7f9b477fe640 1 -- 172.21.15.52:0/3734160516 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50009510 con 0x7f9b60158b10 2024-04-25T13:17:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.294+0000 7f9b65210640 1 -- 172.21.15.52:0/3734160516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b601f1360 con 0x7f9b60158b10 2024-04-25T13:17:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.295+0000 7f9b65210640 1 -- 172.21.15.52:0/3734160516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b60068f50 con 0x7f9b60158b10 2024-04-25T13:17:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.295+0000 7f9b477fe640 1 -- 172.21.15.52:0/3734160516 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b50007bd0 con 0x7f9b60158b10 2024-04-25T13:17:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.295+0000 7f9b477fe640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9b4c06c8f0 0x7f9b4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.295+0000 7f9b477fe640 1 -- 172.21.15.52:0/3734160516 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f9b500acd20 con 0x7f9b60158b10 2024-04-25T13:17:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.296+0000 7f9b5ed9d640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9b4c06c8f0 0x7f9b4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.296+0000 7f9b5ed9d640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9b4c06c8f0 0x7f9b4c06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800ab60 tx=0x7f9b58008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.300+0000 7f9b477fe640 1 -- 172.21.15.52:0/3734160516 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9b5007a770 con 0x7f9b60158b10 2024-04-25T13:17:08.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.486+0000 7f9b65210640 1 -- 172.21.15.52:0/3734160516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9b60148a80 con 0x7f9b60158b10 2024-04-25T13:17:08.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.487+0000 7f9b477fe640 1 -- 172.21.15.52:0/3734160516 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f9b5007ea70 con 0x7f9b60158b10 2024-04-25T13:17:08.487 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-25T13:17:08.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.488+0000 7f9b65210640 1 -- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9b4c06c8f0 msgr2=0x7f9b4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.488+0000 7f9b65210640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9b4c06c8f0 0x7f9b4c06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800ab60 tx=0x7f9b58008040 comp rx=0 tx=0).stop 2024-04-25T13:17:08.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.488+0000 7f9b65210640 1 -- 172.21.15.52:0/3734160516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60158b10 msgr2=0x7f9b60147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.488+0000 7f9b65210640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60158b10 0x7f9b60147eb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009f40 tx=0x7f9b50004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:08.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.488+0000 7f9b65210640 1 -- 172.21.15.52:0/3734160516 shutdown_connections 2024-04-25T13:17:08.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.488+0000 7f9b65210640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f9b4c06c8f0 0x7f9b4c06edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.488+0000 7f9b65210640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9b600c8720 0x7f9b60157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.488+0000 7f9b65210640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60158b10 0x7f9b60147eb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.488+0000 7f9b65210640 1 --2- 172.21.15.52:0/3734160516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b600c8340 0x7f9b601f06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.489+0000 7f9b65210640 1 -- 172.21.15.52:0/3734160516 >> 172.21.15.52:0/3734160516 conn(0x7f9b6006d660 msgr2=0x7f9b60149280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.489+0000 7f9b65210640 1 -- 172.21.15.52:0/3734160516 shutdown_connections 2024-04-25T13:17:08.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.489+0000 7f9b65210640 1 -- 172.21.15.52:0/3734160516 wait complete. 2024-04-25T13:17:08.503 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:17:08.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.606+0000 7fe7ab3cd640 1 Processor -- start 2024-04-25T13:17:08.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.606+0000 7fe7ab3cd640 1 -- start start 2024-04-25T13:17:08.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.607+0000 7fe7ab3cd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7a40cb270 0x7fe7a406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.607+0000 7fe7ab3cd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe7a40c60c0 0x7fe7a40c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.607+0000 7fe7ab3cd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a40c5900 con 0x7fe7a4155220 2024-04-25T13:17:08.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.607+0000 7fe7ab3cd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a415c040 con 0x7fe7a40c60c0 2024-04-25T13:17:08.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.607+0000 7fe7ab3cd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a40ccb70 con 0x7fe7a40cb270 2024-04-25T13:17:08.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.607+0000 7fe7a996a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe7a40c60c0 0x7fe7a40c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.607+0000 7fe7a8968640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7a40cb270 0x7fe7a406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.608+0000 7fe7a996a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe7a40c60c0 0x7fe7a40c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:40942/0 (socket says 172.21.15.52:40942) 2024-04-25T13:17:08.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.608+0000 7fe7a8968640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7a40cb270 0x7fe7a406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:33586/0 (socket says 172.21.15.52:33586) 2024-04-25T13:17:08.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.608+0000 7fe7a996a640 1 -- 172.21.15.52:0/2160842187 learned_addr learned my addr 172.21.15.52:0/2160842187 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:08.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.608+0000 7fe7a996a640 1 -- 172.21.15.52:0/2160842187 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7a40cb270 msgr2=0x7fe7a406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.608+0000 7fe7a996a640 1 --2- 172.21.15.52:0/2160842187 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7a40cb270 0x7fe7a406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.608+0000 7fe7a996a640 1 -- 172.21.15.52:0/2160842187 >> v1:172.21.15.102:6789/0 conn(0x7fe7a4155220 legacy=0x7fe7a40d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.608+0000 7fe7a996a640 1 -- 172.21.15.52:0/2160842187 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a40cc4f0 con 0x7fe7a40c60c0 2024-04-25T13:17:08.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.608+0000 7fe79bfff640 1 -- 172.21.15.52:0/2160842187 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1956021214 0 0) 0x7fe7a40c5900 con 0x7fe7a4155220 2024-04-25T13:17:08.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.608+0000 7fe7a8968640 1 --2- 172.21.15.52:0/2160842187 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7a40cb270 0x7fe7a406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:08.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.609+0000 7fe7a996a640 1 --2- 172.21.15.52:0/2160842187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a40c60c0 0x7fe7a40c6550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009e50 tx=0x7fe79c02a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f158adb8248b28e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.609+0000 7fe79bfff640 1 -- 172.21.15.52:0/2160842187 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c036070 con 0x7fe7a40c60c0 2024-04-25T13:17:08.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.609+0000 7fe79bfff640 1 -- 172.21.15.52:0/2160842187 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79c031600 con 0x7fe7a40c60c0 2024-04-25T13:17:08.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.609+0000 7fe79bfff640 1 -- 172.21.15.52:0/2160842187 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0319d0 con 0x7fe7a40c60c0 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.609+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/2160842187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a40c60c0 msgr2=0x7fe7a40c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.609+0000 7fe7ab3cd640 1 --2- 172.21.15.52:0/2160842187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a40c60c0 0x7fe7a40c6550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009e50 tx=0x7fe79c02a7a0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.609+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/2160842187 shutdown_connections 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.609+0000 7fe7ab3cd640 1 --2- 172.21.15.52:0/2160842187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a40c60c0 0x7fe7a40c6550 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.609+0000 7fe7ab3cd640 1 --2- 172.21.15.52:0/2160842187 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7a40cb270 0x7fe7a406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.609+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/2160842187 >> 172.21.15.52:0/2160842187 conn(0x7fe7a4075170 msgr2=0x7fe7a4075580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.610+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/2160842187 shutdown_connections 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.610+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/2160842187 wait complete. 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.611+0000 7fe7ab3cd640 1 Processor -- start 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.611+0000 7fe7ab3cd640 1 -- start start 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.611+0000 7fe7ab3cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a40c60c0 0x7fe7a415a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.611+0000 7fe7ab3cd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7a40cb270 0x7fe7a41f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.611+0000 7fe7ab3cd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7a4155220 0x7fe7a41f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.611+0000 7fe7ab3cd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a415bd60 con 0x7fe7a4155220 2024-04-25T13:17:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7ab3cd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a40c5c30 con 0x7fe7a40c60c0 2024-04-25T13:17:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7ab3cd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a4155600 con 0x7fe7a40cb270 2024-04-25T13:17:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7a996a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7a4155220 0x7fe7a41f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7a996a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7a4155220 0x7fe7a41f27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57482/0 (socket says 172.21.15.52:57482) 2024-04-25T13:17:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7a996a640 1 -- 172.21.15.52:0/783191621 learned_addr learned my addr 172.21.15.52:0/783191621 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7a9169640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a40c60c0 0x7fe7a415a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7a8968640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7a40cb270 0x7fe7a41f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7a996a640 1 -- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7a40cb270 msgr2=0x7fe7a41f22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7a996a640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7a40cb270 0x7fe7a41f22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7a996a640 1 -- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a40c60c0 msgr2=0x7fe7a415a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7a996a640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a40c60c0 0x7fe7a415a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7a996a640 1 -- 172.21.15.52:0/783191621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a40c7d00 con 0x7fe7a4155220 2024-04-25T13:17:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7a996a640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7a4155220 0x7fe7a41f27f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009e50 tx=0x7fe79c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe799ffb640 1 -- 172.21.15.52:0/783191621 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c041020 con 0x7fe7a4155220 2024-04-25T13:17:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe799ffb640 1 -- 172.21.15.52:0/783191621 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79c0077a0 con 0x7fe7a4155220 2024-04-25T13:17:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/783191621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a40c7fc0 con 0x7fe7a4155220 2024-04-25T13:17:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.612+0000 7fe799ffb640 1 -- 172.21.15.52:0/783191621 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c036040 con 0x7fe7a4155220 2024-04-25T13:17:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.613+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/783191621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a40c8580 con 0x7fe7a4155220 2024-04-25T13:17:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.613+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/783191621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a4068e40 con 0x7fe7a4155220 2024-04-25T13:17:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.614+0000 7fe799ffb640 1 -- 172.21.15.52:0/783191621 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe79c044020 con 0x7fe7a4155220 2024-04-25T13:17:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.614+0000 7fe799ffb640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe78806c920 0x7fe78806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.615+0000 7fe799ffb640 1 -- 172.21.15.52:0/783191621 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fe79c0ac700 con 0x7fe7a4155220 2024-04-25T13:17:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.615+0000 7fe7a9169640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe78806c920 0x7fe78806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.615+0000 7fe7a9169640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe78806c920 0x7fe78806ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0000f60 tx=0x7fe7a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.619+0000 7fe799ffb640 1 -- 172.21.15.52:0/783191621 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe79c04b070 con 0x7fe7a4155220 2024-04-25T13:17:08.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.804+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/783191621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe7a4073c00 con 0x7fe7a4155220 2024-04-25T13:17:08.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.804+0000 7fe799ffb640 1 -- 172.21.15.52:0/783191621 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fe79c07a210 con 0x7fe7a4155220 2024-04-25T13:17:08.805 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T13:17:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.806+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe78806c920 msgr2=0x7fe78806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.806+0000 7fe7ab3cd640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe78806c920 0x7fe78806ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0000f60 tx=0x7fe7a0009040 comp rx=0 tx=0).stop 2024-04-25T13:17:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.806+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/783191621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7a4155220 msgr2=0x7fe7a41f27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.806+0000 7fe7ab3cd640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7a4155220 0x7fe7a41f27f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009e50 tx=0x7fe79c004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.806+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/783191621 shutdown_connections 2024-04-25T13:17:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.806+0000 7fe7ab3cd640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe78806c920 0x7fe78806ede0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.806+0000 7fe7ab3cd640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7a40cb270 0x7fe7a41f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.806+0000 7fe7ab3cd640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7a4155220 0x7fe7a41f27f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.806+0000 7fe7ab3cd640 1 --2- 172.21.15.52:0/783191621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a40c60c0 0x7fe7a415a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.806+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/783191621 >> 172.21.15.52:0/783191621 conn(0x7fe7a4075170 msgr2=0x7fe7a40cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.806+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/783191621 shutdown_connections 2024-04-25T13:17:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.806+0000 7fe7ab3cd640 1 -- 172.21.15.52:0/783191621 wait complete. 2024-04-25T13:17:08.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:17:08.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.919+0000 7f95e00fa640 1 Processor -- start 2024-04-25T13:17:08.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.919+0000 7f95e00fa640 1 -- start start 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.920+0000 7f95e00fa640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95d80c5f20 0x7f95d815eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.920+0000 7f95e00fa640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d80ccf00 con 0x7f95d8155550 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.920+0000 7f95e00fa640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d80cd1e0 con 0x7f95d8155170 2024-04-25T13:17:08.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.920+0000 7f95e00fa640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f95d80cddf0 con 0x7f95d80c5f20 2024-04-25T13:17:08.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.920+0000 7f95de697640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95d80c5f20 0x7f95d815eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.920+0000 7f95dd695640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f95d8155550 0x7f95d80c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51158/0 (socket says 172.21.15.52:51158) 2024-04-25T13:17:08.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.920+0000 7f95dd695640 1 -- 172.21.15.52:0/2387935573 learned_addr learned my addr 172.21.15.52:0/2387935573 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.920+0000 7f95dce94640 1 -- 172.21.15.52:0/2387935573 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482554548 0 0) 0x7f95d80ccf00 con 0x7f95d8155550 2024-04-25T13:17:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.920+0000 7f95dce94640 1 -- 172.21.15.52:0/2387935573 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95c4003520 con 0x7f95d8155550 2024-04-25T13:17:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.921+0000 7f95de697640 1 -- 172.21.15.52:0/2387935573 >> v1:172.21.15.102:6789/0 conn(0x7f95d8155170 legacy=0x7f95d80d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.921+0000 7f95de697640 1 -- 172.21.15.52:0/2387935573 >> v1:172.21.15.52:6789/0 conn(0x7f95d8155550 legacy=0x7f95d80c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.921+0000 7f95de697640 1 -- 172.21.15.52:0/2387935573 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d80cd4c0 con 0x7f95d80c5f20 2024-04-25T13:17:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.921+0000 7f95de697640 1 --2- 172.21.15.52:0/2387935573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95d80c5f20 0x7f95d815eef0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009d90 tx=0x7f95d402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02dd43dc0dd83c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.921+0000 7f95dce94640 1 -- 172.21.15.52:0/2387935573 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4007740 con 0x7f95d80c5f20 2024-04-25T13:17:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.921+0000 7f95dce94640 1 -- 172.21.15.52:0/2387935573 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d40078e0 con 0x7f95d80c5f20 2024-04-25T13:17:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.921+0000 7f95dce94640 1 -- 172.21.15.52:0/2387935573 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4007cb0 con 0x7f95d80c5f20 2024-04-25T13:17:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.922+0000 7f95e00fa640 1 -- 172.21.15.52:0/2387935573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95d80c5f20 msgr2=0x7f95d815eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.922+0000 7f95e00fa640 1 --2- 172.21.15.52:0/2387935573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95d80c5f20 0x7f95d815eef0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009d90 tx=0x7f95d402a6f0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.922+0000 7f95e00fa640 1 -- 172.21.15.52:0/2387935573 shutdown_connections 2024-04-25T13:17:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.922+0000 7f95e00fa640 1 --2- 172.21.15.52:0/2387935573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95d80c5f20 0x7f95d815eef0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.922+0000 7f95e00fa640 1 -- 172.21.15.52:0/2387935573 >> 172.21.15.52:0/2387935573 conn(0x7f95d8072570 msgr2=0x7f95d8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.922+0000 7f95e00fa640 1 -- 172.21.15.52:0/2387935573 shutdown_connections 2024-04-25T13:17:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.922+0000 7f95e00fa640 1 -- 172.21.15.52:0/2387935573 wait complete. 2024-04-25T13:17:08.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.923+0000 7f95e00fa640 1 Processor -- start 2024-04-25T13:17:08.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.923+0000 7f95e00fa640 1 -- start start 2024-04-25T13:17:08.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95e00fa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95d8155170 0x7f95d80b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95e00fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95d8155550 0x7f95d815c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95e00fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d815c660 0x7f95d815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95e00fa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95d80cda80 con 0x7f95d8155550 2024-04-25T13:17:08.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95e00fa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f95d815f430 con 0x7f95d815c660 2024-04-25T13:17:08.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95e00fa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f95d80ccae0 con 0x7f95d8155170 2024-04-25T13:17:08.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95dd695640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95d8155550 0x7f95d815c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95dd695640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95d8155550 0x7f95d815c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36114/0 (socket says 172.21.15.52:36114) 2024-04-25T13:17:08.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95dd695640 1 -- 172.21.15.52:0/3090597862 learned_addr learned my addr 172.21.15.52:0/3090597862 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:08.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95de697640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d815c660 0x7f95d815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95dde96640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95d8155170 0x7f95d80b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95dd695640 1 -- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95d8155170 msgr2=0x7f95d80b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95dd695640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95d8155170 0x7f95d80b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95dd695640 1 -- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d815c660 msgr2=0x7f95d815e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95dd695640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d815c660 0x7f95d815e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.924+0000 7f95dd695640 1 -- 172.21.15.52:0/3090597862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d8149b60 con 0x7f95d8155550 2024-04-25T13:17:08.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.925+0000 7f95dd695640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95d8155550 0x7f95d815c120 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f95c800c3e0 tx=0x7f95c800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.925+0000 7f95ce7fc640 1 -- 172.21.15.52:0/3090597862 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c8017070 con 0x7f95d8155550 2024-04-25T13:17:08.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.925+0000 7f95ce7fc640 1 -- 172.21.15.52:0/3090597862 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c8005ce0 con 0x7f95d8155550 2024-04-25T13:17:08.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.925+0000 7f95e00fa640 1 -- 172.21.15.52:0/3090597862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d81f43e0 con 0x7f95d8155550 2024-04-25T13:17:08.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.925+0000 7f95ce7fc640 1 -- 172.21.15.52:0/3090597862 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c80072d0 con 0x7f95d8155550 2024-04-25T13:17:08.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.925+0000 7f95e00fa640 1 -- 172.21.15.52:0/3090597862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d81f49a0 con 0x7f95d8155550 2024-04-25T13:17:08.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.926+0000 7f95e00fa640 1 -- 172.21.15.52:0/3090597862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d80b3bb0 con 0x7f95d8155550 2024-04-25T13:17:08.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.926+0000 7f95ce7fc640 1 -- 172.21.15.52:0/3090597862 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95c801a070 con 0x7f95d8155550 2024-04-25T13:17:08.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.927+0000 7f95ce7fc640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f95bc06c920 0x7f95bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.927+0000 7f95ce7fc640 1 -- 172.21.15.52:0/3090597862 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f95c808b280 con 0x7f95d8155550 2024-04-25T13:17:08.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.927+0000 7f95dde96640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f95bc06c920 0x7f95bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.927+0000 7f95dde96640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f95bc06c920 0x7f95bc06ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f95d0007fd0 tx=0x7f95d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:08.931+0000 7f95ce7fc640 1 -- 172.21.15.52:0/3090597862 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f95d80b3bb0 con 0x7f95d8155550 2024-04-25T13:17:09.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.126+0000 7f95e00fa640 1 -- 172.21.15.52:0/3090597862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95d80b3210 con 0x7f95d8155550 2024-04-25T13:17:09.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.126+0000 7f95ce7fc640 1 -- 172.21.15.52:0/3090597862 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f95c8058bb0 con 0x7f95d8155550 2024-04-25T13:17:09.127 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-04-25T13:17:09.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.128+0000 7f95e00fa640 1 -- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f95bc06c920 msgr2=0x7f95bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.128+0000 7f95e00fa640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f95bc06c920 0x7f95bc06ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f95d0007fd0 tx=0x7f95d0009040 comp rx=0 tx=0).stop 2024-04-25T13:17:09.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.128+0000 7f95e00fa640 1 -- 172.21.15.52:0/3090597862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95d8155550 msgr2=0x7f95d815c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.128+0000 7f95e00fa640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95d8155550 0x7f95d815c120 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f95c800c3e0 tx=0x7f95c800c8a0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.128+0000 7f95e00fa640 1 -- 172.21.15.52:0/3090597862 shutdown_connections 2024-04-25T13:17:09.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.128+0000 7f95e00fa640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f95bc06c920 0x7f95bc06ede0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.128+0000 7f95e00fa640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d815c660 0x7f95d815e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.128+0000 7f95e00fa640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95d8155550 0x7f95d815c120 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.128+0000 7f95e00fa640 1 --2- 172.21.15.52:0/3090597862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95d8155170 0x7f95d80b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.128+0000 7f95e00fa640 1 -- 172.21.15.52:0/3090597862 >> 172.21.15.52:0/3090597862 conn(0x7f95d8072570 msgr2=0x7f95d80c5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.128+0000 7f95e00fa640 1 -- 172.21.15.52:0/3090597862 shutdown_connections 2024-04-25T13:17:09.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:09.128+0000 7f95e00fa640 1 -- 172.21.15.52:0/3090597862 wait complete. 2024-04-25T13:17:09.139 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi052.front.sepia.ceph.com... 2024-04-25T13:17:09.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:09.140 DEBUG:teuthology.orchestra.run.smithi052:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:09.162 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[45144]: fuse finished with error 0 and tester_r 0 2024-04-25T13:17:09.164 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:17:09.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:17:09.873 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:17:15.266 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:17:15.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:15.266 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T13:17:15.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:15.286 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-04-25T13:17:15.345 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T13:17:15.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:15.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:15.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:15.415 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-04-25T13:17:15.510 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T13:17:15.519 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T13:17:15.520 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:15.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.628+0000 7f2fa86a3640 1 Processor -- start 2024-04-25T13:17:15.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.628+0000 7f2fa86a3640 1 -- start start 2024-04-25T13:17:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa86a3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2fa0074d50 0x7f2fa015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa86a3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2fa0075130 0x7f2fa0075560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa86a3640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa00cdcb0 con 0x7f2fa015f190 2024-04-25T13:17:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa86a3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa0075aa0 con 0x7f2fa0075130 2024-04-25T13:17:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa86a3640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa00cdf70 con 0x7f2fa0074d50 2024-04-25T13:17:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa6c40640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2fa0075130 0x7f2fa0075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa6c40640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2fa0075130 0x7f2fa0075560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36130/0 (socket says 172.21.15.52:36130) 2024-04-25T13:17:15.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa6c40640 1 -- 172.21.15.52:0/3268200008 learned_addr learned my addr 172.21.15.52:0/3268200008 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:15.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa643f640 1 --2- 172.21.15.52:0/3268200008 >> v2:172.21.15.102:3300/0 conn(0x7f2fa0074d50 0x7f2fa015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa6c40640 1 -- 172.21.15.52:0/3268200008 >> v2:172.21.15.102:3300/0 conn(0x7f2fa0074d50 msgr2=0x7f2fa015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:15.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa6c40640 1 --2- 172.21.15.52:0/3268200008 >> v2:172.21.15.102:3300/0 conn(0x7f2fa0074d50 0x7f2fa015b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa6c40640 1 -- 172.21.15.52:0/3268200008 >> v1:172.21.15.102:6789/0 conn(0x7f2fa015f190 legacy=0x7f2fa00c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.629+0000 7f2fa6c40640 1 -- 172.21.15.52:0/3268200008 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa00ce250 con 0x7f2fa0075130 2024-04-25T13:17:15.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.630+0000 7f2fa6c40640 1 --2- 172.21.15.52:0/3268200008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fa0075130 0x7f2fa0075560 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2fa006c6f0 tx=0x7f2f9802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4554f5c5045427a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.630+0000 7f2fa543d640 1 -- 172.21.15.52:0/3268200008 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98036070 con 0x7f2fa0075130 2024-04-25T13:17:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.630+0000 7f2fa543d640 1 -- 172.21.15.52:0/3268200008 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f98031600 con 0x7f2fa0075130 2024-04-25T13:17:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.630+0000 7f2fa543d640 1 -- 172.21.15.52:0/3268200008 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f980319f0 con 0x7f2fa0075130 2024-04-25T13:17:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.631+0000 7f2fa86a3640 1 -- 172.21.15.52:0/3268200008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fa0075130 msgr2=0x7f2fa0075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.631+0000 7f2fa86a3640 1 --2- 172.21.15.52:0/3268200008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fa0075130 0x7f2fa0075560 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2fa006c6f0 tx=0x7f2f9802a7c0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.631+0000 7f2fa86a3640 1 -- 172.21.15.52:0/3268200008 shutdown_connections 2024-04-25T13:17:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.631+0000 7f2fa86a3640 1 --2- 172.21.15.52:0/3268200008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fa0075130 0x7f2fa0075560 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.631+0000 7f2fa86a3640 1 --2- 172.21.15.52:0/3268200008 >> v2:172.21.15.102:3300/0 conn(0x7f2fa0074d50 0x7f2fa015b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.631+0000 7f2fa86a3640 1 -- 172.21.15.52:0/3268200008 >> 172.21.15.52:0/3268200008 conn(0x7f2fa006b920 msgr2=0x7f2fa006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.631+0000 7f2fa86a3640 1 -- 172.21.15.52:0/3268200008 shutdown_connections 2024-04-25T13:17:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.631+0000 7f2fa86a3640 1 -- 172.21.15.52:0/3268200008 wait complete. 2024-04-25T13:17:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.632+0000 7f2fa86a3640 1 Processor -- start 2024-04-25T13:17:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.632+0000 7f2fa86a3640 1 -- start start 2024-04-25T13:17:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa86a3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fa0074d50 0x7f2fa0155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa86a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fa0075130 0x7f2fa01e5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa86a3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2fa015f190 0x7f2fa01e5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa86a3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa015ec70 con 0x7f2fa0075130 2024-04-25T13:17:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa86a3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa015e990 con 0x7f2fa0074d50 2024-04-25T13:17:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa86a3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa00cd4b0 con 0x7f2fa015f190 2024-04-25T13:17:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa5c3e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fa0075130 0x7f2fa01e5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa5c3e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fa0075130 0x7f2fa01e5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36140/0 (socket says 172.21.15.52:36140) 2024-04-25T13:17:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa5c3e640 1 -- 172.21.15.52:0/666689419 learned_addr learned my addr 172.21.15.52:0/666689419 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa643f640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fa0074d50 0x7f2fa0155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa6c40640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2fa015f190 0x7f2fa01e5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa5c3e640 1 -- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2fa015f190 msgr2=0x7f2fa01e5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa5c3e640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2fa015f190 0x7f2fa01e5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa5c3e640 1 -- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fa0074d50 msgr2=0x7f2fa0155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa5c3e640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fa0074d50 0x7f2fa0155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa5c3e640 1 -- 172.21.15.52:0/666689419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa01e6f50 con 0x7f2fa0075130 2024-04-25T13:17:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.633+0000 7f2fa5c3e640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fa0075130 0x7f2fa01e5a80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2f9000c470 tx=0x7f2f90001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.634+0000 7f2f96ffd640 1 -- 172.21.15.52:0/666689419 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900052d0 con 0x7f2fa0075130 2024-04-25T13:17:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.634+0000 7f2f96ffd640 1 -- 172.21.15.52:0/666689419 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f90005470 con 0x7f2fa0075130 2024-04-25T13:17:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.634+0000 7f2fa86a3640 1 -- 172.21.15.52:0/666689419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa01e6340 con 0x7f2fa0075130 2024-04-25T13:17:15.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.634+0000 7f2f96ffd640 1 -- 172.21.15.52:0/666689419 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90007260 con 0x7f2fa0075130 2024-04-25T13:17:15.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.634+0000 7f2fa86a3640 1 -- 172.21.15.52:0/666689419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa013d4a0 con 0x7f2fa0075130 2024-04-25T13:17:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.635+0000 7f2fa86a3640 1 -- 172.21.15.52:0/666689419 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa006c030 con 0x7f2fa0075130 2024-04-25T13:17:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.635+0000 7f2f96ffd640 1 -- 172.21.15.52:0/666689419 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f90007400 con 0x7f2fa0075130 2024-04-25T13:17:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.636+0000 7f2f96ffd640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2f8406c8f0 0x7f2f8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.636+0000 7f2f96ffd640 1 -- 172.21.15.52:0/666689419 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f2f9008b420 con 0x7f2fa0075130 2024-04-25T13:17:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.636+0000 7f2fa643f640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2f8406c8f0 0x7f2f8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.636+0000 7f2fa643f640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2f8406c8f0 0x7f2f8406edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009aa0 tx=0x7f2f9c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.640+0000 7f2f96ffd640 1 -- 172.21.15.52:0/666689419 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2fa006c030 con 0x7f2fa0075130 2024-04-25T13:17:15.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.827+0000 7f2fa86a3640 1 -- 172.21.15.52:0/666689419 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fa01564b0 con 0x7f2f8406c8f0 2024-04-25T13:17:15.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.835+0000 7f2f96ffd640 1 -- 172.21.15.52:0/666689419 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7f2fa01564b0 con 0x7f2f8406c8f0 2024-04-25T13:17:15.839 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:17:15.841 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T13:17:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.839+0000 7f2fa86a3640 1 -- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2f8406c8f0 msgr2=0x7f2f8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.839+0000 7f2fa86a3640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2f8406c8f0 0x7f2f8406edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009aa0 tx=0x7f2f9c009190 comp rx=0 tx=0).stop 2024-04-25T13:17:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.839+0000 7f2fa86a3640 1 -- 172.21.15.52:0/666689419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fa0075130 msgr2=0x7f2fa01e5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.839+0000 7f2fa86a3640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fa0075130 0x7f2fa01e5a80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2f9000c470 tx=0x7f2f90001e70 comp rx=0 tx=0).stop 2024-04-25T13:17:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.839+0000 7f2fa86a3640 1 -- 172.21.15.52:0/666689419 shutdown_connections 2024-04-25T13:17:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.839+0000 7f2fa86a3640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f2f8406c8f0 0x7f2f8406edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.839+0000 7f2fa86a3640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2fa015f190 0x7f2fa01e5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.839+0000 7f2fa86a3640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fa0075130 0x7f2fa01e5a80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.839+0000 7f2fa86a3640 1 --2- 172.21.15.52:0/666689419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fa0074d50 0x7f2fa0155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.839+0000 7f2fa86a3640 1 -- 172.21.15.52:0/666689419 >> 172.21.15.52:0/666689419 conn(0x7f2fa006b920 msgr2=0x7f2fa0142590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.839+0000 7f2fa86a3640 1 -- 172.21.15.52:0/666689419 shutdown_connections 2024-04-25T13:17:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.839+0000 7f2fa86a3640 1 -- 172.21.15.52:0/666689419 wait complete. 2024-04-25T13:17:15.850 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-04-25T13:17:13.835240+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236456,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738264,"statfs":{"total":773094113280,"available":772851982336,"internally_reserved":0,"allocated":3776512,"data_stored":2177831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2328,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003523"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.148643+0000","last_change":"2024-04-25T13:16:07.001071+0000","last_active":"2024-04-25T13:16:56.148643+0000","last_peered":"2024-04-25T13:16:56.148643+0000","last_clean":"2024-04-25T13:16:56.148643+0000","last_became_active":"2024-04-25T13:16:07.000746+0000","last_became_peered":"2024-04-25T13:16:07.000746+0000","last_unstale":"2024-04-25T13:16:56.148643+0000","last_undegraded":"2024-04-25T13:16:56.148643+0000","last_fullsized":"2024-04-25T13:16:56.148643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:36.289103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235936+0000","last_change":"2024-04-25T13:16:08.012928+0000","last_active":"2024-04-25T13:16:49.235936+0000","last_peered":"2024-04-25T13:16:49.235936+0000","last_clean":"2024-04-25T13:16:49.235936+0000","last_became_active":"2024-04-25T13:16:08.012114+0000","last_became_peered":"2024-04-25T13:16:08.012114+0000","last_unstale":"2024-04-25T13:16:49.235936+0000","last_undegraded":"2024-04-25T13:16:49.235936+0000","last_fullsized":"2024-04-25T13:16:49.235936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:01.077922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235570+0000","last_change":"2024-04-25T13:16:12.734829+0000","last_active":"2024-04-25T13:16:49.235570+0000","last_peered":"2024-04-25T13:16:49.235570+0000","last_clean":"2024-04-25T13:16:49.235570+0000","last_became_active":"2024-04-25T13:16:12.734390+0000","last_became_peered":"2024-04-25T13:16:12.734390+0000","last_unstale":"2024-04-25T13:16:49.235570+0000","last_undegraded":"2024-04-25T13:16:49.235570+0000","last_fullsized":"2024-04-25T13:16:49.235570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:33.941883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236119+0000","last_change":"2024-04-25T13:16:06.999440+0000","last_active":"2024-04-25T13:16:49.236119+0000","last_peered":"2024-04-25T13:16:49.236119+0000","last_clean":"2024-04-25T13:16:49.236119+0000","last_became_active":"2024-04-25T13:16:06.999078+0000","last_became_peered":"2024-04-25T13:16:06.999078+0000","last_unstale":"2024-04-25T13:16:49.236119+0000","last_undegraded":"2024-04-25T13:16:49.236119+0000","last_fullsized":"2024-04-25T13:16:49.236119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.819349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133600+0000","last_change":"2024-04-25T13:16:08.012743+0000","last_active":"2024-04-25T13:16:49.133600+0000","last_peered":"2024-04-25T13:16:49.133600+0000","last_clean":"2024-04-25T13:16:49.133600+0000","last_became_active":"2024-04-25T13:16:08.012036+0000","last_became_peered":"2024-04-25T13:16:08.012036+0000","last_unstale":"2024-04-25T13:16:49.133600+0000","last_undegraded":"2024-04-25T13:16:49.133600+0000","last_fullsized":"2024-04-25T13:16:49.133600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.959146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.238290+0000","last_change":"2024-04-25T13:16:49.238290+0000","last_active":"2024-04-25T13:16:49.238290+0000","last_peered":"2024-04-25T13:16:49.238290+0000","last_clean":"2024-04-25T13:16:49.238290+0000","last_became_active":"2024-04-25T13:16:49.237674+0000","last_became_peered":"2024-04-25T13:16:49.237674+0000","last_unstale":"2024-04-25T13:16:49.238290+0000","last_undegraded":"2024-04-25T13:16:49.238290+0000","last_fullsized":"2024-04-25T13:16:49.238290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:32.550364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.149564+0000","last_change":"2024-04-25T13:16:07.001022+0000","last_active":"2024-04-25T13:16:56.149564+0000","last_peered":"2024-04-25T13:16:56.149564+0000","last_clean":"2024-04-25T13:16:56.149564+0000","last_became_active":"2024-04-25T13:16:07.000751+0000","last_became_peered":"2024-04-25T13:16:07.000751+0000","last_unstale":"2024-04-25T13:16:56.149564+0000","last_undegraded":"2024-04-25T13:16:56.149564+0000","last_fullsized":"2024-04-25T13:16:56.149564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:11.597397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131104+0000","last_change":"2024-04-25T13:16:08.011361+0000","last_active":"2024-04-25T13:16:49.131104+0000","last_peered":"2024-04-25T13:16:49.131104+0000","last_clean":"2024-04-25T13:16:49.131104+0000","last_became_active":"2024-04-25T13:16:08.011073+0000","last_became_peered":"2024-04-25T13:16:08.011073+0000","last_unstale":"2024-04-25T13:16:49.131104+0000","last_undegraded":"2024-04-25T13:16:49.131104+0000","last_fullsized":"2024-04-25T13:16:49.131104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:00.471410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.238066+0000","last_change":"2024-04-25T13:16:49.238066+0000","last_active":"2024-04-25T13:16:49.238066+0000","last_peered":"2024-04-25T13:16:49.238066+0000","last_clean":"2024-04-25T13:16:49.238066+0000","last_became_active":"2024-04-25T13:16:49.237565+0000","last_became_peered":"2024-04-25T13:16:49.237565+0000","last_unstale":"2024-04-25T13:16:49.238066+0000","last_undegraded":"2024-04-25T13:16:49.238066+0000","last_fullsized":"2024-04-25T13:16:49.238066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:15.893235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.151020+0000","last_change":"2024-04-25T13:16:07.003774+0000","last_active":"2024-04-25T13:16:56.151020+0000","last_peered":"2024-04-25T13:16:56.151020+0000","last_clean":"2024-04-25T13:16:56.151020+0000","last_became_active":"2024-04-25T13:16:07.003493+0000","last_became_peered":"2024-04-25T13:16:07.003493+0000","last_unstale":"2024-04-25T13:16:56.151020+0000","last_undegraded":"2024-04-25T13:16:56.151020+0000","last_fullsized":"2024-04-25T13:16:56.151020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:12.940812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130266+0000","last_change":"2024-04-25T13:16:08.012084+0000","last_active":"2024-04-25T13:16:49.130266+0000","last_peered":"2024-04-25T13:16:49.130266+0000","last_clean":"2024-04-25T13:16:49.130266+0000","last_became_active":"2024-04-25T13:16:08.011634+0000","last_became_peered":"2024-04-25T13:16:08.011634+0000","last_unstale":"2024-04-25T13:16:49.130266+0000","last_undegraded":"2024-04-25T13:16:49.130266+0000","last_fullsized":"2024-04-25T13:16:49.130266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:26.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132146+0000","last_change":"2024-04-25T13:16:12.039238+0000","last_active":"2024-04-25T13:16:49.132146+0000","last_peered":"2024-04-25T13:16:49.132146+0000","last_clean":"2024-04-25T13:16:49.132146+0000","last_became_active":"2024-04-25T13:16:12.038508+0000","last_became_peered":"2024-04-25T13:16:12.038508+0000","last_unstale":"2024-04-25T13:16:49.132146+0000","last_undegraded":"2024-04-25T13:16:49.132146+0000","last_fullsized":"2024-04-25T13:16:49.132146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:22.183373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235784+0000","last_change":"2024-04-25T13:16:08.007741+0000","last_active":"2024-04-25T13:16:49.235784+0000","last_peered":"2024-04-25T13:16:49.235784+0000","last_clean":"2024-04-25T13:16:49.235784+0000","last_became_active":"2024-04-25T13:16:08.007478+0000","last_became_peered":"2024-04-25T13:16:08.007478+0000","last_unstale":"2024-04-25T13:16:49.235784+0000","last_undegraded":"2024-04-25T13:16:49.235784+0000","last_fullsized":"2024-04-25T13:16:49.235784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:49.162203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131314+0000","last_change":"2024-04-25T13:16:07.001183+0000","last_active":"2024-04-25T13:16:49.131314+0000","last_peered":"2024-04-25T13:16:49.131314+0000","last_clean":"2024-04-25T13:16:49.131314+0000","last_became_active":"2024-04-25T13:16:07.000880+0000","last_became_peered":"2024-04-25T13:16:07.000880+0000","last_unstale":"2024-04-25T13:16:49.131314+0000","last_undegraded":"2024-04-25T13:16:49.131314+0000","last_fullsized":"2024-04-25T13:16:49.131314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.250349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132664+0000","last_change":"2024-04-25T13:16:12.037074+0000","last_active":"2024-04-25T13:16:49.132664+0000","last_peered":"2024-04-25T13:16:49.132664+0000","last_clean":"2024-04-25T13:16:49.132664+0000","last_became_active":"2024-04-25T13:16:12.036508+0000","last_became_peered":"2024-04-25T13:16:12.036508+0000","last_unstale":"2024-04-25T13:16:49.132664+0000","last_undegraded":"2024-04-25T13:16:49.132664+0000","last_fullsized":"2024-04-25T13:16:49.132664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:01.380469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235873+0000","last_change":"2024-04-25T13:16:08.013538+0000","last_active":"2024-04-25T13:16:49.235873+0000","last_peered":"2024-04-25T13:16:49.235873+0000","last_clean":"2024-04-25T13:16:49.235873+0000","last_became_active":"2024-04-25T13:16:08.013269+0000","last_became_peered":"2024-04-25T13:16:08.013269+0000","last_unstale":"2024-04-25T13:16:49.235873+0000","last_undegraded":"2024-04-25T13:16:49.235873+0000","last_fullsized":"2024-04-25T13:16:49.235873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:05.313768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.130603+0000","last_change":"2024-04-25T13:16:06.994106+0000","last_active":"2024-04-25T13:16:51.130603+0000","last_peered":"2024-04-25T13:16:51.130603+0000","last_clean":"2024-04-25T13:16:51.130603+0000","last_became_active":"2024-04-25T13:16:06.993807+0000","last_became_peered":"2024-04-25T13:16:06.993807+0000","last_unstale":"2024-04-25T13:16:51.130603+0000","last_undegraded":"2024-04-25T13:16:51.130603+0000","last_fullsized":"2024-04-25T13:16:51.130603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:53.706175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131943+0000","last_change":"2024-04-25T13:16:12.039421+0000","last_active":"2024-04-25T13:16:49.131943+0000","last_peered":"2024-04-25T13:16:49.131943+0000","last_clean":"2024-04-25T13:16:49.131943+0000","last_became_active":"2024-04-25T13:16:12.038953+0000","last_became_peered":"2024-04-25T13:16:12.038953+0000","last_unstale":"2024-04-25T13:16:49.131943+0000","last_undegraded":"2024-04-25T13:16:49.131943+0000","last_fullsized":"2024-04-25T13:16:49.131943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:26.714224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236290+0000","last_change":"2024-04-25T13:16:08.008978+0000","last_active":"2024-04-25T13:16:49.236290+0000","last_peered":"2024-04-25T13:16:49.236290+0000","last_clean":"2024-04-25T13:16:49.236290+0000","last_became_active":"2024-04-25T13:16:08.008446+0000","last_became_peered":"2024-04-25T13:16:08.008446+0000","last_unstale":"2024-04-25T13:16:49.236290+0000","last_undegraded":"2024-04-25T13:16:49.236290+0000","last_fullsized":"2024-04-25T13:16:49.236290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:34.604344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.148428+0000","last_change":"2024-04-25T13:16:06.992902+0000","last_active":"2024-04-25T13:16:56.148428+0000","last_peered":"2024-04-25T13:16:56.148428+0000","last_clean":"2024-04-25T13:16:56.148428+0000","last_became_active":"2024-04-25T13:16:06.992593+0000","last_became_peered":"2024-04-25T13:16:06.992593+0000","last_unstale":"2024-04-25T13:16:56.148428+0000","last_undegraded":"2024-04-25T13:16:56.148428+0000","last_fullsized":"2024-04-25T13:16:56.148428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:57.665455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129441+0000","last_change":"2024-04-25T13:16:12.735412+0000","last_active":"2024-04-25T13:16:49.129441+0000","last_peered":"2024-04-25T13:16:49.129441+0000","last_clean":"2024-04-25T13:16:49.129441+0000","last_became_active":"2024-04-25T13:16:12.733485+0000","last_became_peered":"2024-04-25T13:16:12.733485+0000","last_unstale":"2024-04-25T13:16:49.129441+0000","last_undegraded":"2024-04-25T13:16:49.129441+0000","last_fullsized":"2024-04-25T13:16:49.129441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:25.265696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132357+0000","last_change":"2024-04-25T13:16:07.998941+0000","last_active":"2024-04-25T13:16:49.132357+0000","last_peered":"2024-04-25T13:16:49.132357+0000","last_clean":"2024-04-25T13:16:49.132357+0000","last_became_active":"2024-04-25T13:16:07.998658+0000","last_became_peered":"2024-04-25T13:16:07.998658+0000","last_unstale":"2024-04-25T13:16:49.132357+0000","last_undegraded":"2024-04-25T13:16:49.132357+0000","last_fullsized":"2024-04-25T13:16:49.132357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:45.473269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129850+0000","last_change":"2024-04-25T13:16:07.001542+0000","last_active":"2024-04-25T13:16:49.129850+0000","last_peered":"2024-04-25T13:16:49.129850+0000","last_clean":"2024-04-25T13:16:49.129850+0000","last_became_active":"2024-04-25T13:16:07.000846+0000","last_became_peered":"2024-04-25T13:16:07.000846+0000","last_unstale":"2024-04-25T13:16:49.129850+0000","last_undegraded":"2024-04-25T13:16:49.129850+0000","last_fullsized":"2024-04-25T13:16:49.129850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:41.121978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132197+0000","last_change":"2024-04-25T13:16:12.038493+0000","last_active":"2024-04-25T13:16:49.132197+0000","last_peered":"2024-04-25T13:16:49.132197+0000","last_clean":"2024-04-25T13:16:49.132197+0000","last_became_active":"2024-04-25T13:16:12.038032+0000","last_became_peered":"2024-04-25T13:16:12.038032+0000","last_unstale":"2024-04-25T13:16:49.132197+0000","last_undegraded":"2024-04-25T13:16:49.132197+0000","last_fullsized":"2024-04-25T13:16:49.132197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:40.222480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134580+0000","last_change":"2024-04-25T13:16:07.998444+0000","last_active":"2024-04-25T13:16:49.134580+0000","last_peered":"2024-04-25T13:16:49.134580+0000","last_clean":"2024-04-25T13:16:49.134580+0000","last_became_active":"2024-04-25T13:16:07.998037+0000","last_became_peered":"2024-04-25T13:16:07.998037+0000","last_unstale":"2024-04-25T13:16:49.134580+0000","last_undegraded":"2024-04-25T13:16:49.134580+0000","last_fullsized":"2024-04-25T13:16:49.134580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:35.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.347192+0000","last_change":"2024-04-25T13:16:06.995706+0000","last_active":"2024-04-25T13:16:56.347192+0000","last_peered":"2024-04-25T13:16:56.347192+0000","last_clean":"2024-04-25T13:16:56.347192+0000","last_became_active":"2024-04-25T13:16:06.995420+0000","last_became_peered":"2024-04-25T13:16:06.995420+0000","last_unstale":"2024-04-25T13:16:56.347192+0000","last_undegraded":"2024-04-25T13:16:56.347192+0000","last_fullsized":"2024-04-25T13:16:56.347192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:08.672949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132741+0000","last_change":"2024-04-25T13:16:12.734165+0000","last_active":"2024-04-25T13:16:49.132741+0000","last_peered":"2024-04-25T13:16:49.132741+0000","last_clean":"2024-04-25T13:16:49.132741+0000","last_became_active":"2024-04-25T13:16:12.733772+0000","last_became_peered":"2024-04-25T13:16:12.733772+0000","last_unstale":"2024-04-25T13:16:49.132741+0000","last_undegraded":"2024-04-25T13:16:49.132741+0000","last_fullsized":"2024-04-25T13:16:49.132741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:35.716517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236301+0000","last_change":"2024-04-25T13:16:08.017429+0000","last_active":"2024-04-25T13:16:49.236301+0000","last_peered":"2024-04-25T13:16:49.236301+0000","last_clean":"2024-04-25T13:16:49.236301+0000","last_became_active":"2024-04-25T13:16:08.017205+0000","last_became_peered":"2024-04-25T13:16:08.017205+0000","last_unstale":"2024-04-25T13:16:49.236301+0000","last_undegraded":"2024-04-25T13:16:49.236301+0000","last_fullsized":"2024-04-25T13:16:49.236301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.383669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.133433+0000","last_change":"2024-04-25T13:16:06.992063+0000","last_active":"2024-04-25T13:16:51.133433+0000","last_peered":"2024-04-25T13:16:51.133433+0000","last_clean":"2024-04-25T13:16:51.133433+0000","last_became_active":"2024-04-25T13:16:06.991766+0000","last_became_peered":"2024-04-25T13:16:06.991766+0000","last_unstale":"2024-04-25T13:16:51.133433+0000","last_undegraded":"2024-04-25T13:16:51.133433+0000","last_fullsized":"2024-04-25T13:16:51.133433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:25.728063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235811+0000","last_change":"2024-04-25T13:16:12.734837+0000","last_active":"2024-04-25T13:16:49.235811+0000","last_peered":"2024-04-25T13:16:49.235811+0000","last_clean":"2024-04-25T13:16:49.235811+0000","last_became_active":"2024-04-25T13:16:12.734394+0000","last_became_peered":"2024-04-25T13:16:12.734394+0000","last_unstale":"2024-04-25T13:16:49.235811+0000","last_undegraded":"2024-04-25T13:16:49.235811+0000","last_fullsized":"2024-04-25T13:16:49.235811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:24.740929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129513+0000","last_change":"2024-04-25T13:16:08.000277+0000","last_active":"2024-04-25T13:16:49.129513+0000","last_peered":"2024-04-25T13:16:49.129513+0000","last_clean":"2024-04-25T13:16:49.129513+0000","last_became_active":"2024-04-25T13:16:07.999797+0000","last_became_peered":"2024-04-25T13:16:07.999797+0000","last_unstale":"2024-04-25T13:16:49.129513+0000","last_undegraded":"2024-04-25T13:16:49.129513+0000","last_fullsized":"2024-04-25T13:16:49.129513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:08.860755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.133126+0000","last_change":"2024-04-25T13:16:07.002146+0000","last_active":"2024-04-25T13:16:51.133126+0000","last_peered":"2024-04-25T13:16:51.133126+0000","last_clean":"2024-04-25T13:16:51.133126+0000","last_became_active":"2024-04-25T13:16:07.001918+0000","last_became_peered":"2024-04-25T13:16:07.001918+0000","last_unstale":"2024-04-25T13:16:51.133126+0000","last_undegraded":"2024-04-25T13:16:51.133126+0000","last_fullsized":"2024-04-25T13:16:51.133126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:38.326719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134757+0000","last_change":"2024-04-25T13:16:12.733744+0000","last_active":"2024-04-25T13:16:49.134757+0000","last_peered":"2024-04-25T13:16:49.134757+0000","last_clean":"2024-04-25T13:16:49.134757+0000","last_became_active":"2024-04-25T13:16:12.733361+0000","last_became_peered":"2024-04-25T13:16:12.733361+0000","last_unstale":"2024-04-25T13:16:49.134757+0000","last_undegraded":"2024-04-25T13:16:49.134757+0000","last_fullsized":"2024-04-25T13:16:49.134757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:39.178837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130376+0000","last_change":"2024-04-25T13:16:08.016667+0000","last_active":"2024-04-25T13:16:49.130376+0000","last_peered":"2024-04-25T13:16:49.130376+0000","last_clean":"2024-04-25T13:16:49.130376+0000","last_became_active":"2024-04-25T13:16:08.015172+0000","last_became_peered":"2024-04-25T13:16:08.015172+0000","last_unstale":"2024-04-25T13:16:49.130376+0000","last_undegraded":"2024-04-25T13:16:49.130376+0000","last_fullsized":"2024-04-25T13:16:49.130376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:40.786954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129640+0000","last_change":"2024-04-25T13:16:06.996301+0000","last_active":"2024-04-25T13:16:49.129640+0000","last_peered":"2024-04-25T13:16:49.129640+0000","last_clean":"2024-04-25T13:16:49.129640+0000","last_became_active":"2024-04-25T13:16:06.995957+0000","last_became_peered":"2024-04-25T13:16:06.995957+0000","last_unstale":"2024-04-25T13:16:49.129640+0000","last_undegraded":"2024-04-25T13:16:49.129640+0000","last_fullsized":"2024-04-25T13:16:49.129640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:16.802775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129020+0000","last_change":"2024-04-25T13:16:12.040987+0000","last_active":"2024-04-25T13:16:49.129020+0000","last_peered":"2024-04-25T13:16:49.129020+0000","last_clean":"2024-04-25T13:16:49.129020+0000","last_became_active":"2024-04-25T13:16:12.039987+0000","last_became_peered":"2024-04-25T13:16:12.039987+0000","last_unstale":"2024-04-25T13:16:49.129020+0000","last_undegraded":"2024-04-25T13:16:49.129020+0000","last_fullsized":"2024-04-25T13:16:49.129020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:40.366718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133323+0000","last_change":"2024-04-25T13:16:08.002876+0000","last_active":"2024-04-25T13:16:49.133323+0000","last_peered":"2024-04-25T13:16:49.133323+0000","last_clean":"2024-04-25T13:16:49.133323+0000","last_became_active":"2024-04-25T13:16:08.002131+0000","last_became_peered":"2024-04-25T13:16:08.002131+0000","last_unstale":"2024-04-25T13:16:49.133323+0000","last_undegraded":"2024-04-25T13:16:49.133323+0000","last_fullsized":"2024-04-25T13:16:49.133323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:09.646849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.150771+0000","last_change":"2024-04-25T13:16:06.990075+0000","last_active":"2024-04-25T13:16:56.150771+0000","last_peered":"2024-04-25T13:16:56.150771+0000","last_clean":"2024-04-25T13:16:56.150771+0000","last_became_active":"2024-04-25T13:16:06.989652+0000","last_became_peered":"2024-04-25T13:16:06.989652+0000","last_unstale":"2024-04-25T13:16:56.150771+0000","last_undegraded":"2024-04-25T13:16:56.150771+0000","last_fullsized":"2024-04-25T13:16:56.150771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:29.378995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129361+0000","last_change":"2024-04-25T13:16:12.032906+0000","last_active":"2024-04-25T13:16:49.129361+0000","last_peered":"2024-04-25T13:16:49.129361+0000","last_clean":"2024-04-25T13:16:49.129361+0000","last_became_active":"2024-04-25T13:16:12.032184+0000","last_became_peered":"2024-04-25T13:16:12.032184+0000","last_unstale":"2024-04-25T13:16:49.129361+0000","last_undegraded":"2024-04-25T13:16:49.129361+0000","last_fullsized":"2024-04-25T13:16:49.129361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.724927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.128917+0000","last_change":"2024-04-25T13:16:07.997173+0000","last_active":"2024-04-25T13:16:49.128917+0000","last_peered":"2024-04-25T13:16:49.128917+0000","last_clean":"2024-04-25T13:16:49.128917+0000","last_became_active":"2024-04-25T13:16:07.996545+0000","last_became_peered":"2024-04-25T13:16:07.996545+0000","last_unstale":"2024-04-25T13:16:49.128917+0000","last_undegraded":"2024-04-25T13:16:49.128917+0000","last_fullsized":"2024-04-25T13:16:49.128917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:28.902563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.147729+0000","last_change":"2024-04-25T13:16:06.993674+0000","last_active":"2024-04-25T13:16:56.147729+0000","last_peered":"2024-04-25T13:16:56.147729+0000","last_clean":"2024-04-25T13:16:56.147729+0000","last_became_active":"2024-04-25T13:16:06.993387+0000","last_became_peered":"2024-04-25T13:16:06.993387+0000","last_unstale":"2024-04-25T13:16:56.147729+0000","last_undegraded":"2024-04-25T13:16:56.147729+0000","last_fullsized":"2024-04-25T13:16:56.147729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:13.104822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.238099+0000","last_change":"2024-04-25T13:16:49.237386+0000","last_active":"2024-04-25T13:16:49.238099+0000","last_peered":"2024-04-25T13:16:49.238099+0000","last_clean":"2024-04-25T13:16:49.238099+0000","last_became_active":"2024-04-25T13:16:49.236873+0000","last_became_peered":"2024-04-25T13:16:49.236873+0000","last_unstale":"2024-04-25T13:16:49.238099+0000","last_undegraded":"2024-04-25T13:16:49.238099+0000","last_fullsized":"2024-04-25T13:16:49.238099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:58.580330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133201+0000","last_change":"2024-04-25T13:16:08.004209+0000","last_active":"2024-04-25T13:16:49.133201+0000","last_peered":"2024-04-25T13:16:49.133201+0000","last_clean":"2024-04-25T13:16:49.133201+0000","last_became_active":"2024-04-25T13:16:08.003908+0000","last_became_peered":"2024-04-25T13:16:08.003908+0000","last_unstale":"2024-04-25T13:16:49.133201+0000","last_undegraded":"2024-04-25T13:16:49.133201+0000","last_fullsized":"2024-04-25T13:16:49.133201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:17.027888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130018+0000","last_change":"2024-04-25T13:16:06.999384+0000","last_active":"2024-04-25T13:16:49.130018+0000","last_peered":"2024-04-25T13:16:49.130018+0000","last_clean":"2024-04-25T13:16:49.130018+0000","last_became_active":"2024-04-25T13:16:06.999126+0000","last_became_peered":"2024-04-25T13:16:06.999126+0000","last_unstale":"2024-04-25T13:16:49.130018+0000","last_undegraded":"2024-04-25T13:16:49.130018+0000","last_fullsized":"2024-04-25T13:16:49.130018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:50.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134406+0000","last_change":"2024-04-25T13:16:12.733992+0000","last_active":"2024-04-25T13:16:49.134406+0000","last_peered":"2024-04-25T13:16:49.134406+0000","last_clean":"2024-04-25T13:16:49.134406+0000","last_became_active":"2024-04-25T13:16:12.733316+0000","last_became_peered":"2024-04-25T13:16:12.733316+0000","last_unstale":"2024-04-25T13:16:49.134406+0000","last_undegraded":"2024-04-25T13:16:49.134406+0000","last_fullsized":"2024-04-25T13:16:49.134406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:54.246728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235445+0000","last_change":"2024-04-25T13:16:08.021617+0000","last_active":"2024-04-25T13:16:49.235445+0000","last_peered":"2024-04-25T13:16:49.235445+0000","last_clean":"2024-04-25T13:16:49.235445+0000","last_became_active":"2024-04-25T13:16:08.021346+0000","last_became_peered":"2024-04-25T13:16:08.021346+0000","last_unstale":"2024-04-25T13:16:49.235445+0000","last_undegraded":"2024-04-25T13:16:49.235445+0000","last_fullsized":"2024-04-25T13:16:49.235445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:10.013805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.131254+0000","last_change":"2024-04-25T13:16:06.990638+0000","last_active":"2024-04-25T13:16:51.131254+0000","last_peered":"2024-04-25T13:16:51.131254+0000","last_clean":"2024-04-25T13:16:51.131254+0000","last_became_active":"2024-04-25T13:16:06.990379+0000","last_became_peered":"2024-04-25T13:16:06.990379+0000","last_unstale":"2024-04-25T13:16:51.131254+0000","last_undegraded":"2024-04-25T13:16:51.131254+0000","last_fullsized":"2024-04-25T13:16:51.131254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:39.385990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130081+0000","last_change":"2024-04-25T13:15:57.168598+0000","last_active":"2024-04-25T13:16:49.130081+0000","last_peered":"2024-04-25T13:16:49.130081+0000","last_clean":"2024-04-25T13:16:49.130081+0000","last_became_active":"2024-04-25T13:15:57.167692+0000","last_became_peered":"2024-04-25T13:15:57.167692+0000","last_unstale":"2024-04-25T13:16:49.130081+0000","last_undegraded":"2024-04-25T13:16:49.130081+0000","last_fullsized":"2024-04-25T13:16:49.130081+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_clean_scrub_stamp":"2024-04-25T13:15:55.844647+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:29.123100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235646+0000","last_change":"2024-04-25T13:16:12.734712+0000","last_active":"2024-04-25T13:16:49.235646+0000","last_peered":"2024-04-25T13:16:49.235646+0000","last_clean":"2024-04-25T13:16:49.235646+0000","last_became_active":"2024-04-25T13:16:12.734288+0000","last_became_peered":"2024-04-25T13:16:12.734288+0000","last_unstale":"2024-04-25T13:16:49.235646+0000","last_undegraded":"2024-04-25T13:16:49.235646+0000","last_fullsized":"2024-04-25T13:16:49.235646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:45.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131327+0000","last_change":"2024-04-25T13:16:08.014279+0000","last_active":"2024-04-25T13:16:49.131327+0000","last_peered":"2024-04-25T13:16:49.131327+0000","last_clean":"2024-04-25T13:16:49.131327+0000","last_became_active":"2024-04-25T13:16:08.013989+0000","last_became_peered":"2024-04-25T13:16:08.013989+0000","last_unstale":"2024-04-25T13:16:49.131327+0000","last_undegraded":"2024-04-25T13:16:49.131327+0000","last_fullsized":"2024-04-25T13:16:49.131327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:54.411981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.515732+0000","last_change":"2024-04-25T13:16:06.996774+0000","last_active":"2024-04-25T13:17:04.515732+0000","last_peered":"2024-04-25T13:17:04.515732+0000","last_clean":"2024-04-25T13:17:04.515732+0000","last_became_active":"2024-04-25T13:16:06.996251+0000","last_became_peered":"2024-04-25T13:16:06.996251+0000","last_unstale":"2024-04-25T13:17:04.515732+0000","last_undegraded":"2024-04-25T13:17:04.515732+0000","last_fullsized":"2024-04-25T13:17:04.515732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:01.815602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235463+0000","last_change":"2024-04-25T13:16:12.733562+0000","last_active":"2024-04-25T13:16:49.235463+0000","last_peered":"2024-04-25T13:16:49.235463+0000","last_clean":"2024-04-25T13:16:49.235463+0000","last_became_active":"2024-04-25T13:16:12.733114+0000","last_became_peered":"2024-04-25T13:16:12.733114+0000","last_unstale":"2024-04-25T13:16:49.235463+0000","last_undegraded":"2024-04-25T13:16:49.235463+0000","last_fullsized":"2024-04-25T13:16:49.235463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:20.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131209+0000","last_change":"2024-04-25T13:16:08.011389+0000","last_active":"2024-04-25T13:16:49.131209+0000","last_peered":"2024-04-25T13:16:49.131209+0000","last_clean":"2024-04-25T13:16:49.131209+0000","last_became_active":"2024-04-25T13:16:08.011113+0000","last_became_peered":"2024-04-25T13:16:08.011113+0000","last_unstale":"2024-04-25T13:16:49.131209+0000","last_undegraded":"2024-04-25T13:16:49.131209+0000","last_fullsized":"2024-04-25T13:16:49.131209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:12.339487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.130312+0000","last_change":"2024-04-25T13:16:06.988988+0000","last_active":"2024-04-25T13:16:51.130312+0000","last_peered":"2024-04-25T13:16:51.130312+0000","last_clean":"2024-04-25T13:16:51.130312+0000","last_became_active":"2024-04-25T13:16:06.988631+0000","last_became_peered":"2024-04-25T13:16:06.988631+0000","last_unstale":"2024-04-25T13:16:51.130312+0000","last_undegraded":"2024-04-25T13:16:51.130312+0000","last_fullsized":"2024-04-25T13:16:51.130312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:47.056977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134845+0000","last_change":"2024-04-25T13:16:12.047194+0000","last_active":"2024-04-25T13:16:49.134845+0000","last_peered":"2024-04-25T13:16:49.134845+0000","last_clean":"2024-04-25T13:16:49.134845+0000","last_became_active":"2024-04-25T13:16:12.046780+0000","last_became_peered":"2024-04-25T13:16:12.046780+0000","last_unstale":"2024-04-25T13:16:49.134845+0000","last_undegraded":"2024-04-25T13:16:49.134845+0000","last_fullsized":"2024-04-25T13:16:49.134845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:41.664409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131701+0000","last_change":"2024-04-25T13:16:08.007925+0000","last_active":"2024-04-25T13:16:49.131701+0000","last_peered":"2024-04-25T13:16:49.131701+0000","last_clean":"2024-04-25T13:16:49.131701+0000","last_became_active":"2024-04-25T13:16:08.007681+0000","last_became_peered":"2024-04-25T13:16:08.007681+0000","last_unstale":"2024-04-25T13:16:49.131701+0000","last_undegraded":"2024-04-25T13:16:49.131701+0000","last_fullsized":"2024-04-25T13:16:49.131701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:29.601564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.147255+0000","last_change":"2024-04-25T13:16:06.991912+0000","last_active":"2024-04-25T13:16:56.147255+0000","last_peered":"2024-04-25T13:16:56.147255+0000","last_clean":"2024-04-25T13:16:56.147255+0000","last_became_active":"2024-04-25T13:16:06.991578+0000","last_became_peered":"2024-04-25T13:16:06.991578+0000","last_unstale":"2024-04-25T13:16:56.147255+0000","last_undegraded":"2024-04-25T13:16:56.147255+0000","last_fullsized":"2024-04-25T13:16:56.147255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:59.364396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129381+0000","last_change":"2024-04-25T13:16:12.733567+0000","last_active":"2024-04-25T13:16:49.129381+0000","last_peered":"2024-04-25T13:16:49.129381+0000","last_clean":"2024-04-25T13:16:49.129381+0000","last_became_active":"2024-04-25T13:16:12.733136+0000","last_became_peered":"2024-04-25T13:16:12.733136+0000","last_unstale":"2024-04-25T13:16:49.129381+0000","last_undegraded":"2024-04-25T13:16:49.129381+0000","last_fullsized":"2024-04-25T13:16:49.129381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:29.125928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131176+0000","last_change":"2024-04-25T13:16:08.004897+0000","last_active":"2024-04-25T13:16:49.131176+0000","last_peered":"2024-04-25T13:16:49.131176+0000","last_clean":"2024-04-25T13:16:49.131176+0000","last_became_active":"2024-04-25T13:16:08.004180+0000","last_became_peered":"2024-04-25T13:16:08.004180+0000","last_unstale":"2024-04-25T13:16:49.131176+0000","last_undegraded":"2024-04-25T13:16:49.131176+0000","last_fullsized":"2024-04-25T13:16:49.131176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:12.011447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132694+0000","last_change":"2024-04-25T13:16:06.994487+0000","last_active":"2024-04-25T13:16:49.132694+0000","last_peered":"2024-04-25T13:16:49.132694+0000","last_clean":"2024-04-25T13:16:49.132694+0000","last_became_active":"2024-04-25T13:16:06.994235+0000","last_became_peered":"2024-04-25T13:16:06.994235+0000","last_unstale":"2024-04-25T13:16:49.132694+0000","last_undegraded":"2024-04-25T13:16:49.132694+0000","last_fullsized":"2024-04-25T13:16:49.132694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131872+0000","last_change":"2024-04-25T13:16:12.039277+0000","last_active":"2024-04-25T13:16:49.131872+0000","last_peered":"2024-04-25T13:16:49.131872+0000","last_clean":"2024-04-25T13:16:49.131872+0000","last_became_active":"2024-04-25T13:16:12.038534+0000","last_became_peered":"2024-04-25T13:16:12.038534+0000","last_unstale":"2024-04-25T13:16:49.131872+0000","last_undegraded":"2024-04-25T13:16:49.131872+0000","last_fullsized":"2024-04-25T13:16:49.131872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:59.495976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130166+0000","last_change":"2024-04-25T13:16:08.007302+0000","last_active":"2024-04-25T13:16:49.130166+0000","last_peered":"2024-04-25T13:16:49.130166+0000","last_clean":"2024-04-25T13:16:49.130166+0000","last_became_active":"2024-04-25T13:16:08.007050+0000","last_became_peered":"2024-04-25T13:16:08.007050+0000","last_unstale":"2024-04-25T13:16:49.130166+0000","last_undegraded":"2024-04-25T13:16:49.130166+0000","last_fullsized":"2024-04-25T13:16:49.130166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:35.369188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.131068+0000","last_change":"2024-04-25T13:16:06.982609+0000","last_active":"2024-04-25T13:16:51.131068+0000","last_peered":"2024-04-25T13:16:51.131068+0000","last_clean":"2024-04-25T13:16:51.131068+0000","last_became_active":"2024-04-25T13:16:06.982320+0000","last_became_peered":"2024-04-25T13:16:06.982320+0000","last_unstale":"2024-04-25T13:16:51.131068+0000","last_undegraded":"2024-04-25T13:16:51.131068+0000","last_fullsized":"2024-04-25T13:16:51.131068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:55.372968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134321+0000","last_change":"2024-04-25T13:16:12.043657+0000","last_active":"2024-04-25T13:16:49.134321+0000","last_peered":"2024-04-25T13:16:49.134321+0000","last_clean":"2024-04-25T13:16:49.134321+0000","last_became_active":"2024-04-25T13:16:12.042902+0000","last_became_peered":"2024-04-25T13:16:12.042902+0000","last_unstale":"2024-04-25T13:16:49.134321+0000","last_undegraded":"2024-04-25T13:16:49.134321+0000","last_fullsized":"2024-04-25T13:16:49.134321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:46.721199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236046+0000","last_change":"2024-04-25T13:16:08.008534+0000","last_active":"2024-04-25T13:16:49.236046+0000","last_peered":"2024-04-25T13:16:49.236046+0000","last_clean":"2024-04-25T13:16:49.236046+0000","last_became_active":"2024-04-25T13:16:08.008102+0000","last_became_peered":"2024-04-25T13:16:08.008102+0000","last_unstale":"2024-04-25T13:16:49.236046+0000","last_undegraded":"2024-04-25T13:16:49.236046+0000","last_fullsized":"2024-04-25T13:16:49.236046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:48.331724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.520370+0000","last_change":"2024-04-25T13:16:06.993292+0000","last_active":"2024-04-25T13:17:04.520370+0000","last_peered":"2024-04-25T13:17:04.520370+0000","last_clean":"2024-04-25T13:17:04.520370+0000","last_became_active":"2024-04-25T13:16:06.993008+0000","last_became_peered":"2024-04-25T13:16:06.993008+0000","last_unstale":"2024-04-25T13:17:04.520370+0000","last_undegraded":"2024-04-25T13:17:04.520370+0000","last_fullsized":"2024-04-25T13:17:04.520370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236165+0000","last_change":"2024-04-25T13:16:12.733945+0000","last_active":"2024-04-25T13:16:49.236165+0000","last_peered":"2024-04-25T13:16:49.236165+0000","last_clean":"2024-04-25T13:16:49.236165+0000","last_became_active":"2024-04-25T13:16:12.733359+0000","last_became_peered":"2024-04-25T13:16:12.733359+0000","last_unstale":"2024-04-25T13:16:49.236165+0000","last_undegraded":"2024-04-25T13:16:49.236165+0000","last_fullsized":"2024-04-25T13:16:49.236165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:27.352613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131189+0000","last_change":"2024-04-25T13:16:08.008034+0000","last_active":"2024-04-25T13:16:49.131189+0000","last_peered":"2024-04-25T13:16:49.131189+0000","last_clean":"2024-04-25T13:16:49.131189+0000","last_became_active":"2024-04-25T13:16:08.007790+0000","last_became_peered":"2024-04-25T13:16:08.007790+0000","last_unstale":"2024-04-25T13:16:49.131189+0000","last_undegraded":"2024-04-25T13:16:49.131189+0000","last_fullsized":"2024-04-25T13:16:49.131189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:35.903237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.130884+0000","last_change":"2024-04-25T13:16:06.996737+0000","last_active":"2024-04-25T13:16:51.130884+0000","last_peered":"2024-04-25T13:16:51.130884+0000","last_clean":"2024-04-25T13:16:51.130884+0000","last_became_active":"2024-04-25T13:16:06.996439+0000","last_became_peered":"2024-04-25T13:16:06.996439+0000","last_unstale":"2024-04-25T13:16:51.130884+0000","last_undegraded":"2024-04-25T13:16:51.130884+0000","last_fullsized":"2024-04-25T13:16:51.130884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:36.400030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235760+0000","last_change":"2024-04-25T13:16:12.734393+0000","last_active":"2024-04-25T13:16:49.235760+0000","last_peered":"2024-04-25T13:16:49.235760+0000","last_clean":"2024-04-25T13:16:49.235760+0000","last_became_active":"2024-04-25T13:16:12.733328+0000","last_became_peered":"2024-04-25T13:16:12.733328+0000","last_unstale":"2024-04-25T13:16:49.235760+0000","last_undegraded":"2024-04-25T13:16:49.235760+0000","last_fullsized":"2024-04-25T13:16:49.235760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.254012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.136838+0000","last_change":"2024-04-25T13:16:49.135983+0000","last_active":"2024-04-25T13:16:49.136838+0000","last_peered":"2024-04-25T13:16:49.136838+0000","last_clean":"2024-04-25T13:16:49.136838+0000","last_became_active":"2024-04-25T13:16:49.135704+0000","last_became_peered":"2024-04-25T13:16:49.135704+0000","last_unstale":"2024-04-25T13:16:49.136838+0000","last_undegraded":"2024-04-25T13:16:49.136838+0000","last_fullsized":"2024-04-25T13:16:49.136838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:22.268728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.150750+0000","last_change":"2024-04-25T13:16:07.000559+0000","last_active":"2024-04-25T13:16:56.150750+0000","last_peered":"2024-04-25T13:16:56.150750+0000","last_clean":"2024-04-25T13:16:56.150750+0000","last_became_active":"2024-04-25T13:16:07.000243+0000","last_became_peered":"2024-04-25T13:16:07.000243+0000","last_unstale":"2024-04-25T13:16:56.150750+0000","last_undegraded":"2024-04-25T13:16:56.150750+0000","last_fullsized":"2024-04-25T13:16:56.150750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:01.672221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130148+0000","last_change":"2024-04-25T13:16:12.733681+0000","last_active":"2024-04-25T13:16:49.130148+0000","last_peered":"2024-04-25T13:16:49.130148+0000","last_clean":"2024-04-25T13:16:49.130148+0000","last_became_active":"2024-04-25T13:16:12.733245+0000","last_became_peered":"2024-04-25T13:16:12.733245+0000","last_unstale":"2024-04-25T13:16:49.130148+0000","last_undegraded":"2024-04-25T13:16:49.130148+0000","last_fullsized":"2024-04-25T13:16:49.130148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.028858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131242+0000","last_change":"2024-04-25T13:16:08.008790+0000","last_active":"2024-04-25T13:16:49.131242+0000","last_peered":"2024-04-25T13:16:49.131242+0000","last_clean":"2024-04-25T13:16:49.131242+0000","last_became_active":"2024-04-25T13:16:08.008530+0000","last_became_peered":"2024-04-25T13:16:08.008530+0000","last_unstale":"2024-04-25T13:16:49.131242+0000","last_undegraded":"2024-04-25T13:16:49.131242+0000","last_fullsized":"2024-04-25T13:16:49.131242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:44.215930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.525527+0000","last_change":"2024-04-25T13:16:06.997575+0000","last_active":"2024-04-25T13:17:04.525527+0000","last_peered":"2024-04-25T13:17:04.525527+0000","last_clean":"2024-04-25T13:17:04.525527+0000","last_became_active":"2024-04-25T13:16:06.997289+0000","last_became_peered":"2024-04-25T13:16:06.997289+0000","last_unstale":"2024-04-25T13:17:04.525527+0000","last_undegraded":"2024-04-25T13:17:04.525527+0000","last_fullsized":"2024-04-25T13:17:04.525527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:54.096662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129133+0000","last_change":"2024-04-25T13:16:12.040456+0000","last_active":"2024-04-25T13:16:49.129133+0000","last_peered":"2024-04-25T13:16:49.129133+0000","last_clean":"2024-04-25T13:16:49.129133+0000","last_became_active":"2024-04-25T13:16:12.039443+0000","last_became_peered":"2024-04-25T13:16:12.039443+0000","last_unstale":"2024-04-25T13:16:49.129133+0000","last_undegraded":"2024-04-25T13:16:49.129133+0000","last_fullsized":"2024-04-25T13:16:49.129133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:23.192500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132567+0000","last_change":"2024-04-25T13:16:08.004618+0000","last_active":"2024-04-25T13:16:49.132567+0000","last_peered":"2024-04-25T13:16:49.132567+0000","last_clean":"2024-04-25T13:16:49.132567+0000","last_became_active":"2024-04-25T13:16:08.002583+0000","last_became_peered":"2024-04-25T13:16:08.002583+0000","last_unstale":"2024-04-25T13:16:49.132567+0000","last_undegraded":"2024-04-25T13:16:49.132567+0000","last_fullsized":"2024-04-25T13:16:49.132567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:25.609409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129519+0000","last_change":"2024-04-25T13:16:06.996610+0000","last_active":"2024-04-25T13:16:49.129519+0000","last_peered":"2024-04-25T13:16:49.129519+0000","last_clean":"2024-04-25T13:16:49.129519+0000","last_became_active":"2024-04-25T13:16:06.995616+0000","last_became_peered":"2024-04-25T13:16:06.995616+0000","last_unstale":"2024-04-25T13:16:49.129519+0000","last_undegraded":"2024-04-25T13:16:49.129519+0000","last_fullsized":"2024-04-25T13:16:49.129519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:21.135053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133232+0000","last_change":"2024-04-25T13:16:12.043744+0000","last_active":"2024-04-25T13:16:49.133232+0000","last_peered":"2024-04-25T13:16:49.133232+0000","last_clean":"2024-04-25T13:16:49.133232+0000","last_became_active":"2024-04-25T13:16:12.043267+0000","last_became_peered":"2024-04-25T13:16:12.043267+0000","last_unstale":"2024-04-25T13:16:49.133232+0000","last_undegraded":"2024-04-25T13:16:49.133232+0000","last_fullsized":"2024-04-25T13:16:49.133232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:52.316751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.137097+0000","last_change":"2024-04-25T13:16:49.137097+0000","last_active":"2024-04-25T13:16:49.137097+0000","last_peered":"2024-04-25T13:16:49.137097+0000","last_clean":"2024-04-25T13:16:49.137097+0000","last_became_active":"2024-04-25T13:16:49.136773+0000","last_became_peered":"2024-04-25T13:16:49.136773+0000","last_unstale":"2024-04-25T13:16:49.137097+0000","last_undegraded":"2024-04-25T13:16:49.137097+0000","last_fullsized":"2024-04-25T13:16:49.137097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:56.580060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.148921+0000","last_change":"2024-04-25T13:16:06.997061+0000","last_active":"2024-04-25T13:16:56.148921+0000","last_peered":"2024-04-25T13:16:56.148921+0000","last_clean":"2024-04-25T13:16:56.148921+0000","last_became_active":"2024-04-25T13:16:06.996418+0000","last_became_peered":"2024-04-25T13:16:06.996418+0000","last_unstale":"2024-04-25T13:16:56.148921+0000","last_undegraded":"2024-04-25T13:16:56.148921+0000","last_fullsized":"2024-04-25T13:16:56.148921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:34.878260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236082+0000","last_change":"2024-04-25T13:16:12.042796+0000","last_active":"2024-04-25T13:16:49.236082+0000","last_peered":"2024-04-25T13:16:49.236082+0000","last_clean":"2024-04-25T13:16:49.236082+0000","last_became_active":"2024-04-25T13:16:12.042252+0000","last_became_peered":"2024-04-25T13:16:12.042252+0000","last_unstale":"2024-04-25T13:16:49.236082+0000","last_undegraded":"2024-04-25T13:16:49.236082+0000","last_fullsized":"2024-04-25T13:16:49.236082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:51.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130623+0000","last_change":"2024-04-25T13:16:08.016203+0000","last_active":"2024-04-25T13:16:49.130623+0000","last_peered":"2024-04-25T13:16:49.130623+0000","last_clean":"2024-04-25T13:16:49.130623+0000","last_became_active":"2024-04-25T13:16:08.015820+0000","last_became_peered":"2024-04-25T13:16:08.015820+0000","last_unstale":"2024-04-25T13:16:49.130623+0000","last_undegraded":"2024-04-25T13:16:49.130623+0000","last_fullsized":"2024-04-25T13:16:49.130623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.518227+0000","last_change":"2024-04-25T13:16:06.996624+0000","last_active":"2024-04-25T13:17:04.518227+0000","last_peered":"2024-04-25T13:17:04.518227+0000","last_clean":"2024-04-25T13:17:04.518227+0000","last_became_active":"2024-04-25T13:16:06.996373+0000","last_became_peered":"2024-04-25T13:16:06.996373+0000","last_unstale":"2024-04-25T13:17:04.518227+0000","last_undegraded":"2024-04-25T13:17:04.518227+0000","last_fullsized":"2024-04-25T13:17:04.518227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:29.929030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235595+0000","last_change":"2024-04-25T13:16:12.733792+0000","last_active":"2024-04-25T13:16:49.235595+0000","last_peered":"2024-04-25T13:16:49.235595+0000","last_clean":"2024-04-25T13:16:49.235595+0000","last_became_active":"2024-04-25T13:16:12.733314+0000","last_became_peered":"2024-04-25T13:16:12.733314+0000","last_unstale":"2024-04-25T13:16:49.235595+0000","last_undegraded":"2024-04-25T13:16:49.235595+0000","last_fullsized":"2024-04-25T13:16:49.235595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.836368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134224+0000","last_change":"2024-04-25T13:16:12.734573+0000","last_active":"2024-04-25T13:16:49.134224+0000","last_peered":"2024-04-25T13:16:49.134224+0000","last_clean":"2024-04-25T13:16:49.134224+0000","last_became_active":"2024-04-25T13:16:12.733908+0000","last_became_peered":"2024-04-25T13:16:12.733908+0000","last_unstale":"2024-04-25T13:16:49.134224+0000","last_undegraded":"2024-04-25T13:16:49.134224+0000","last_fullsized":"2024-04-25T13:16:49.134224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:59.673528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.128734+0000","last_change":"2024-04-25T13:16:08.008915+0000","last_active":"2024-04-25T13:16:49.128734+0000","last_peered":"2024-04-25T13:16:49.128734+0000","last_clean":"2024-04-25T13:16:49.128734+0000","last_became_active":"2024-04-25T13:16:08.008586+0000","last_became_peered":"2024-04-25T13:16:08.008586+0000","last_unstale":"2024-04-25T13:16:49.128734+0000","last_undegraded":"2024-04-25T13:16:49.128734+0000","last_fullsized":"2024-04-25T13:16:49.128734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:46.905065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.132985+0000","last_change":"2024-04-25T13:16:06.994489+0000","last_active":"2024-04-25T13:16:51.132985+0000","last_peered":"2024-04-25T13:16:51.132985+0000","last_clean":"2024-04-25T13:16:51.132985+0000","last_became_active":"2024-04-25T13:16:06.994005+0000","last_became_peered":"2024-04-25T13:16:06.994005+0000","last_unstale":"2024-04-25T13:16:51.132985+0000","last_undegraded":"2024-04-25T13:16:51.132985+0000","last_fullsized":"2024-04-25T13:16:51.132985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:43.921452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235786+0000","last_change":"2024-04-25T13:16:12.037008+0000","last_active":"2024-04-25T13:16:49.235786+0000","last_peered":"2024-04-25T13:16:49.235786+0000","last_clean":"2024-04-25T13:16:49.235786+0000","last_became_active":"2024-04-25T13:16:12.036569+0000","last_became_peered":"2024-04-25T13:16:12.036569+0000","last_unstale":"2024-04-25T13:16:49.235786+0000","last_undegraded":"2024-04-25T13:16:49.235786+0000","last_fullsized":"2024-04-25T13:16:49.235786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:48.224913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236198+0000","last_change":"2024-04-25T13:16:08.008747+0000","last_active":"2024-04-25T13:16:49.236198+0000","last_peered":"2024-04-25T13:16:49.236198+0000","last_clean":"2024-04-25T13:16:49.236198+0000","last_became_active":"2024-04-25T13:16:08.008078+0000","last_became_peered":"2024-04-25T13:16:08.008078+0000","last_unstale":"2024-04-25T13:16:49.236198+0000","last_undegraded":"2024-04-25T13:16:49.236198+0000","last_fullsized":"2024-04-25T13:16:49.236198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:19.590099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236018+0000","last_change":"2024-04-25T13:16:06.997642+0000","last_active":"2024-04-25T13:16:49.236018+0000","last_peered":"2024-04-25T13:16:49.236018+0000","last_clean":"2024-04-25T13:16:49.236018+0000","last_became_active":"2024-04-25T13:16:06.996985+0000","last_became_peered":"2024-04-25T13:16:06.996985+0000","last_unstale":"2024-04-25T13:16:49.236018+0000","last_undegraded":"2024-04-25T13:16:49.236018+0000","last_fullsized":"2024-04-25T13:16:49.236018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:49.853125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.133935+0000","last_change":"2024-04-25T13:16:06.992687+0000","last_active":"2024-04-25T13:16:51.133935+0000","last_peered":"2024-04-25T13:16:51.133935+0000","last_clean":"2024-04-25T13:16:51.133935+0000","last_became_active":"2024-04-25T13:16:06.992407+0000","last_became_peered":"2024-04-25T13:16:06.992407+0000","last_unstale":"2024-04-25T13:16:51.133935+0000","last_undegraded":"2024-04-25T13:16:51.133935+0000","last_fullsized":"2024-04-25T13:16:51.133935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:37.658458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134927+0000","last_change":"2024-04-25T13:16:08.004510+0000","last_active":"2024-04-25T13:16:49.134927+0000","last_peered":"2024-04-25T13:16:49.134927+0000","last_clean":"2024-04-25T13:16:49.134927+0000","last_became_active":"2024-04-25T13:16:08.003959+0000","last_became_peered":"2024-04-25T13:16:08.003959+0000","last_unstale":"2024-04-25T13:16:49.134927+0000","last_undegraded":"2024-04-25T13:16:49.134927+0000","last_fullsized":"2024-04-25T13:16:49.134927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:45.142873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131981+0000","last_change":"2024-04-25T13:16:12.037097+0000","last_active":"2024-04-25T13:16:49.131981+0000","last_peered":"2024-04-25T13:16:49.131981+0000","last_clean":"2024-04-25T13:16:49.131981+0000","last_became_active":"2024-04-25T13:16:12.036651+0000","last_became_peered":"2024-04-25T13:16:12.036651+0000","last_unstale":"2024-04-25T13:16:49.131981+0000","last_undegraded":"2024-04-25T13:16:49.131981+0000","last_fullsized":"2024-04-25T13:16:49.131981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:34.443514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.518175+0000","last_change":"2024-04-25T13:16:06.996311+0000","last_active":"2024-04-25T13:17:04.518175+0000","last_peered":"2024-04-25T13:17:04.518175+0000","last_clean":"2024-04-25T13:17:04.518175+0000","last_became_active":"2024-04-25T13:16:06.996010+0000","last_became_peered":"2024-04-25T13:16:06.996010+0000","last_unstale":"2024-04-25T13:17:04.518175+0000","last_undegraded":"2024-04-25T13:17:04.518175+0000","last_fullsized":"2024-04-25T13:17:04.518175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:08.835482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132357+0000","last_change":"2024-04-25T13:16:08.002159+0000","last_active":"2024-04-25T13:16:49.132357+0000","last_peered":"2024-04-25T13:16:49.132357+0000","last_clean":"2024-04-25T13:16:49.132357+0000","last_became_active":"2024-04-25T13:16:08.001833+0000","last_became_peered":"2024-04-25T13:16:08.001833+0000","last_unstale":"2024-04-25T13:16:49.132357+0000","last_undegraded":"2024-04-25T13:16:49.132357+0000","last_fullsized":"2024-04-25T13:16:49.132357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:25.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236270+0000","last_change":"2024-04-25T13:16:12.042721+0000","last_active":"2024-04-25T13:16:49.236270+0000","last_peered":"2024-04-25T13:16:49.236270+0000","last_clean":"2024-04-25T13:16:49.236270+0000","last_became_active":"2024-04-25T13:16:12.042000+0000","last_became_peered":"2024-04-25T13:16:12.042000+0000","last_unstale":"2024-04-25T13:16:49.236270+0000","last_undegraded":"2024-04-25T13:16:49.236270+0000","last_fullsized":"2024-04-25T13:16:49.236270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:18.702032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235823+0000","last_change":"2024-04-25T13:16:08.008364+0000","last_active":"2024-04-25T13:16:49.235823+0000","last_peered":"2024-04-25T13:16:49.235823+0000","last_clean":"2024-04-25T13:16:49.235823+0000","last_became_active":"2024-04-25T13:16:08.007728+0000","last_became_peered":"2024-04-25T13:16:08.007728+0000","last_unstale":"2024-04-25T13:16:49.235823+0000","last_undegraded":"2024-04-25T13:16:49.235823+0000","last_fullsized":"2024-04-25T13:16:49.235823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:08.731178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131539+0000","last_change":"2024-04-25T13:16:08.011273+0000","last_active":"2024-04-25T13:16:49.131539+0000","last_peered":"2024-04-25T13:16:49.131539+0000","last_clean":"2024-04-25T13:16:49.131539+0000","last_became_active":"2024-04-25T13:16:08.010981+0000","last_became_peered":"2024-04-25T13:16:08.010981+0000","last_unstale":"2024-04-25T13:16:49.131539+0000","last_undegraded":"2024-04-25T13:16:49.131539+0000","last_fullsized":"2024-04-25T13:16:49.131539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:03.835422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130170+0000","last_change":"2024-04-25T13:16:08.016413+0000","last_active":"2024-04-25T13:16:49.130170+0000","last_peered":"2024-04-25T13:16:49.130170+0000","last_clean":"2024-04-25T13:16:49.130170+0000","last_became_active":"2024-04-25T13:16:08.016084+0000","last_became_peered":"2024-04-25T13:16:08.016084+0000","last_unstale":"2024-04-25T13:16:49.130170+0000","last_undegraded":"2024-04-25T13:16:49.130170+0000","last_fullsized":"2024-04-25T13:16:49.130170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:41.014999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.138094+0000","last_change":"2024-04-25T13:16:49.138094+0000","last_active":"2024-04-25T13:16:49.138094+0000","last_peered":"2024-04-25T13:16:49.138094+0000","last_clean":"2024-04-25T13:16:49.138094+0000","last_became_active":"2024-04-25T13:16:49.137825+0000","last_became_peered":"2024-04-25T13:16:49.137825+0000","last_unstale":"2024-04-25T13:16:49.138094+0000","last_undegraded":"2024-04-25T13:16:49.138094+0000","last_fullsized":"2024-04-25T13:16:49.138094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:52.534923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236041+0000","last_change":"2024-04-25T13:16:08.012814+0000","last_active":"2024-04-25T13:16:49.236041+0000","last_peered":"2024-04-25T13:16:49.236041+0000","last_clean":"2024-04-25T13:16:49.236041+0000","last_became_active":"2024-04-25T13:16:08.012481+0000","last_became_peered":"2024-04-25T13:16:08.012481+0000","last_unstale":"2024-04-25T13:16:49.236041+0000","last_undegraded":"2024-04-25T13:16:49.236041+0000","last_fullsized":"2024-04-25T13:16:49.236041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:05.409701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129200+0000","last_change":"2024-04-25T13:16:08.008843+0000","last_active":"2024-04-25T13:16:49.129200+0000","last_peered":"2024-04-25T13:16:49.129200+0000","last_clean":"2024-04-25T13:16:49.129200+0000","last_became_active":"2024-04-25T13:16:08.008489+0000","last_became_peered":"2024-04-25T13:16:08.008489+0000","last_unstale":"2024-04-25T13:16:49.129200+0000","last_undegraded":"2024-04-25T13:16:49.129200+0000","last_fullsized":"2024-04-25T13:16:49.129200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:35.740816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236176+0000","last_change":"2024-04-25T13:16:08.008121+0000","last_active":"2024-04-25T13:16:49.236176+0000","last_peered":"2024-04-25T13:16:49.236176+0000","last_clean":"2024-04-25T13:16:49.236176+0000","last_became_active":"2024-04-25T13:16:08.007727+0000","last_became_peered":"2024-04-25T13:16:08.007727+0000","last_unstale":"2024-04-25T13:16:49.236176+0000","last_undegraded":"2024-04-25T13:16:49.236176+0000","last_fullsized":"2024-04-25T13:16:49.236176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:11.193610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236219+0000","last_change":"2024-04-25T13:16:08.014997+0000","last_active":"2024-04-25T13:16:49.236219+0000","last_peered":"2024-04-25T13:16:49.236219+0000","last_clean":"2024-04-25T13:16:49.236219+0000","last_became_active":"2024-04-25T13:16:08.014579+0000","last_became_peered":"2024-04-25T13:16:08.014579+0000","last_unstale":"2024-04-25T13:16:49.236219+0000","last_undegraded":"2024-04-25T13:16:49.236219+0000","last_fullsized":"2024-04-25T13:16:49.236219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:07.884249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129692+0000","last_change":"2024-04-25T13:16:08.015379+0000","last_active":"2024-04-25T13:16:49.129692+0000","last_peered":"2024-04-25T13:16:49.129692+0000","last_clean":"2024-04-25T13:16:49.129692+0000","last_became_active":"2024-04-25T13:16:08.014693+0000","last_became_peered":"2024-04-25T13:16:08.014693+0000","last_unstale":"2024-04-25T13:16:49.129692+0000","last_undegraded":"2024-04-25T13:16:49.129692+0000","last_fullsized":"2024-04-25T13:16:49.129692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:41.305358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235707+0000","last_change":"2024-04-25T13:16:08.014873+0000","last_active":"2024-04-25T13:16:49.235707+0000","last_peered":"2024-04-25T13:16:49.235707+0000","last_clean":"2024-04-25T13:16:49.235707+0000","last_became_active":"2024-04-25T13:16:08.014575+0000","last_became_peered":"2024-04-25T13:16:08.014575+0000","last_unstale":"2024-04-25T13:16:49.235707+0000","last_undegraded":"2024-04-25T13:16:49.235707+0000","last_fullsized":"2024-04-25T13:16:49.235707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:41.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.135573+0000","last_change":"2024-04-25T13:16:49.133825+0000","last_active":"2024-04-25T13:16:49.135573+0000","last_peered":"2024-04-25T13:16:49.135573+0000","last_clean":"2024-04-25T13:16:49.135573+0000","last_became_active":"2024-04-25T13:16:49.133449+0000","last_became_peered":"2024-04-25T13:16:49.133449+0000","last_unstale":"2024-04-25T13:16:49.135573+0000","last_undegraded":"2024-04-25T13:16:49.135573+0000","last_fullsized":"2024-04-25T13:16:49.135573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:44.601144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134802+0000","last_change":"2024-04-25T13:16:08.000447+0000","last_active":"2024-04-25T13:16:49.134802+0000","last_peered":"2024-04-25T13:16:49.134802+0000","last_clean":"2024-04-25T13:16:49.134802+0000","last_became_active":"2024-04-25T13:16:08.000102+0000","last_became_peered":"2024-04-25T13:16:08.000102+0000","last_unstale":"2024-04-25T13:16:49.134802+0000","last_undegraded":"2024-04-25T13:16:49.134802+0000","last_fullsized":"2024-04-25T13:16:49.134802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:30.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235889+0000","last_change":"2024-04-25T13:16:08.008437+0000","last_active":"2024-04-25T13:16:49.235889+0000","last_peered":"2024-04-25T13:16:49.235889+0000","last_clean":"2024-04-25T13:16:49.235889+0000","last_became_active":"2024-04-25T13:16:08.008173+0000","last_became_peered":"2024-04-25T13:16:08.008173+0000","last_unstale":"2024-04-25T13:16:49.235889+0000","last_undegraded":"2024-04-25T13:16:49.235889+0000","last_fullsized":"2024-04-25T13:16:49.235889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:54.362757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131654+0000","last_change":"2024-04-25T13:16:08.004689+0000","last_active":"2024-04-25T13:16:49.131654+0000","last_peered":"2024-04-25T13:16:49.131654+0000","last_clean":"2024-04-25T13:16:49.131654+0000","last_became_active":"2024-04-25T13:16:08.004340+0000","last_became_peered":"2024-04-25T13:16:08.004340+0000","last_unstale":"2024-04-25T13:16:49.131654+0000","last_undegraded":"2024-04-25T13:16:49.131654+0000","last_fullsized":"2024-04-25T13:16:49.131654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:18.870731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132255+0000","last_change":"2024-04-25T13:16:08.005344+0000","last_active":"2024-04-25T13:16:49.132255+0000","last_peered":"2024-04-25T13:16:49.132255+0000","last_clean":"2024-04-25T13:16:49.132255+0000","last_became_active":"2024-04-25T13:16:08.005041+0000","last_became_peered":"2024-04-25T13:16:08.005041+0000","last_unstale":"2024-04-25T13:16:49.132255+0000","last_undegraded":"2024-04-25T13:16:49.132255+0000","last_fullsized":"2024-04-25T13:16:49.132255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.389800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.136388+0000","last_change":"2024-04-25T13:16:49.135779+0000","last_active":"2024-04-25T13:16:49.136388+0000","last_peered":"2024-04-25T13:16:49.136388+0000","last_clean":"2024-04-25T13:16:49.136388+0000","last_became_active":"2024-04-25T13:16:49.135476+0000","last_became_peered":"2024-04-25T13:16:49.135476+0000","last_unstale":"2024-04-25T13:16:49.136388+0000","last_undegraded":"2024-04-25T13:16:49.136388+0000","last_fullsized":"2024-04-25T13:16:49.136388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:47.445270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129582+0000","last_change":"2024-04-25T13:16:08.012737+0000","last_active":"2024-04-25T13:16:49.129582+0000","last_peered":"2024-04-25T13:16:49.129582+0000","last_clean":"2024-04-25T13:16:49.129582+0000","last_became_active":"2024-04-25T13:16:08.012472+0000","last_became_peered":"2024-04-25T13:16:08.012472+0000","last_unstale":"2024-04-25T13:16:49.129582+0000","last_undegraded":"2024-04-25T13:16:49.129582+0000","last_fullsized":"2024-04-25T13:16:49.129582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:36.880757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.128898+0000","last_change":"2024-04-25T13:16:08.007177+0000","last_active":"2024-04-25T13:16:49.128898+0000","last_peered":"2024-04-25T13:16:49.128898+0000","last_clean":"2024-04-25T13:16:49.128898+0000","last_became_active":"2024-04-25T13:16:08.006866+0000","last_became_peered":"2024-04-25T13:16:08.006866+0000","last_unstale":"2024-04-25T13:16:49.128898+0000","last_undegraded":"2024-04-25T13:16:49.128898+0000","last_fullsized":"2024-04-25T13:16:49.128898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:16.707771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133723+0000","last_change":"2024-04-25T13:16:07.999761+0000","last_active":"2024-04-25T13:16:49.133723+0000","last_peered":"2024-04-25T13:16:49.133723+0000","last_clean":"2024-04-25T13:16:49.133723+0000","last_became_active":"2024-04-25T13:16:07.999033+0000","last_became_peered":"2024-04-25T13:16:07.999033+0000","last_unstale":"2024-04-25T13:16:49.133723+0000","last_undegraded":"2024-04-25T13:16:49.133723+0000","last_fullsized":"2024-04-25T13:16:49.133723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:40.420290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235662+0000","last_change":"2024-04-25T13:16:08.016370+0000","last_active":"2024-04-25T13:16:49.235662+0000","last_peered":"2024-04-25T13:16:49.235662+0000","last_clean":"2024-04-25T13:16:49.235662+0000","last_became_active":"2024-04-25T13:16:08.016068+0000","last_became_peered":"2024-04-25T13:16:08.016068+0000","last_unstale":"2024-04-25T13:16:49.235662+0000","last_undegraded":"2024-04-25T13:16:49.235662+0000","last_fullsized":"2024-04-25T13:16:49.235662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:11.475920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132457+0000","last_change":"2024-04-25T13:16:08.005195+0000","last_active":"2024-04-25T13:16:49.132457+0000","last_peered":"2024-04-25T13:16:49.132457+0000","last_clean":"2024-04-25T13:16:49.132457+0000","last_became_active":"2024-04-25T13:16:08.004655+0000","last_became_peered":"2024-04-25T13:16:08.004655+0000","last_unstale":"2024-04-25T13:16:49.132457+0000","last_undegraded":"2024-04-25T13:16:49.132457+0000","last_fullsized":"2024-04-25T13:16:49.132457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:28.249616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235787+0000","last_change":"2024-04-25T13:16:08.011310+0000","last_active":"2024-04-25T13:16:49.235787+0000","last_peered":"2024-04-25T13:16:49.235787+0000","last_clean":"2024-04-25T13:16:49.235787+0000","last_became_active":"2024-04-25T13:16:08.011047+0000","last_became_peered":"2024-04-25T13:16:08.011047+0000","last_unstale":"2024-04-25T13:16:49.235787+0000","last_undegraded":"2024-04-25T13:16:49.235787+0000","last_fullsized":"2024-04-25T13:16:49.235787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:55.447995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236059+0000","last_change":"2024-04-25T13:16:08.012191+0000","last_active":"2024-04-25T13:16:49.236059+0000","last_peered":"2024-04-25T13:16:49.236059+0000","last_clean":"2024-04-25T13:16:49.236059+0000","last_became_active":"2024-04-25T13:16:08.011916+0000","last_became_peered":"2024-04-25T13:16:08.011916+0000","last_unstale":"2024-04-25T13:16:49.236059+0000","last_undegraded":"2024-04-25T13:16:49.236059+0000","last_fullsized":"2024-04-25T13:16:49.236059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:33.520554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131648+0000","last_change":"2024-04-25T13:16:08.012349+0000","last_active":"2024-04-25T13:16:49.131648+0000","last_peered":"2024-04-25T13:16:49.131648+0000","last_clean":"2024-04-25T13:16:49.131648+0000","last_became_active":"2024-04-25T13:16:08.011893+0000","last_became_peered":"2024-04-25T13:16:08.011893+0000","last_unstale":"2024-04-25T13:16:49.131648+0000","last_undegraded":"2024-04-25T13:16:49.131648+0000","last_fullsized":"2024-04-25T13:16:49.131648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:11.901170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235983+0000","last_change":"2024-04-25T13:16:08.015681+0000","last_active":"2024-04-25T13:16:49.235983+0000","last_peered":"2024-04-25T13:16:49.235983+0000","last_clean":"2024-04-25T13:16:49.235983+0000","last_became_active":"2024-04-25T13:16:08.015405+0000","last_became_peered":"2024-04-25T13:16:08.015405+0000","last_unstale":"2024-04-25T13:16:49.235983+0000","last_undegraded":"2024-04-25T13:16:49.235983+0000","last_fullsized":"2024-04-25T13:16:49.235983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:00.932243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130058+0000","last_change":"2024-04-25T13:16:08.000456+0000","last_active":"2024-04-25T13:16:49.130058+0000","last_peered":"2024-04-25T13:16:49.130058+0000","last_clean":"2024-04-25T13:16:49.130058+0000","last_became_active":"2024-04-25T13:16:08.000193+0000","last_became_peered":"2024-04-25T13:16:08.000193+0000","last_unstale":"2024-04-25T13:16:49.130058+0000","last_undegraded":"2024-04-25T13:16:49.130058+0000","last_fullsized":"2024-04-25T13:16:49.130058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:15.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129924+0000","last_change":"2024-04-25T13:16:08.016060+0000","last_active":"2024-04-25T13:16:49.129924+0000","last_peered":"2024-04-25T13:16:49.129924+0000","last_clean":"2024-04-25T13:16:49.129924+0000","last_became_active":"2024-04-25T13:16:08.014300+0000","last_became_peered":"2024-04-25T13:16:08.014300+0000","last_unstale":"2024-04-25T13:16:49.129924+0000","last_undegraded":"2024-04-25T13:16:49.129924+0000","last_fullsized":"2024-04-25T13:16:49.129924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:37.644887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130981+0000","last_change":"2024-04-25T13:16:08.004946+0000","last_active":"2024-04-25T13:16:49.130981+0000","last_peered":"2024-04-25T13:16:49.130981+0000","last_clean":"2024-04-25T13:16:49.130981+0000","last_became_active":"2024-04-25T13:16:08.004673+0000","last_became_peered":"2024-04-25T13:16:08.004673+0000","last_unstale":"2024-04-25T13:16:49.130981+0000","last_undegraded":"2024-04-25T13:16:49.130981+0000","last_fullsized":"2024-04-25T13:16:49.130981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:18.616424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131000+0000","last_change":"2024-04-25T13:16:08.015676+0000","last_active":"2024-04-25T13:16:49.131000+0000","last_peered":"2024-04-25T13:16:49.131000+0000","last_clean":"2024-04-25T13:16:49.131000+0000","last_became_active":"2024-04-25T13:16:08.014719+0000","last_became_peered":"2024-04-25T13:16:08.014719+0000","last_unstale":"2024-04-25T13:16:49.131000+0000","last_undegraded":"2024-04-25T13:16:49.131000+0000","last_fullsized":"2024-04-25T13:16:49.131000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:04.274611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134113+0000","last_change":"2024-04-25T13:16:07.997665+0000","last_active":"2024-04-25T13:16:49.134113+0000","last_peered":"2024-04-25T13:16:49.134113+0000","last_clean":"2024-04-25T13:16:49.134113+0000","last_became_active":"2024-04-25T13:16:07.996792+0000","last_became_peered":"2024-04-25T13:16:07.996792+0000","last_unstale":"2024-04-25T13:16:49.134113+0000","last_undegraded":"2024-04-25T13:16:49.134113+0000","last_fullsized":"2024-04-25T13:16:49.134113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:39.367026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129755+0000","last_change":"2024-04-25T13:16:08.001495+0000","last_active":"2024-04-25T13:16:49.129755+0000","last_peered":"2024-04-25T13:16:49.129755+0000","last_clean":"2024-04-25T13:16:49.129755+0000","last_became_active":"2024-04-25T13:16:08.001182+0000","last_became_peered":"2024-04-25T13:16:08.001182+0000","last_unstale":"2024-04-25T13:16:49.129755+0000","last_undegraded":"2024-04-25T13:16:49.129755+0000","last_fullsized":"2024-04-25T13:16:49.129755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:48.417192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131530+0000","last_change":"2024-04-25T13:16:08.006262+0000","last_active":"2024-04-25T13:16:49.131530+0000","last_peered":"2024-04-25T13:16:49.131530+0000","last_clean":"2024-04-25T13:16:49.131530+0000","last_became_active":"2024-04-25T13:16:08.005976+0000","last_became_peered":"2024-04-25T13:16:08.005976+0000","last_unstale":"2024-04-25T13:16:49.131530+0000","last_undegraded":"2024-04-25T13:16:49.131530+0000","last_fullsized":"2024-04-25T13:16:49.131530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:22.965387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":714627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":127091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":125950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":123489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":127125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":123621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":123109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":913408,"data_stored":712819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:15.856 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:15.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.991+0000 7fed2d283640 1 Processor -- start 2024-04-25T13:17:15.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.991+0000 7fed2d283640 1 -- start start 2024-04-25T13:17:15.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.992+0000 7fed2d283640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed280b3c00 0x7fed280b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:15.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.992+0000 7fed2d283640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed281558c0 con 0x7fed280b5450 2024-04-25T13:17:15.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.992+0000 7fed2d283640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed280cb8c0 con 0x7fed281554e0 2024-04-25T13:17:15.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.992+0000 7fed2d283640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fed280b4a80 con 0x7fed280b3c00 2024-04-25T13:17:15.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.992+0000 7fed1ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed280b3c00 0x7fed280b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:15.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.992+0000 7fed1ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed280b3c00 0x7fed280b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36142/0 (socket says 172.21.15.52:36142) 2024-04-25T13:17:15.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.992+0000 7fed277fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fed280b5450 0x7fed280d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51160/0 (socket says 172.21.15.52:51160) 2024-04-25T13:17:15.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.992+0000 7fed1ffff640 1 -- 172.21.15.52:0/2756298941 learned_addr learned my addr 172.21.15.52:0/2756298941 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:15.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.992+0000 7fed1ffff640 1 -- 172.21.15.52:0/2756298941 >> v1:172.21.15.102:6789/0 conn(0x7fed281554e0 legacy=0x7fed2815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.992+0000 7fed1ffff640 1 -- 172.21.15.52:0/2756298941 >> v1:172.21.15.52:6789/0 conn(0x7fed280b5450 legacy=0x7fed280d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.992+0000 7fed1ffff640 1 -- 172.21.15.52:0/2756298941 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed280cbba0 con 0x7fed280b3c00 2024-04-25T13:17:15.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.993+0000 7fed1ffff640 1 --2- 172.21.15.52:0/2756298941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed280b3c00 0x7fed280b4f10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fed10009870 tx=0x7fed1002a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65459d8565bc4791 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:15.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.993+0000 7fed267fc640 1 -- 172.21.15.52:0/2756298941 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10037070 con 0x7fed280b3c00 2024-04-25T13:17:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.993+0000 7fed267fc640 1 -- 172.21.15.52:0/2756298941 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed10032640 con 0x7fed280b3c00 2024-04-25T13:17:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.993+0000 7fed267fc640 1 -- 172.21.15.52:0/2756298941 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10032a10 con 0x7fed280b3c00 2024-04-25T13:17:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.994+0000 7fed2d283640 1 -- 172.21.15.52:0/2756298941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed280b3c00 msgr2=0x7fed280b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.994+0000 7fed2d283640 1 --2- 172.21.15.52:0/2756298941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed280b3c00 0x7fed280b4f10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fed10009870 tx=0x7fed1002a3c0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.994+0000 7fed2d283640 1 -- 172.21.15.52:0/2756298941 shutdown_connections 2024-04-25T13:17:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.994+0000 7fed2d283640 1 --2- 172.21.15.52:0/2756298941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed280b3c00 0x7fed280b4f10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.994+0000 7fed2d283640 1 -- 172.21.15.52:0/2756298941 >> 172.21.15.52:0/2756298941 conn(0x7fed28074d50 msgr2=0x7fed28075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:15.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.994+0000 7fed2d283640 1 -- 172.21.15.52:0/2756298941 shutdown_connections 2024-04-25T13:17:15.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.994+0000 7fed2d283640 1 -- 172.21.15.52:0/2756298941 wait complete. 2024-04-25T13:17:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.995+0000 7fed2d283640 1 Processor -- start 2024-04-25T13:17:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.995+0000 7fed2d283640 1 -- start start 2024-04-25T13:17:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed2d283640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed280b3c00 0x7fed281f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed2d283640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed280b5450 0x7fed280cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed2d283640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed281554e0 0x7fed281f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed2d283640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fed280b4710 con 0x7fed280b5450 2024-04-25T13:17:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed2d283640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fed280b4430 con 0x7fed281554e0 2024-04-25T13:17:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed2d283640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fed280b3580 con 0x7fed280b3c00 2024-04-25T13:17:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed1ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed280b5450 0x7fed280cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed1ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed280b5450 0x7fed280cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36154/0 (socket says 172.21.15.52:36154) 2024-04-25T13:17:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed1ffff640 1 -- 172.21.15.52:0/2294533314 learned_addr learned my addr 172.21.15.52:0/2294533314 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed26ffd640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed280b3c00 0x7fed281f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed277fe640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed281554e0 0x7fed281f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed1ffff640 1 -- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed280b3c00 msgr2=0x7fed281f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed1ffff640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed280b3c00 0x7fed281f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed1ffff640 1 -- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed281554e0 msgr2=0x7fed281f0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed1ffff640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed281554e0 0x7fed281f0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed1ffff640 1 -- 172.21.15.52:0/2294533314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed28151ad0 con 0x7fed280b5450 2024-04-25T13:17:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed26ffd640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed280b3c00 0x7fed281f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed277fe640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed281554e0 0x7fed281f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed1ffff640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed280b5450 0x7fed280cc6f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fed1002a400 tx=0x7fed100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed1f7fe640 1 -- 172.21.15.52:0/2294533314 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10037040 con 0x7fed280b5450 2024-04-25T13:17:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed1f7fe640 1 -- 172.21.15.52:0/2294533314 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed10042070 con 0x7fed280b5450 2024-04-25T13:17:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed2d283640 1 -- 172.21.15.52:0/2294533314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed281f16e0 con 0x7fed280b5450 2024-04-25T13:17:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed1f7fe640 1 -- 172.21.15.52:0/2294533314 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10030bd0 con 0x7fed280b5450 2024-04-25T13:17:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.996+0000 7fed2d283640 1 -- 172.21.15.52:0/2294533314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed281f1980 con 0x7fed280b5450 2024-04-25T13:17:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.997+0000 7fed2d283640 1 -- 172.21.15.52:0/2294533314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed28068e40 con 0x7fed280b5450 2024-04-25T13:17:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.998+0000 7fed1f7fe640 1 -- 172.21.15.52:0/2294533314 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed10032500 con 0x7fed280b5450 2024-04-25T13:17:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.998+0000 7fed1f7fe640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fed0806c8f0 0x7fed0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.998+0000 7fed1f7fe640 1 -- 172.21.15.52:0/2294533314 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fed100acab0 con 0x7fed280b5450 2024-04-25T13:17:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.999+0000 7fed26ffd640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fed0806c8f0 0x7fed0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:15.999+0000 7fed26ffd640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fed0806c8f0 0x7fed0806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fed18001700 tx=0x7fed18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.003+0000 7fed1f7fe640 1 -- 172.21.15.52:0/2294533314 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed1007aa30 con 0x7fed280b5450 2024-04-25T13:17:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.186+0000 7fed2d283640 1 -- 172.21.15.52:0/2294533314 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed280cc260 con 0x7fed0806c8f0 2024-04-25T13:17:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.194+0000 7fed1f7fe640 1 -- 172.21.15.52:0/2294533314 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7fed280cc260 con 0x7fed0806c8f0 2024-04-25T13:17:16.198 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:17:16.200 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T13:17:16.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.198+0000 7fed2d283640 1 -- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fed0806c8f0 msgr2=0x7fed0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.198+0000 7fed2d283640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fed0806c8f0 0x7fed0806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fed18001700 tx=0x7fed18009040 comp rx=0 tx=0).stop 2024-04-25T13:17:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.198+0000 7fed2d283640 1 -- 172.21.15.52:0/2294533314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed280b5450 msgr2=0x7fed280cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.198+0000 7fed2d283640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed280b5450 0x7fed280cc6f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fed1002a400 tx=0x7fed100046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.198+0000 7fed2d283640 1 -- 172.21.15.52:0/2294533314 shutdown_connections 2024-04-25T13:17:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.198+0000 7fed2d283640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fed0806c8f0 0x7fed0806edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.198+0000 7fed2d283640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed281554e0 0x7fed281f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.198+0000 7fed2d283640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed280b5450 0x7fed280cc6f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.198+0000 7fed2d283640 1 --2- 172.21.15.52:0/2294533314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed280b3c00 0x7fed281f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.198+0000 7fed2d283640 1 -- 172.21.15.52:0/2294533314 >> 172.21.15.52:0/2294533314 conn(0x7fed28074d50 msgr2=0x7fed28151050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.198+0000 7fed2d283640 1 -- 172.21.15.52:0/2294533314 shutdown_connections 2024-04-25T13:17:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.198+0000 7fed2d283640 1 -- 172.21.15.52:0/2294533314 wait complete. 2024-04-25T13:17:16.209 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-25T13:17:15.835809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236456,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738264,"statfs":{"total":773094113280,"available":772851982336,"internally_reserved":0,"allocated":3776512,"data_stored":2178536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2328,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003409"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.148643+0000","last_change":"2024-04-25T13:16:07.001071+0000","last_active":"2024-04-25T13:16:56.148643+0000","last_peered":"2024-04-25T13:16:56.148643+0000","last_clean":"2024-04-25T13:16:56.148643+0000","last_became_active":"2024-04-25T13:16:07.000746+0000","last_became_peered":"2024-04-25T13:16:07.000746+0000","last_unstale":"2024-04-25T13:16:56.148643+0000","last_undegraded":"2024-04-25T13:16:56.148643+0000","last_fullsized":"2024-04-25T13:16:56.148643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:36.289103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235936+0000","last_change":"2024-04-25T13:16:08.012928+0000","last_active":"2024-04-25T13:16:49.235936+0000","last_peered":"2024-04-25T13:16:49.235936+0000","last_clean":"2024-04-25T13:16:49.235936+0000","last_became_active":"2024-04-25T13:16:08.012114+0000","last_became_peered":"2024-04-25T13:16:08.012114+0000","last_unstale":"2024-04-25T13:16:49.235936+0000","last_undegraded":"2024-04-25T13:16:49.235936+0000","last_fullsized":"2024-04-25T13:16:49.235936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:01.077922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235570+0000","last_change":"2024-04-25T13:16:12.734829+0000","last_active":"2024-04-25T13:16:49.235570+0000","last_peered":"2024-04-25T13:16:49.235570+0000","last_clean":"2024-04-25T13:16:49.235570+0000","last_became_active":"2024-04-25T13:16:12.734390+0000","last_became_peered":"2024-04-25T13:16:12.734390+0000","last_unstale":"2024-04-25T13:16:49.235570+0000","last_undegraded":"2024-04-25T13:16:49.235570+0000","last_fullsized":"2024-04-25T13:16:49.235570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:33.941883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236119+0000","last_change":"2024-04-25T13:16:06.999440+0000","last_active":"2024-04-25T13:16:49.236119+0000","last_peered":"2024-04-25T13:16:49.236119+0000","last_clean":"2024-04-25T13:16:49.236119+0000","last_became_active":"2024-04-25T13:16:06.999078+0000","last_became_peered":"2024-04-25T13:16:06.999078+0000","last_unstale":"2024-04-25T13:16:49.236119+0000","last_undegraded":"2024-04-25T13:16:49.236119+0000","last_fullsized":"2024-04-25T13:16:49.236119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.819349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133600+0000","last_change":"2024-04-25T13:16:08.012743+0000","last_active":"2024-04-25T13:16:49.133600+0000","last_peered":"2024-04-25T13:16:49.133600+0000","last_clean":"2024-04-25T13:16:49.133600+0000","last_became_active":"2024-04-25T13:16:08.012036+0000","last_became_peered":"2024-04-25T13:16:08.012036+0000","last_unstale":"2024-04-25T13:16:49.133600+0000","last_undegraded":"2024-04-25T13:16:49.133600+0000","last_fullsized":"2024-04-25T13:16:49.133600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.959146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.238290+0000","last_change":"2024-04-25T13:16:49.238290+0000","last_active":"2024-04-25T13:16:49.238290+0000","last_peered":"2024-04-25T13:16:49.238290+0000","last_clean":"2024-04-25T13:16:49.238290+0000","last_became_active":"2024-04-25T13:16:49.237674+0000","last_became_peered":"2024-04-25T13:16:49.237674+0000","last_unstale":"2024-04-25T13:16:49.238290+0000","last_undegraded":"2024-04-25T13:16:49.238290+0000","last_fullsized":"2024-04-25T13:16:49.238290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:32.550364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.149564+0000","last_change":"2024-04-25T13:16:07.001022+0000","last_active":"2024-04-25T13:16:56.149564+0000","last_peered":"2024-04-25T13:16:56.149564+0000","last_clean":"2024-04-25T13:16:56.149564+0000","last_became_active":"2024-04-25T13:16:07.000751+0000","last_became_peered":"2024-04-25T13:16:07.000751+0000","last_unstale":"2024-04-25T13:16:56.149564+0000","last_undegraded":"2024-04-25T13:16:56.149564+0000","last_fullsized":"2024-04-25T13:16:56.149564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:11.597397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131104+0000","last_change":"2024-04-25T13:16:08.011361+0000","last_active":"2024-04-25T13:16:49.131104+0000","last_peered":"2024-04-25T13:16:49.131104+0000","last_clean":"2024-04-25T13:16:49.131104+0000","last_became_active":"2024-04-25T13:16:08.011073+0000","last_became_peered":"2024-04-25T13:16:08.011073+0000","last_unstale":"2024-04-25T13:16:49.131104+0000","last_undegraded":"2024-04-25T13:16:49.131104+0000","last_fullsized":"2024-04-25T13:16:49.131104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:00.471410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.238066+0000","last_change":"2024-04-25T13:16:49.238066+0000","last_active":"2024-04-25T13:16:49.238066+0000","last_peered":"2024-04-25T13:16:49.238066+0000","last_clean":"2024-04-25T13:16:49.238066+0000","last_became_active":"2024-04-25T13:16:49.237565+0000","last_became_peered":"2024-04-25T13:16:49.237565+0000","last_unstale":"2024-04-25T13:16:49.238066+0000","last_undegraded":"2024-04-25T13:16:49.238066+0000","last_fullsized":"2024-04-25T13:16:49.238066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:15.893235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.151020+0000","last_change":"2024-04-25T13:16:07.003774+0000","last_active":"2024-04-25T13:16:56.151020+0000","last_peered":"2024-04-25T13:16:56.151020+0000","last_clean":"2024-04-25T13:16:56.151020+0000","last_became_active":"2024-04-25T13:16:07.003493+0000","last_became_peered":"2024-04-25T13:16:07.003493+0000","last_unstale":"2024-04-25T13:16:56.151020+0000","last_undegraded":"2024-04-25T13:16:56.151020+0000","last_fullsized":"2024-04-25T13:16:56.151020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:12.940812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130266+0000","last_change":"2024-04-25T13:16:08.012084+0000","last_active":"2024-04-25T13:16:49.130266+0000","last_peered":"2024-04-25T13:16:49.130266+0000","last_clean":"2024-04-25T13:16:49.130266+0000","last_became_active":"2024-04-25T13:16:08.011634+0000","last_became_peered":"2024-04-25T13:16:08.011634+0000","last_unstale":"2024-04-25T13:16:49.130266+0000","last_undegraded":"2024-04-25T13:16:49.130266+0000","last_fullsized":"2024-04-25T13:16:49.130266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:26.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132146+0000","last_change":"2024-04-25T13:16:12.039238+0000","last_active":"2024-04-25T13:16:49.132146+0000","last_peered":"2024-04-25T13:16:49.132146+0000","last_clean":"2024-04-25T13:16:49.132146+0000","last_became_active":"2024-04-25T13:16:12.038508+0000","last_became_peered":"2024-04-25T13:16:12.038508+0000","last_unstale":"2024-04-25T13:16:49.132146+0000","last_undegraded":"2024-04-25T13:16:49.132146+0000","last_fullsized":"2024-04-25T13:16:49.132146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:22.183373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235784+0000","last_change":"2024-04-25T13:16:08.007741+0000","last_active":"2024-04-25T13:16:49.235784+0000","last_peered":"2024-04-25T13:16:49.235784+0000","last_clean":"2024-04-25T13:16:49.235784+0000","last_became_active":"2024-04-25T13:16:08.007478+0000","last_became_peered":"2024-04-25T13:16:08.007478+0000","last_unstale":"2024-04-25T13:16:49.235784+0000","last_undegraded":"2024-04-25T13:16:49.235784+0000","last_fullsized":"2024-04-25T13:16:49.235784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:49.162203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131314+0000","last_change":"2024-04-25T13:16:07.001183+0000","last_active":"2024-04-25T13:16:49.131314+0000","last_peered":"2024-04-25T13:16:49.131314+0000","last_clean":"2024-04-25T13:16:49.131314+0000","last_became_active":"2024-04-25T13:16:07.000880+0000","last_became_peered":"2024-04-25T13:16:07.000880+0000","last_unstale":"2024-04-25T13:16:49.131314+0000","last_undegraded":"2024-04-25T13:16:49.131314+0000","last_fullsized":"2024-04-25T13:16:49.131314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.250349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132664+0000","last_change":"2024-04-25T13:16:12.037074+0000","last_active":"2024-04-25T13:16:49.132664+0000","last_peered":"2024-04-25T13:16:49.132664+0000","last_clean":"2024-04-25T13:16:49.132664+0000","last_became_active":"2024-04-25T13:16:12.036508+0000","last_became_peered":"2024-04-25T13:16:12.036508+0000","last_unstale":"2024-04-25T13:16:49.132664+0000","last_undegraded":"2024-04-25T13:16:49.132664+0000","last_fullsized":"2024-04-25T13:16:49.132664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:01.380469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235873+0000","last_change":"2024-04-25T13:16:08.013538+0000","last_active":"2024-04-25T13:16:49.235873+0000","last_peered":"2024-04-25T13:16:49.235873+0000","last_clean":"2024-04-25T13:16:49.235873+0000","last_became_active":"2024-04-25T13:16:08.013269+0000","last_became_peered":"2024-04-25T13:16:08.013269+0000","last_unstale":"2024-04-25T13:16:49.235873+0000","last_undegraded":"2024-04-25T13:16:49.235873+0000","last_fullsized":"2024-04-25T13:16:49.235873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:05.313768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.130603+0000","last_change":"2024-04-25T13:16:06.994106+0000","last_active":"2024-04-25T13:16:51.130603+0000","last_peered":"2024-04-25T13:16:51.130603+0000","last_clean":"2024-04-25T13:16:51.130603+0000","last_became_active":"2024-04-25T13:16:06.993807+0000","last_became_peered":"2024-04-25T13:16:06.993807+0000","last_unstale":"2024-04-25T13:16:51.130603+0000","last_undegraded":"2024-04-25T13:16:51.130603+0000","last_fullsized":"2024-04-25T13:16:51.130603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:53.706175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131943+0000","last_change":"2024-04-25T13:16:12.039421+0000","last_active":"2024-04-25T13:16:49.131943+0000","last_peered":"2024-04-25T13:16:49.131943+0000","last_clean":"2024-04-25T13:16:49.131943+0000","last_became_active":"2024-04-25T13:16:12.038953+0000","last_became_peered":"2024-04-25T13:16:12.038953+0000","last_unstale":"2024-04-25T13:16:49.131943+0000","last_undegraded":"2024-04-25T13:16:49.131943+0000","last_fullsized":"2024-04-25T13:16:49.131943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:26.714224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236290+0000","last_change":"2024-04-25T13:16:08.008978+0000","last_active":"2024-04-25T13:16:49.236290+0000","last_peered":"2024-04-25T13:16:49.236290+0000","last_clean":"2024-04-25T13:16:49.236290+0000","last_became_active":"2024-04-25T13:16:08.008446+0000","last_became_peered":"2024-04-25T13:16:08.008446+0000","last_unstale":"2024-04-25T13:16:49.236290+0000","last_undegraded":"2024-04-25T13:16:49.236290+0000","last_fullsized":"2024-04-25T13:16:49.236290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:34.604344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.148428+0000","last_change":"2024-04-25T13:16:06.992902+0000","last_active":"2024-04-25T13:16:56.148428+0000","last_peered":"2024-04-25T13:16:56.148428+0000","last_clean":"2024-04-25T13:16:56.148428+0000","last_became_active":"2024-04-25T13:16:06.992593+0000","last_became_peered":"2024-04-25T13:16:06.992593+0000","last_unstale":"2024-04-25T13:16:56.148428+0000","last_undegraded":"2024-04-25T13:16:56.148428+0000","last_fullsized":"2024-04-25T13:16:56.148428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:57.665455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129441+0000","last_change":"2024-04-25T13:16:12.735412+0000","last_active":"2024-04-25T13:16:49.129441+0000","last_peered":"2024-04-25T13:16:49.129441+0000","last_clean":"2024-04-25T13:16:49.129441+0000","last_became_active":"2024-04-25T13:16:12.733485+0000","last_became_peered":"2024-04-25T13:16:12.733485+0000","last_unstale":"2024-04-25T13:16:49.129441+0000","last_undegraded":"2024-04-25T13:16:49.129441+0000","last_fullsized":"2024-04-25T13:16:49.129441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:25.265696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132357+0000","last_change":"2024-04-25T13:16:07.998941+0000","last_active":"2024-04-25T13:16:49.132357+0000","last_peered":"2024-04-25T13:16:49.132357+0000","last_clean":"2024-04-25T13:16:49.132357+0000","last_became_active":"2024-04-25T13:16:07.998658+0000","last_became_peered":"2024-04-25T13:16:07.998658+0000","last_unstale":"2024-04-25T13:16:49.132357+0000","last_undegraded":"2024-04-25T13:16:49.132357+0000","last_fullsized":"2024-04-25T13:16:49.132357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:45.473269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129850+0000","last_change":"2024-04-25T13:16:07.001542+0000","last_active":"2024-04-25T13:16:49.129850+0000","last_peered":"2024-04-25T13:16:49.129850+0000","last_clean":"2024-04-25T13:16:49.129850+0000","last_became_active":"2024-04-25T13:16:07.000846+0000","last_became_peered":"2024-04-25T13:16:07.000846+0000","last_unstale":"2024-04-25T13:16:49.129850+0000","last_undegraded":"2024-04-25T13:16:49.129850+0000","last_fullsized":"2024-04-25T13:16:49.129850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:41.121978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132197+0000","last_change":"2024-04-25T13:16:12.038493+0000","last_active":"2024-04-25T13:16:49.132197+0000","last_peered":"2024-04-25T13:16:49.132197+0000","last_clean":"2024-04-25T13:16:49.132197+0000","last_became_active":"2024-04-25T13:16:12.038032+0000","last_became_peered":"2024-04-25T13:16:12.038032+0000","last_unstale":"2024-04-25T13:16:49.132197+0000","last_undegraded":"2024-04-25T13:16:49.132197+0000","last_fullsized":"2024-04-25T13:16:49.132197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:40.222480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134580+0000","last_change":"2024-04-25T13:16:07.998444+0000","last_active":"2024-04-25T13:16:49.134580+0000","last_peered":"2024-04-25T13:16:49.134580+0000","last_clean":"2024-04-25T13:16:49.134580+0000","last_became_active":"2024-04-25T13:16:07.998037+0000","last_became_peered":"2024-04-25T13:16:07.998037+0000","last_unstale":"2024-04-25T13:16:49.134580+0000","last_undegraded":"2024-04-25T13:16:49.134580+0000","last_fullsized":"2024-04-25T13:16:49.134580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:35.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.347192+0000","last_change":"2024-04-25T13:16:06.995706+0000","last_active":"2024-04-25T13:16:56.347192+0000","last_peered":"2024-04-25T13:16:56.347192+0000","last_clean":"2024-04-25T13:16:56.347192+0000","last_became_active":"2024-04-25T13:16:06.995420+0000","last_became_peered":"2024-04-25T13:16:06.995420+0000","last_unstale":"2024-04-25T13:16:56.347192+0000","last_undegraded":"2024-04-25T13:16:56.347192+0000","last_fullsized":"2024-04-25T13:16:56.347192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:08.672949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132741+0000","last_change":"2024-04-25T13:16:12.734165+0000","last_active":"2024-04-25T13:16:49.132741+0000","last_peered":"2024-04-25T13:16:49.132741+0000","last_clean":"2024-04-25T13:16:49.132741+0000","last_became_active":"2024-04-25T13:16:12.733772+0000","last_became_peered":"2024-04-25T13:16:12.733772+0000","last_unstale":"2024-04-25T13:16:49.132741+0000","last_undegraded":"2024-04-25T13:16:49.132741+0000","last_fullsized":"2024-04-25T13:16:49.132741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:35.716517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236301+0000","last_change":"2024-04-25T13:16:08.017429+0000","last_active":"2024-04-25T13:16:49.236301+0000","last_peered":"2024-04-25T13:16:49.236301+0000","last_clean":"2024-04-25T13:16:49.236301+0000","last_became_active":"2024-04-25T13:16:08.017205+0000","last_became_peered":"2024-04-25T13:16:08.017205+0000","last_unstale":"2024-04-25T13:16:49.236301+0000","last_undegraded":"2024-04-25T13:16:49.236301+0000","last_fullsized":"2024-04-25T13:16:49.236301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.383669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.133433+0000","last_change":"2024-04-25T13:16:06.992063+0000","last_active":"2024-04-25T13:16:51.133433+0000","last_peered":"2024-04-25T13:16:51.133433+0000","last_clean":"2024-04-25T13:16:51.133433+0000","last_became_active":"2024-04-25T13:16:06.991766+0000","last_became_peered":"2024-04-25T13:16:06.991766+0000","last_unstale":"2024-04-25T13:16:51.133433+0000","last_undegraded":"2024-04-25T13:16:51.133433+0000","last_fullsized":"2024-04-25T13:16:51.133433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:25.728063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235811+0000","last_change":"2024-04-25T13:16:12.734837+0000","last_active":"2024-04-25T13:16:49.235811+0000","last_peered":"2024-04-25T13:16:49.235811+0000","last_clean":"2024-04-25T13:16:49.235811+0000","last_became_active":"2024-04-25T13:16:12.734394+0000","last_became_peered":"2024-04-25T13:16:12.734394+0000","last_unstale":"2024-04-25T13:16:49.235811+0000","last_undegraded":"2024-04-25T13:16:49.235811+0000","last_fullsized":"2024-04-25T13:16:49.235811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:24.740929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129513+0000","last_change":"2024-04-25T13:16:08.000277+0000","last_active":"2024-04-25T13:16:49.129513+0000","last_peered":"2024-04-25T13:16:49.129513+0000","last_clean":"2024-04-25T13:16:49.129513+0000","last_became_active":"2024-04-25T13:16:07.999797+0000","last_became_peered":"2024-04-25T13:16:07.999797+0000","last_unstale":"2024-04-25T13:16:49.129513+0000","last_undegraded":"2024-04-25T13:16:49.129513+0000","last_fullsized":"2024-04-25T13:16:49.129513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:08.860755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.133126+0000","last_change":"2024-04-25T13:16:07.002146+0000","last_active":"2024-04-25T13:16:51.133126+0000","last_peered":"2024-04-25T13:16:51.133126+0000","last_clean":"2024-04-25T13:16:51.133126+0000","last_became_active":"2024-04-25T13:16:07.001918+0000","last_became_peered":"2024-04-25T13:16:07.001918+0000","last_unstale":"2024-04-25T13:16:51.133126+0000","last_undegraded":"2024-04-25T13:16:51.133126+0000","last_fullsized":"2024-04-25T13:16:51.133126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:38.326719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134757+0000","last_change":"2024-04-25T13:16:12.733744+0000","last_active":"2024-04-25T13:16:49.134757+0000","last_peered":"2024-04-25T13:16:49.134757+0000","last_clean":"2024-04-25T13:16:49.134757+0000","last_became_active":"2024-04-25T13:16:12.733361+0000","last_became_peered":"2024-04-25T13:16:12.733361+0000","last_unstale":"2024-04-25T13:16:49.134757+0000","last_undegraded":"2024-04-25T13:16:49.134757+0000","last_fullsized":"2024-04-25T13:16:49.134757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:39.178837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130376+0000","last_change":"2024-04-25T13:16:08.016667+0000","last_active":"2024-04-25T13:16:49.130376+0000","last_peered":"2024-04-25T13:16:49.130376+0000","last_clean":"2024-04-25T13:16:49.130376+0000","last_became_active":"2024-04-25T13:16:08.015172+0000","last_became_peered":"2024-04-25T13:16:08.015172+0000","last_unstale":"2024-04-25T13:16:49.130376+0000","last_undegraded":"2024-04-25T13:16:49.130376+0000","last_fullsized":"2024-04-25T13:16:49.130376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:40.786954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129640+0000","last_change":"2024-04-25T13:16:06.996301+0000","last_active":"2024-04-25T13:16:49.129640+0000","last_peered":"2024-04-25T13:16:49.129640+0000","last_clean":"2024-04-25T13:16:49.129640+0000","last_became_active":"2024-04-25T13:16:06.995957+0000","last_became_peered":"2024-04-25T13:16:06.995957+0000","last_unstale":"2024-04-25T13:16:49.129640+0000","last_undegraded":"2024-04-25T13:16:49.129640+0000","last_fullsized":"2024-04-25T13:16:49.129640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:16.802775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129020+0000","last_change":"2024-04-25T13:16:12.040987+0000","last_active":"2024-04-25T13:16:49.129020+0000","last_peered":"2024-04-25T13:16:49.129020+0000","last_clean":"2024-04-25T13:16:49.129020+0000","last_became_active":"2024-04-25T13:16:12.039987+0000","last_became_peered":"2024-04-25T13:16:12.039987+0000","last_unstale":"2024-04-25T13:16:49.129020+0000","last_undegraded":"2024-04-25T13:16:49.129020+0000","last_fullsized":"2024-04-25T13:16:49.129020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:40.366718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133323+0000","last_change":"2024-04-25T13:16:08.002876+0000","last_active":"2024-04-25T13:16:49.133323+0000","last_peered":"2024-04-25T13:16:49.133323+0000","last_clean":"2024-04-25T13:16:49.133323+0000","last_became_active":"2024-04-25T13:16:08.002131+0000","last_became_peered":"2024-04-25T13:16:08.002131+0000","last_unstale":"2024-04-25T13:16:49.133323+0000","last_undegraded":"2024-04-25T13:16:49.133323+0000","last_fullsized":"2024-04-25T13:16:49.133323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:09.646849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.150771+0000","last_change":"2024-04-25T13:16:06.990075+0000","last_active":"2024-04-25T13:16:56.150771+0000","last_peered":"2024-04-25T13:16:56.150771+0000","last_clean":"2024-04-25T13:16:56.150771+0000","last_became_active":"2024-04-25T13:16:06.989652+0000","last_became_peered":"2024-04-25T13:16:06.989652+0000","last_unstale":"2024-04-25T13:16:56.150771+0000","last_undegraded":"2024-04-25T13:16:56.150771+0000","last_fullsized":"2024-04-25T13:16:56.150771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:29.378995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129361+0000","last_change":"2024-04-25T13:16:12.032906+0000","last_active":"2024-04-25T13:16:49.129361+0000","last_peered":"2024-04-25T13:16:49.129361+0000","last_clean":"2024-04-25T13:16:49.129361+0000","last_became_active":"2024-04-25T13:16:12.032184+0000","last_became_peered":"2024-04-25T13:16:12.032184+0000","last_unstale":"2024-04-25T13:16:49.129361+0000","last_undegraded":"2024-04-25T13:16:49.129361+0000","last_fullsized":"2024-04-25T13:16:49.129361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.724927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.128917+0000","last_change":"2024-04-25T13:16:07.997173+0000","last_active":"2024-04-25T13:16:49.128917+0000","last_peered":"2024-04-25T13:16:49.128917+0000","last_clean":"2024-04-25T13:16:49.128917+0000","last_became_active":"2024-04-25T13:16:07.996545+0000","last_became_peered":"2024-04-25T13:16:07.996545+0000","last_unstale":"2024-04-25T13:16:49.128917+0000","last_undegraded":"2024-04-25T13:16:49.128917+0000","last_fullsized":"2024-04-25T13:16:49.128917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:28.902563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.147729+0000","last_change":"2024-04-25T13:16:06.993674+0000","last_active":"2024-04-25T13:16:56.147729+0000","last_peered":"2024-04-25T13:16:56.147729+0000","last_clean":"2024-04-25T13:16:56.147729+0000","last_became_active":"2024-04-25T13:16:06.993387+0000","last_became_peered":"2024-04-25T13:16:06.993387+0000","last_unstale":"2024-04-25T13:16:56.147729+0000","last_undegraded":"2024-04-25T13:16:56.147729+0000","last_fullsized":"2024-04-25T13:16:56.147729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:13.104822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.238099+0000","last_change":"2024-04-25T13:16:49.237386+0000","last_active":"2024-04-25T13:16:49.238099+0000","last_peered":"2024-04-25T13:16:49.238099+0000","last_clean":"2024-04-25T13:16:49.238099+0000","last_became_active":"2024-04-25T13:16:49.236873+0000","last_became_peered":"2024-04-25T13:16:49.236873+0000","last_unstale":"2024-04-25T13:16:49.238099+0000","last_undegraded":"2024-04-25T13:16:49.238099+0000","last_fullsized":"2024-04-25T13:16:49.238099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:58.580330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133201+0000","last_change":"2024-04-25T13:16:08.004209+0000","last_active":"2024-04-25T13:16:49.133201+0000","last_peered":"2024-04-25T13:16:49.133201+0000","last_clean":"2024-04-25T13:16:49.133201+0000","last_became_active":"2024-04-25T13:16:08.003908+0000","last_became_peered":"2024-04-25T13:16:08.003908+0000","last_unstale":"2024-04-25T13:16:49.133201+0000","last_undegraded":"2024-04-25T13:16:49.133201+0000","last_fullsized":"2024-04-25T13:16:49.133201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:17.027888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130018+0000","last_change":"2024-04-25T13:16:06.999384+0000","last_active":"2024-04-25T13:16:49.130018+0000","last_peered":"2024-04-25T13:16:49.130018+0000","last_clean":"2024-04-25T13:16:49.130018+0000","last_became_active":"2024-04-25T13:16:06.999126+0000","last_became_peered":"2024-04-25T13:16:06.999126+0000","last_unstale":"2024-04-25T13:16:49.130018+0000","last_undegraded":"2024-04-25T13:16:49.130018+0000","last_fullsized":"2024-04-25T13:16:49.130018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:50.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134406+0000","last_change":"2024-04-25T13:16:12.733992+0000","last_active":"2024-04-25T13:16:49.134406+0000","last_peered":"2024-04-25T13:16:49.134406+0000","last_clean":"2024-04-25T13:16:49.134406+0000","last_became_active":"2024-04-25T13:16:12.733316+0000","last_became_peered":"2024-04-25T13:16:12.733316+0000","last_unstale":"2024-04-25T13:16:49.134406+0000","last_undegraded":"2024-04-25T13:16:49.134406+0000","last_fullsized":"2024-04-25T13:16:49.134406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:54.246728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235445+0000","last_change":"2024-04-25T13:16:08.021617+0000","last_active":"2024-04-25T13:16:49.235445+0000","last_peered":"2024-04-25T13:16:49.235445+0000","last_clean":"2024-04-25T13:16:49.235445+0000","last_became_active":"2024-04-25T13:16:08.021346+0000","last_became_peered":"2024-04-25T13:16:08.021346+0000","last_unstale":"2024-04-25T13:16:49.235445+0000","last_undegraded":"2024-04-25T13:16:49.235445+0000","last_fullsized":"2024-04-25T13:16:49.235445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:10.013805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.131254+0000","last_change":"2024-04-25T13:16:06.990638+0000","last_active":"2024-04-25T13:16:51.131254+0000","last_peered":"2024-04-25T13:16:51.131254+0000","last_clean":"2024-04-25T13:16:51.131254+0000","last_became_active":"2024-04-25T13:16:06.990379+0000","last_became_peered":"2024-04-25T13:16:06.990379+0000","last_unstale":"2024-04-25T13:16:51.131254+0000","last_undegraded":"2024-04-25T13:16:51.131254+0000","last_fullsized":"2024-04-25T13:16:51.131254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:39.385990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130081+0000","last_change":"2024-04-25T13:15:57.168598+0000","last_active":"2024-04-25T13:16:49.130081+0000","last_peered":"2024-04-25T13:16:49.130081+0000","last_clean":"2024-04-25T13:16:49.130081+0000","last_became_active":"2024-04-25T13:15:57.167692+0000","last_became_peered":"2024-04-25T13:15:57.167692+0000","last_unstale":"2024-04-25T13:16:49.130081+0000","last_undegraded":"2024-04-25T13:16:49.130081+0000","last_fullsized":"2024-04-25T13:16:49.130081+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_clean_scrub_stamp":"2024-04-25T13:15:55.844647+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:29.123100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235646+0000","last_change":"2024-04-25T13:16:12.734712+0000","last_active":"2024-04-25T13:16:49.235646+0000","last_peered":"2024-04-25T13:16:49.235646+0000","last_clean":"2024-04-25T13:16:49.235646+0000","last_became_active":"2024-04-25T13:16:12.734288+0000","last_became_peered":"2024-04-25T13:16:12.734288+0000","last_unstale":"2024-04-25T13:16:49.235646+0000","last_undegraded":"2024-04-25T13:16:49.235646+0000","last_fullsized":"2024-04-25T13:16:49.235646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:45.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131327+0000","last_change":"2024-04-25T13:16:08.014279+0000","last_active":"2024-04-25T13:16:49.131327+0000","last_peered":"2024-04-25T13:16:49.131327+0000","last_clean":"2024-04-25T13:16:49.131327+0000","last_became_active":"2024-04-25T13:16:08.013989+0000","last_became_peered":"2024-04-25T13:16:08.013989+0000","last_unstale":"2024-04-25T13:16:49.131327+0000","last_undegraded":"2024-04-25T13:16:49.131327+0000","last_fullsized":"2024-04-25T13:16:49.131327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:54.411981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.515732+0000","last_change":"2024-04-25T13:16:06.996774+0000","last_active":"2024-04-25T13:17:04.515732+0000","last_peered":"2024-04-25T13:17:04.515732+0000","last_clean":"2024-04-25T13:17:04.515732+0000","last_became_active":"2024-04-25T13:16:06.996251+0000","last_became_peered":"2024-04-25T13:16:06.996251+0000","last_unstale":"2024-04-25T13:17:04.515732+0000","last_undegraded":"2024-04-25T13:17:04.515732+0000","last_fullsized":"2024-04-25T13:17:04.515732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:01.815602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235463+0000","last_change":"2024-04-25T13:16:12.733562+0000","last_active":"2024-04-25T13:16:49.235463+0000","last_peered":"2024-04-25T13:16:49.235463+0000","last_clean":"2024-04-25T13:16:49.235463+0000","last_became_active":"2024-04-25T13:16:12.733114+0000","last_became_peered":"2024-04-25T13:16:12.733114+0000","last_unstale":"2024-04-25T13:16:49.235463+0000","last_undegraded":"2024-04-25T13:16:49.235463+0000","last_fullsized":"2024-04-25T13:16:49.235463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:20.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131209+0000","last_change":"2024-04-25T13:16:08.011389+0000","last_active":"2024-04-25T13:16:49.131209+0000","last_peered":"2024-04-25T13:16:49.131209+0000","last_clean":"2024-04-25T13:16:49.131209+0000","last_became_active":"2024-04-25T13:16:08.011113+0000","last_became_peered":"2024-04-25T13:16:08.011113+0000","last_unstale":"2024-04-25T13:16:49.131209+0000","last_undegraded":"2024-04-25T13:16:49.131209+0000","last_fullsized":"2024-04-25T13:16:49.131209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:12.339487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.130312+0000","last_change":"2024-04-25T13:16:06.988988+0000","last_active":"2024-04-25T13:16:51.130312+0000","last_peered":"2024-04-25T13:16:51.130312+0000","last_clean":"2024-04-25T13:16:51.130312+0000","last_became_active":"2024-04-25T13:16:06.988631+0000","last_became_peered":"2024-04-25T13:16:06.988631+0000","last_unstale":"2024-04-25T13:16:51.130312+0000","last_undegraded":"2024-04-25T13:16:51.130312+0000","last_fullsized":"2024-04-25T13:16:51.130312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:47.056977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134845+0000","last_change":"2024-04-25T13:16:12.047194+0000","last_active":"2024-04-25T13:16:49.134845+0000","last_peered":"2024-04-25T13:16:49.134845+0000","last_clean":"2024-04-25T13:16:49.134845+0000","last_became_active":"2024-04-25T13:16:12.046780+0000","last_became_peered":"2024-04-25T13:16:12.046780+0000","last_unstale":"2024-04-25T13:16:49.134845+0000","last_undegraded":"2024-04-25T13:16:49.134845+0000","last_fullsized":"2024-04-25T13:16:49.134845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:41.664409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131701+0000","last_change":"2024-04-25T13:16:08.007925+0000","last_active":"2024-04-25T13:16:49.131701+0000","last_peered":"2024-04-25T13:16:49.131701+0000","last_clean":"2024-04-25T13:16:49.131701+0000","last_became_active":"2024-04-25T13:16:08.007681+0000","last_became_peered":"2024-04-25T13:16:08.007681+0000","last_unstale":"2024-04-25T13:16:49.131701+0000","last_undegraded":"2024-04-25T13:16:49.131701+0000","last_fullsized":"2024-04-25T13:16:49.131701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:29.601564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.147255+0000","last_change":"2024-04-25T13:16:06.991912+0000","last_active":"2024-04-25T13:16:56.147255+0000","last_peered":"2024-04-25T13:16:56.147255+0000","last_clean":"2024-04-25T13:16:56.147255+0000","last_became_active":"2024-04-25T13:16:06.991578+0000","last_became_peered":"2024-04-25T13:16:06.991578+0000","last_unstale":"2024-04-25T13:16:56.147255+0000","last_undegraded":"2024-04-25T13:16:56.147255+0000","last_fullsized":"2024-04-25T13:16:56.147255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:59.364396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129381+0000","last_change":"2024-04-25T13:16:12.733567+0000","last_active":"2024-04-25T13:16:49.129381+0000","last_peered":"2024-04-25T13:16:49.129381+0000","last_clean":"2024-04-25T13:16:49.129381+0000","last_became_active":"2024-04-25T13:16:12.733136+0000","last_became_peered":"2024-04-25T13:16:12.733136+0000","last_unstale":"2024-04-25T13:16:49.129381+0000","last_undegraded":"2024-04-25T13:16:49.129381+0000","last_fullsized":"2024-04-25T13:16:49.129381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:29.125928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131176+0000","last_change":"2024-04-25T13:16:08.004897+0000","last_active":"2024-04-25T13:16:49.131176+0000","last_peered":"2024-04-25T13:16:49.131176+0000","last_clean":"2024-04-25T13:16:49.131176+0000","last_became_active":"2024-04-25T13:16:08.004180+0000","last_became_peered":"2024-04-25T13:16:08.004180+0000","last_unstale":"2024-04-25T13:16:49.131176+0000","last_undegraded":"2024-04-25T13:16:49.131176+0000","last_fullsized":"2024-04-25T13:16:49.131176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:12.011447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132694+0000","last_change":"2024-04-25T13:16:06.994487+0000","last_active":"2024-04-25T13:16:49.132694+0000","last_peered":"2024-04-25T13:16:49.132694+0000","last_clean":"2024-04-25T13:16:49.132694+0000","last_became_active":"2024-04-25T13:16:06.994235+0000","last_became_peered":"2024-04-25T13:16:06.994235+0000","last_unstale":"2024-04-25T13:16:49.132694+0000","last_undegraded":"2024-04-25T13:16:49.132694+0000","last_fullsized":"2024-04-25T13:16:49.132694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131872+0000","last_change":"2024-04-25T13:16:12.039277+0000","last_active":"2024-04-25T13:16:49.131872+0000","last_peered":"2024-04-25T13:16:49.131872+0000","last_clean":"2024-04-25T13:16:49.131872+0000","last_became_active":"2024-04-25T13:16:12.038534+0000","last_became_peered":"2024-04-25T13:16:12.038534+0000","last_unstale":"2024-04-25T13:16:49.131872+0000","last_undegraded":"2024-04-25T13:16:49.131872+0000","last_fullsized":"2024-04-25T13:16:49.131872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:59.495976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130166+0000","last_change":"2024-04-25T13:16:08.007302+0000","last_active":"2024-04-25T13:16:49.130166+0000","last_peered":"2024-04-25T13:16:49.130166+0000","last_clean":"2024-04-25T13:16:49.130166+0000","last_became_active":"2024-04-25T13:16:08.007050+0000","last_became_peered":"2024-04-25T13:16:08.007050+0000","last_unstale":"2024-04-25T13:16:49.130166+0000","last_undegraded":"2024-04-25T13:16:49.130166+0000","last_fullsized":"2024-04-25T13:16:49.130166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:35.369188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.131068+0000","last_change":"2024-04-25T13:16:06.982609+0000","last_active":"2024-04-25T13:16:51.131068+0000","last_peered":"2024-04-25T13:16:51.131068+0000","last_clean":"2024-04-25T13:16:51.131068+0000","last_became_active":"2024-04-25T13:16:06.982320+0000","last_became_peered":"2024-04-25T13:16:06.982320+0000","last_unstale":"2024-04-25T13:16:51.131068+0000","last_undegraded":"2024-04-25T13:16:51.131068+0000","last_fullsized":"2024-04-25T13:16:51.131068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:55.372968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134321+0000","last_change":"2024-04-25T13:16:12.043657+0000","last_active":"2024-04-25T13:16:49.134321+0000","last_peered":"2024-04-25T13:16:49.134321+0000","last_clean":"2024-04-25T13:16:49.134321+0000","last_became_active":"2024-04-25T13:16:12.042902+0000","last_became_peered":"2024-04-25T13:16:12.042902+0000","last_unstale":"2024-04-25T13:16:49.134321+0000","last_undegraded":"2024-04-25T13:16:49.134321+0000","last_fullsized":"2024-04-25T13:16:49.134321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:46.721199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236046+0000","last_change":"2024-04-25T13:16:08.008534+0000","last_active":"2024-04-25T13:16:49.236046+0000","last_peered":"2024-04-25T13:16:49.236046+0000","last_clean":"2024-04-25T13:16:49.236046+0000","last_became_active":"2024-04-25T13:16:08.008102+0000","last_became_peered":"2024-04-25T13:16:08.008102+0000","last_unstale":"2024-04-25T13:16:49.236046+0000","last_undegraded":"2024-04-25T13:16:49.236046+0000","last_fullsized":"2024-04-25T13:16:49.236046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:48.331724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.520370+0000","last_change":"2024-04-25T13:16:06.993292+0000","last_active":"2024-04-25T13:17:04.520370+0000","last_peered":"2024-04-25T13:17:04.520370+0000","last_clean":"2024-04-25T13:17:04.520370+0000","last_became_active":"2024-04-25T13:16:06.993008+0000","last_became_peered":"2024-04-25T13:16:06.993008+0000","last_unstale":"2024-04-25T13:17:04.520370+0000","last_undegraded":"2024-04-25T13:17:04.520370+0000","last_fullsized":"2024-04-25T13:17:04.520370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236165+0000","last_change":"2024-04-25T13:16:12.733945+0000","last_active":"2024-04-25T13:16:49.236165+0000","last_peered":"2024-04-25T13:16:49.236165+0000","last_clean":"2024-04-25T13:16:49.236165+0000","last_became_active":"2024-04-25T13:16:12.733359+0000","last_became_peered":"2024-04-25T13:16:12.733359+0000","last_unstale":"2024-04-25T13:16:49.236165+0000","last_undegraded":"2024-04-25T13:16:49.236165+0000","last_fullsized":"2024-04-25T13:16:49.236165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:27.352613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131189+0000","last_change":"2024-04-25T13:16:08.008034+0000","last_active":"2024-04-25T13:16:49.131189+0000","last_peered":"2024-04-25T13:16:49.131189+0000","last_clean":"2024-04-25T13:16:49.131189+0000","last_became_active":"2024-04-25T13:16:08.007790+0000","last_became_peered":"2024-04-25T13:16:08.007790+0000","last_unstale":"2024-04-25T13:16:49.131189+0000","last_undegraded":"2024-04-25T13:16:49.131189+0000","last_fullsized":"2024-04-25T13:16:49.131189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:35.903237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.130884+0000","last_change":"2024-04-25T13:16:06.996737+0000","last_active":"2024-04-25T13:16:51.130884+0000","last_peered":"2024-04-25T13:16:51.130884+0000","last_clean":"2024-04-25T13:16:51.130884+0000","last_became_active":"2024-04-25T13:16:06.996439+0000","last_became_peered":"2024-04-25T13:16:06.996439+0000","last_unstale":"2024-04-25T13:16:51.130884+0000","last_undegraded":"2024-04-25T13:16:51.130884+0000","last_fullsized":"2024-04-25T13:16:51.130884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:36.400030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235760+0000","last_change":"2024-04-25T13:16:12.734393+0000","last_active":"2024-04-25T13:16:49.235760+0000","last_peered":"2024-04-25T13:16:49.235760+0000","last_clean":"2024-04-25T13:16:49.235760+0000","last_became_active":"2024-04-25T13:16:12.733328+0000","last_became_peered":"2024-04-25T13:16:12.733328+0000","last_unstale":"2024-04-25T13:16:49.235760+0000","last_undegraded":"2024-04-25T13:16:49.235760+0000","last_fullsized":"2024-04-25T13:16:49.235760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.254012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.136838+0000","last_change":"2024-04-25T13:16:49.135983+0000","last_active":"2024-04-25T13:16:49.136838+0000","last_peered":"2024-04-25T13:16:49.136838+0000","last_clean":"2024-04-25T13:16:49.136838+0000","last_became_active":"2024-04-25T13:16:49.135704+0000","last_became_peered":"2024-04-25T13:16:49.135704+0000","last_unstale":"2024-04-25T13:16:49.136838+0000","last_undegraded":"2024-04-25T13:16:49.136838+0000","last_fullsized":"2024-04-25T13:16:49.136838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:22.268728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.150750+0000","last_change":"2024-04-25T13:16:07.000559+0000","last_active":"2024-04-25T13:16:56.150750+0000","last_peered":"2024-04-25T13:16:56.150750+0000","last_clean":"2024-04-25T13:16:56.150750+0000","last_became_active":"2024-04-25T13:16:07.000243+0000","last_became_peered":"2024-04-25T13:16:07.000243+0000","last_unstale":"2024-04-25T13:16:56.150750+0000","last_undegraded":"2024-04-25T13:16:56.150750+0000","last_fullsized":"2024-04-25T13:16:56.150750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:01.672221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130148+0000","last_change":"2024-04-25T13:16:12.733681+0000","last_active":"2024-04-25T13:16:49.130148+0000","last_peered":"2024-04-25T13:16:49.130148+0000","last_clean":"2024-04-25T13:16:49.130148+0000","last_became_active":"2024-04-25T13:16:12.733245+0000","last_became_peered":"2024-04-25T13:16:12.733245+0000","last_unstale":"2024-04-25T13:16:49.130148+0000","last_undegraded":"2024-04-25T13:16:49.130148+0000","last_fullsized":"2024-04-25T13:16:49.130148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.028858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131242+0000","last_change":"2024-04-25T13:16:08.008790+0000","last_active":"2024-04-25T13:16:49.131242+0000","last_peered":"2024-04-25T13:16:49.131242+0000","last_clean":"2024-04-25T13:16:49.131242+0000","last_became_active":"2024-04-25T13:16:08.008530+0000","last_became_peered":"2024-04-25T13:16:08.008530+0000","last_unstale":"2024-04-25T13:16:49.131242+0000","last_undegraded":"2024-04-25T13:16:49.131242+0000","last_fullsized":"2024-04-25T13:16:49.131242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:44.215930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.525527+0000","last_change":"2024-04-25T13:16:06.997575+0000","last_active":"2024-04-25T13:17:04.525527+0000","last_peered":"2024-04-25T13:17:04.525527+0000","last_clean":"2024-04-25T13:17:04.525527+0000","last_became_active":"2024-04-25T13:16:06.997289+0000","last_became_peered":"2024-04-25T13:16:06.997289+0000","last_unstale":"2024-04-25T13:17:04.525527+0000","last_undegraded":"2024-04-25T13:17:04.525527+0000","last_fullsized":"2024-04-25T13:17:04.525527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:54.096662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129133+0000","last_change":"2024-04-25T13:16:12.040456+0000","last_active":"2024-04-25T13:16:49.129133+0000","last_peered":"2024-04-25T13:16:49.129133+0000","last_clean":"2024-04-25T13:16:49.129133+0000","last_became_active":"2024-04-25T13:16:12.039443+0000","last_became_peered":"2024-04-25T13:16:12.039443+0000","last_unstale":"2024-04-25T13:16:49.129133+0000","last_undegraded":"2024-04-25T13:16:49.129133+0000","last_fullsized":"2024-04-25T13:16:49.129133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:23.192500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132567+0000","last_change":"2024-04-25T13:16:08.004618+0000","last_active":"2024-04-25T13:16:49.132567+0000","last_peered":"2024-04-25T13:16:49.132567+0000","last_clean":"2024-04-25T13:16:49.132567+0000","last_became_active":"2024-04-25T13:16:08.002583+0000","last_became_peered":"2024-04-25T13:16:08.002583+0000","last_unstale":"2024-04-25T13:16:49.132567+0000","last_undegraded":"2024-04-25T13:16:49.132567+0000","last_fullsized":"2024-04-25T13:16:49.132567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:25.609409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129519+0000","last_change":"2024-04-25T13:16:06.996610+0000","last_active":"2024-04-25T13:16:49.129519+0000","last_peered":"2024-04-25T13:16:49.129519+0000","last_clean":"2024-04-25T13:16:49.129519+0000","last_became_active":"2024-04-25T13:16:06.995616+0000","last_became_peered":"2024-04-25T13:16:06.995616+0000","last_unstale":"2024-04-25T13:16:49.129519+0000","last_undegraded":"2024-04-25T13:16:49.129519+0000","last_fullsized":"2024-04-25T13:16:49.129519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:21.135053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133232+0000","last_change":"2024-04-25T13:16:12.043744+0000","last_active":"2024-04-25T13:16:49.133232+0000","last_peered":"2024-04-25T13:16:49.133232+0000","last_clean":"2024-04-25T13:16:49.133232+0000","last_became_active":"2024-04-25T13:16:12.043267+0000","last_became_peered":"2024-04-25T13:16:12.043267+0000","last_unstale":"2024-04-25T13:16:49.133232+0000","last_undegraded":"2024-04-25T13:16:49.133232+0000","last_fullsized":"2024-04-25T13:16:49.133232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:52.316751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.137097+0000","last_change":"2024-04-25T13:16:49.137097+0000","last_active":"2024-04-25T13:16:49.137097+0000","last_peered":"2024-04-25T13:16:49.137097+0000","last_clean":"2024-04-25T13:16:49.137097+0000","last_became_active":"2024-04-25T13:16:49.136773+0000","last_became_peered":"2024-04-25T13:16:49.136773+0000","last_unstale":"2024-04-25T13:16:49.137097+0000","last_undegraded":"2024-04-25T13:16:49.137097+0000","last_fullsized":"2024-04-25T13:16:49.137097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:56.580060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.148921+0000","last_change":"2024-04-25T13:16:06.997061+0000","last_active":"2024-04-25T13:16:56.148921+0000","last_peered":"2024-04-25T13:16:56.148921+0000","last_clean":"2024-04-25T13:16:56.148921+0000","last_became_active":"2024-04-25T13:16:06.996418+0000","last_became_peered":"2024-04-25T13:16:06.996418+0000","last_unstale":"2024-04-25T13:16:56.148921+0000","last_undegraded":"2024-04-25T13:16:56.148921+0000","last_fullsized":"2024-04-25T13:16:56.148921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:34.878260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236082+0000","last_change":"2024-04-25T13:16:12.042796+0000","last_active":"2024-04-25T13:16:49.236082+0000","last_peered":"2024-04-25T13:16:49.236082+0000","last_clean":"2024-04-25T13:16:49.236082+0000","last_became_active":"2024-04-25T13:16:12.042252+0000","last_became_peered":"2024-04-25T13:16:12.042252+0000","last_unstale":"2024-04-25T13:16:49.236082+0000","last_undegraded":"2024-04-25T13:16:49.236082+0000","last_fullsized":"2024-04-25T13:16:49.236082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:51.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130623+0000","last_change":"2024-04-25T13:16:08.016203+0000","last_active":"2024-04-25T13:16:49.130623+0000","last_peered":"2024-04-25T13:16:49.130623+0000","last_clean":"2024-04-25T13:16:49.130623+0000","last_became_active":"2024-04-25T13:16:08.015820+0000","last_became_peered":"2024-04-25T13:16:08.015820+0000","last_unstale":"2024-04-25T13:16:49.130623+0000","last_undegraded":"2024-04-25T13:16:49.130623+0000","last_fullsized":"2024-04-25T13:16:49.130623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.518227+0000","last_change":"2024-04-25T13:16:06.996624+0000","last_active":"2024-04-25T13:17:04.518227+0000","last_peered":"2024-04-25T13:17:04.518227+0000","last_clean":"2024-04-25T13:17:04.518227+0000","last_became_active":"2024-04-25T13:16:06.996373+0000","last_became_peered":"2024-04-25T13:16:06.996373+0000","last_unstale":"2024-04-25T13:17:04.518227+0000","last_undegraded":"2024-04-25T13:17:04.518227+0000","last_fullsized":"2024-04-25T13:17:04.518227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:29.929030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235595+0000","last_change":"2024-04-25T13:16:12.733792+0000","last_active":"2024-04-25T13:16:49.235595+0000","last_peered":"2024-04-25T13:16:49.235595+0000","last_clean":"2024-04-25T13:16:49.235595+0000","last_became_active":"2024-04-25T13:16:12.733314+0000","last_became_peered":"2024-04-25T13:16:12.733314+0000","last_unstale":"2024-04-25T13:16:49.235595+0000","last_undegraded":"2024-04-25T13:16:49.235595+0000","last_fullsized":"2024-04-25T13:16:49.235595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.836368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134224+0000","last_change":"2024-04-25T13:16:12.734573+0000","last_active":"2024-04-25T13:16:49.134224+0000","last_peered":"2024-04-25T13:16:49.134224+0000","last_clean":"2024-04-25T13:16:49.134224+0000","last_became_active":"2024-04-25T13:16:12.733908+0000","last_became_peered":"2024-04-25T13:16:12.733908+0000","last_unstale":"2024-04-25T13:16:49.134224+0000","last_undegraded":"2024-04-25T13:16:49.134224+0000","last_fullsized":"2024-04-25T13:16:49.134224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:59.673528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.128734+0000","last_change":"2024-04-25T13:16:08.008915+0000","last_active":"2024-04-25T13:16:49.128734+0000","last_peered":"2024-04-25T13:16:49.128734+0000","last_clean":"2024-04-25T13:16:49.128734+0000","last_became_active":"2024-04-25T13:16:08.008586+0000","last_became_peered":"2024-04-25T13:16:08.008586+0000","last_unstale":"2024-04-25T13:16:49.128734+0000","last_undegraded":"2024-04-25T13:16:49.128734+0000","last_fullsized":"2024-04-25T13:16:49.128734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:46.905065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.132985+0000","last_change":"2024-04-25T13:16:06.994489+0000","last_active":"2024-04-25T13:16:51.132985+0000","last_peered":"2024-04-25T13:16:51.132985+0000","last_clean":"2024-04-25T13:16:51.132985+0000","last_became_active":"2024-04-25T13:16:06.994005+0000","last_became_peered":"2024-04-25T13:16:06.994005+0000","last_unstale":"2024-04-25T13:16:51.132985+0000","last_undegraded":"2024-04-25T13:16:51.132985+0000","last_fullsized":"2024-04-25T13:16:51.132985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:43.921452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235786+0000","last_change":"2024-04-25T13:16:12.037008+0000","last_active":"2024-04-25T13:16:49.235786+0000","last_peered":"2024-04-25T13:16:49.235786+0000","last_clean":"2024-04-25T13:16:49.235786+0000","last_became_active":"2024-04-25T13:16:12.036569+0000","last_became_peered":"2024-04-25T13:16:12.036569+0000","last_unstale":"2024-04-25T13:16:49.235786+0000","last_undegraded":"2024-04-25T13:16:49.235786+0000","last_fullsized":"2024-04-25T13:16:49.235786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:48.224913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236198+0000","last_change":"2024-04-25T13:16:08.008747+0000","last_active":"2024-04-25T13:16:49.236198+0000","last_peered":"2024-04-25T13:16:49.236198+0000","last_clean":"2024-04-25T13:16:49.236198+0000","last_became_active":"2024-04-25T13:16:08.008078+0000","last_became_peered":"2024-04-25T13:16:08.008078+0000","last_unstale":"2024-04-25T13:16:49.236198+0000","last_undegraded":"2024-04-25T13:16:49.236198+0000","last_fullsized":"2024-04-25T13:16:49.236198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:19.590099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236018+0000","last_change":"2024-04-25T13:16:06.997642+0000","last_active":"2024-04-25T13:16:49.236018+0000","last_peered":"2024-04-25T13:16:49.236018+0000","last_clean":"2024-04-25T13:16:49.236018+0000","last_became_active":"2024-04-25T13:16:06.996985+0000","last_became_peered":"2024-04-25T13:16:06.996985+0000","last_unstale":"2024-04-25T13:16:49.236018+0000","last_undegraded":"2024-04-25T13:16:49.236018+0000","last_fullsized":"2024-04-25T13:16:49.236018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:49.853125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.133935+0000","last_change":"2024-04-25T13:16:06.992687+0000","last_active":"2024-04-25T13:16:51.133935+0000","last_peered":"2024-04-25T13:16:51.133935+0000","last_clean":"2024-04-25T13:16:51.133935+0000","last_became_active":"2024-04-25T13:16:06.992407+0000","last_became_peered":"2024-04-25T13:16:06.992407+0000","last_unstale":"2024-04-25T13:16:51.133935+0000","last_undegraded":"2024-04-25T13:16:51.133935+0000","last_fullsized":"2024-04-25T13:16:51.133935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:37.658458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134927+0000","last_change":"2024-04-25T13:16:08.004510+0000","last_active":"2024-04-25T13:16:49.134927+0000","last_peered":"2024-04-25T13:16:49.134927+0000","last_clean":"2024-04-25T13:16:49.134927+0000","last_became_active":"2024-04-25T13:16:08.003959+0000","last_became_peered":"2024-04-25T13:16:08.003959+0000","last_unstale":"2024-04-25T13:16:49.134927+0000","last_undegraded":"2024-04-25T13:16:49.134927+0000","last_fullsized":"2024-04-25T13:16:49.134927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:45.142873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131981+0000","last_change":"2024-04-25T13:16:12.037097+0000","last_active":"2024-04-25T13:16:49.131981+0000","last_peered":"2024-04-25T13:16:49.131981+0000","last_clean":"2024-04-25T13:16:49.131981+0000","last_became_active":"2024-04-25T13:16:12.036651+0000","last_became_peered":"2024-04-25T13:16:12.036651+0000","last_unstale":"2024-04-25T13:16:49.131981+0000","last_undegraded":"2024-04-25T13:16:49.131981+0000","last_fullsized":"2024-04-25T13:16:49.131981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:34.443514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.518175+0000","last_change":"2024-04-25T13:16:06.996311+0000","last_active":"2024-04-25T13:17:04.518175+0000","last_peered":"2024-04-25T13:17:04.518175+0000","last_clean":"2024-04-25T13:17:04.518175+0000","last_became_active":"2024-04-25T13:16:06.996010+0000","last_became_peered":"2024-04-25T13:16:06.996010+0000","last_unstale":"2024-04-25T13:17:04.518175+0000","last_undegraded":"2024-04-25T13:17:04.518175+0000","last_fullsized":"2024-04-25T13:17:04.518175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:08.835482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132357+0000","last_change":"2024-04-25T13:16:08.002159+0000","last_active":"2024-04-25T13:16:49.132357+0000","last_peered":"2024-04-25T13:16:49.132357+0000","last_clean":"2024-04-25T13:16:49.132357+0000","last_became_active":"2024-04-25T13:16:08.001833+0000","last_became_peered":"2024-04-25T13:16:08.001833+0000","last_unstale":"2024-04-25T13:16:49.132357+0000","last_undegraded":"2024-04-25T13:16:49.132357+0000","last_fullsized":"2024-04-25T13:16:49.132357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:25.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236270+0000","last_change":"2024-04-25T13:16:12.042721+0000","last_active":"2024-04-25T13:16:49.236270+0000","last_peered":"2024-04-25T13:16:49.236270+0000","last_clean":"2024-04-25T13:16:49.236270+0000","last_became_active":"2024-04-25T13:16:12.042000+0000","last_became_peered":"2024-04-25T13:16:12.042000+0000","last_unstale":"2024-04-25T13:16:49.236270+0000","last_undegraded":"2024-04-25T13:16:49.236270+0000","last_fullsized":"2024-04-25T13:16:49.236270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:18.702032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235823+0000","last_change":"2024-04-25T13:16:08.008364+0000","last_active":"2024-04-25T13:16:49.235823+0000","last_peered":"2024-04-25T13:16:49.235823+0000","last_clean":"2024-04-25T13:16:49.235823+0000","last_became_active":"2024-04-25T13:16:08.007728+0000","last_became_peered":"2024-04-25T13:16:08.007728+0000","last_unstale":"2024-04-25T13:16:49.235823+0000","last_undegraded":"2024-04-25T13:16:49.235823+0000","last_fullsized":"2024-04-25T13:16:49.235823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:08.731178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131539+0000","last_change":"2024-04-25T13:16:08.011273+0000","last_active":"2024-04-25T13:16:49.131539+0000","last_peered":"2024-04-25T13:16:49.131539+0000","last_clean":"2024-04-25T13:16:49.131539+0000","last_became_active":"2024-04-25T13:16:08.010981+0000","last_became_peered":"2024-04-25T13:16:08.010981+0000","last_unstale":"2024-04-25T13:16:49.131539+0000","last_undegraded":"2024-04-25T13:16:49.131539+0000","last_fullsized":"2024-04-25T13:16:49.131539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:03.835422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130170+0000","last_change":"2024-04-25T13:16:08.016413+0000","last_active":"2024-04-25T13:16:49.130170+0000","last_peered":"2024-04-25T13:16:49.130170+0000","last_clean":"2024-04-25T13:16:49.130170+0000","last_became_active":"2024-04-25T13:16:08.016084+0000","last_became_peered":"2024-04-25T13:16:08.016084+0000","last_unstale":"2024-04-25T13:16:49.130170+0000","last_undegraded":"2024-04-25T13:16:49.130170+0000","last_fullsized":"2024-04-25T13:16:49.130170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:41.014999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.138094+0000","last_change":"2024-04-25T13:16:49.138094+0000","last_active":"2024-04-25T13:16:49.138094+0000","last_peered":"2024-04-25T13:16:49.138094+0000","last_clean":"2024-04-25T13:16:49.138094+0000","last_became_active":"2024-04-25T13:16:49.137825+0000","last_became_peered":"2024-04-25T13:16:49.137825+0000","last_unstale":"2024-04-25T13:16:49.138094+0000","last_undegraded":"2024-04-25T13:16:49.138094+0000","last_fullsized":"2024-04-25T13:16:49.138094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:52.534923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236041+0000","last_change":"2024-04-25T13:16:08.012814+0000","last_active":"2024-04-25T13:16:49.236041+0000","last_peered":"2024-04-25T13:16:49.236041+0000","last_clean":"2024-04-25T13:16:49.236041+0000","last_became_active":"2024-04-25T13:16:08.012481+0000","last_became_peered":"2024-04-25T13:16:08.012481+0000","last_unstale":"2024-04-25T13:16:49.236041+0000","last_undegraded":"2024-04-25T13:16:49.236041+0000","last_fullsized":"2024-04-25T13:16:49.236041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:05.409701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129200+0000","last_change":"2024-04-25T13:16:08.008843+0000","last_active":"2024-04-25T13:16:49.129200+0000","last_peered":"2024-04-25T13:16:49.129200+0000","last_clean":"2024-04-25T13:16:49.129200+0000","last_became_active":"2024-04-25T13:16:08.008489+0000","last_became_peered":"2024-04-25T13:16:08.008489+0000","last_unstale":"2024-04-25T13:16:49.129200+0000","last_undegraded":"2024-04-25T13:16:49.129200+0000","last_fullsized":"2024-04-25T13:16:49.129200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:35.740816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236176+0000","last_change":"2024-04-25T13:16:08.008121+0000","last_active":"2024-04-25T13:16:49.236176+0000","last_peered":"2024-04-25T13:16:49.236176+0000","last_clean":"2024-04-25T13:16:49.236176+0000","last_became_active":"2024-04-25T13:16:08.007727+0000","last_became_peered":"2024-04-25T13:16:08.007727+0000","last_unstale":"2024-04-25T13:16:49.236176+0000","last_undegraded":"2024-04-25T13:16:49.236176+0000","last_fullsized":"2024-04-25T13:16:49.236176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:11.193610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236219+0000","last_change":"2024-04-25T13:16:08.014997+0000","last_active":"2024-04-25T13:16:49.236219+0000","last_peered":"2024-04-25T13:16:49.236219+0000","last_clean":"2024-04-25T13:16:49.236219+0000","last_became_active":"2024-04-25T13:16:08.014579+0000","last_became_peered":"2024-04-25T13:16:08.014579+0000","last_unstale":"2024-04-25T13:16:49.236219+0000","last_undegraded":"2024-04-25T13:16:49.236219+0000","last_fullsized":"2024-04-25T13:16:49.236219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:07.884249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129692+0000","last_change":"2024-04-25T13:16:08.015379+0000","last_active":"2024-04-25T13:16:49.129692+0000","last_peered":"2024-04-25T13:16:49.129692+0000","last_clean":"2024-04-25T13:16:49.129692+0000","last_became_active":"2024-04-25T13:16:08.014693+0000","last_became_peered":"2024-04-25T13:16:08.014693+0000","last_unstale":"2024-04-25T13:16:49.129692+0000","last_undegraded":"2024-04-25T13:16:49.129692+0000","last_fullsized":"2024-04-25T13:16:49.129692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:41.305358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235707+0000","last_change":"2024-04-25T13:16:08.014873+0000","last_active":"2024-04-25T13:16:49.235707+0000","last_peered":"2024-04-25T13:16:49.235707+0000","last_clean":"2024-04-25T13:16:49.235707+0000","last_became_active":"2024-04-25T13:16:08.014575+0000","last_became_peered":"2024-04-25T13:16:08.014575+0000","last_unstale":"2024-04-25T13:16:49.235707+0000","last_undegraded":"2024-04-25T13:16:49.235707+0000","last_fullsized":"2024-04-25T13:16:49.235707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:41.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.135573+0000","last_change":"2024-04-25T13:16:49.133825+0000","last_active":"2024-04-25T13:16:49.135573+0000","last_peered":"2024-04-25T13:16:49.135573+0000","last_clean":"2024-04-25T13:16:49.135573+0000","last_became_active":"2024-04-25T13:16:49.133449+0000","last_became_peered":"2024-04-25T13:16:49.133449+0000","last_unstale":"2024-04-25T13:16:49.135573+0000","last_undegraded":"2024-04-25T13:16:49.135573+0000","last_fullsized":"2024-04-25T13:16:49.135573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:44.601144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134802+0000","last_change":"2024-04-25T13:16:08.000447+0000","last_active":"2024-04-25T13:16:49.134802+0000","last_peered":"2024-04-25T13:16:49.134802+0000","last_clean":"2024-04-25T13:16:49.134802+0000","last_became_active":"2024-04-25T13:16:08.000102+0000","last_became_peered":"2024-04-25T13:16:08.000102+0000","last_unstale":"2024-04-25T13:16:49.134802+0000","last_undegraded":"2024-04-25T13:16:49.134802+0000","last_fullsized":"2024-04-25T13:16:49.134802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:30.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235889+0000","last_change":"2024-04-25T13:16:08.008437+0000","last_active":"2024-04-25T13:16:49.235889+0000","last_peered":"2024-04-25T13:16:49.235889+0000","last_clean":"2024-04-25T13:16:49.235889+0000","last_became_active":"2024-04-25T13:16:08.008173+0000","last_became_peered":"2024-04-25T13:16:08.008173+0000","last_unstale":"2024-04-25T13:16:49.235889+0000","last_undegraded":"2024-04-25T13:16:49.235889+0000","last_fullsized":"2024-04-25T13:16:49.235889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:54.362757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131654+0000","last_change":"2024-04-25T13:16:08.004689+0000","last_active":"2024-04-25T13:16:49.131654+0000","last_peered":"2024-04-25T13:16:49.131654+0000","last_clean":"2024-04-25T13:16:49.131654+0000","last_became_active":"2024-04-25T13:16:08.004340+0000","last_became_peered":"2024-04-25T13:16:08.004340+0000","last_unstale":"2024-04-25T13:16:49.131654+0000","last_undegraded":"2024-04-25T13:16:49.131654+0000","last_fullsized":"2024-04-25T13:16:49.131654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:18.870731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132255+0000","last_change":"2024-04-25T13:16:08.005344+0000","last_active":"2024-04-25T13:16:49.132255+0000","last_peered":"2024-04-25T13:16:49.132255+0000","last_clean":"2024-04-25T13:16:49.132255+0000","last_became_active":"2024-04-25T13:16:08.005041+0000","last_became_peered":"2024-04-25T13:16:08.005041+0000","last_unstale":"2024-04-25T13:16:49.132255+0000","last_undegraded":"2024-04-25T13:16:49.132255+0000","last_fullsized":"2024-04-25T13:16:49.132255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.389800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.136388+0000","last_change":"2024-04-25T13:16:49.135779+0000","last_active":"2024-04-25T13:16:49.136388+0000","last_peered":"2024-04-25T13:16:49.136388+0000","last_clean":"2024-04-25T13:16:49.136388+0000","last_became_active":"2024-04-25T13:16:49.135476+0000","last_became_peered":"2024-04-25T13:16:49.135476+0000","last_unstale":"2024-04-25T13:16:49.136388+0000","last_undegraded":"2024-04-25T13:16:49.136388+0000","last_fullsized":"2024-04-25T13:16:49.136388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:47.445270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129582+0000","last_change":"2024-04-25T13:16:08.012737+0000","last_active":"2024-04-25T13:16:49.129582+0000","last_peered":"2024-04-25T13:16:49.129582+0000","last_clean":"2024-04-25T13:16:49.129582+0000","last_became_active":"2024-04-25T13:16:08.012472+0000","last_became_peered":"2024-04-25T13:16:08.012472+0000","last_unstale":"2024-04-25T13:16:49.129582+0000","last_undegraded":"2024-04-25T13:16:49.129582+0000","last_fullsized":"2024-04-25T13:16:49.129582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:36.880757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.128898+0000","last_change":"2024-04-25T13:16:08.007177+0000","last_active":"2024-04-25T13:16:49.128898+0000","last_peered":"2024-04-25T13:16:49.128898+0000","last_clean":"2024-04-25T13:16:49.128898+0000","last_became_active":"2024-04-25T13:16:08.006866+0000","last_became_peered":"2024-04-25T13:16:08.006866+0000","last_unstale":"2024-04-25T13:16:49.128898+0000","last_undegraded":"2024-04-25T13:16:49.128898+0000","last_fullsized":"2024-04-25T13:16:49.128898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:16.707771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133723+0000","last_change":"2024-04-25T13:16:07.999761+0000","last_active":"2024-04-25T13:16:49.133723+0000","last_peered":"2024-04-25T13:16:49.133723+0000","last_clean":"2024-04-25T13:16:49.133723+0000","last_became_active":"2024-04-25T13:16:07.999033+0000","last_became_peered":"2024-04-25T13:16:07.999033+0000","last_unstale":"2024-04-25T13:16:49.133723+0000","last_undegraded":"2024-04-25T13:16:49.133723+0000","last_fullsized":"2024-04-25T13:16:49.133723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:40.420290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235662+0000","last_change":"2024-04-25T13:16:08.016370+0000","last_active":"2024-04-25T13:16:49.235662+0000","last_peered":"2024-04-25T13:16:49.235662+0000","last_clean":"2024-04-25T13:16:49.235662+0000","last_became_active":"2024-04-25T13:16:08.016068+0000","last_became_peered":"2024-04-25T13:16:08.016068+0000","last_unstale":"2024-04-25T13:16:49.235662+0000","last_undegraded":"2024-04-25T13:16:49.235662+0000","last_fullsized":"2024-04-25T13:16:49.235662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:11.475920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132457+0000","last_change":"2024-04-25T13:16:08.005195+0000","last_active":"2024-04-25T13:16:49.132457+0000","last_peered":"2024-04-25T13:16:49.132457+0000","last_clean":"2024-04-25T13:16:49.132457+0000","last_became_active":"2024-04-25T13:16:08.004655+0000","last_became_peered":"2024-04-25T13:16:08.004655+0000","last_unstale":"2024-04-25T13:16:49.132457+0000","last_undegraded":"2024-04-25T13:16:49.132457+0000","last_fullsized":"2024-04-25T13:16:49.132457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:28.249616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235787+0000","last_change":"2024-04-25T13:16:08.011310+0000","last_active":"2024-04-25T13:16:49.235787+0000","last_peered":"2024-04-25T13:16:49.235787+0000","last_clean":"2024-04-25T13:16:49.235787+0000","last_became_active":"2024-04-25T13:16:08.011047+0000","last_became_peered":"2024-04-25T13:16:08.011047+0000","last_unstale":"2024-04-25T13:16:49.235787+0000","last_undegraded":"2024-04-25T13:16:49.235787+0000","last_fullsized":"2024-04-25T13:16:49.235787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:55.447995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236059+0000","last_change":"2024-04-25T13:16:08.012191+0000","last_active":"2024-04-25T13:16:49.236059+0000","last_peered":"2024-04-25T13:16:49.236059+0000","last_clean":"2024-04-25T13:16:49.236059+0000","last_became_active":"2024-04-25T13:16:08.011916+0000","last_became_peered":"2024-04-25T13:16:08.011916+0000","last_unstale":"2024-04-25T13:16:49.236059+0000","last_undegraded":"2024-04-25T13:16:49.236059+0000","last_fullsized":"2024-04-25T13:16:49.236059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:33.520554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131648+0000","last_change":"2024-04-25T13:16:08.012349+0000","last_active":"2024-04-25T13:16:49.131648+0000","last_peered":"2024-04-25T13:16:49.131648+0000","last_clean":"2024-04-25T13:16:49.131648+0000","last_became_active":"2024-04-25T13:16:08.011893+0000","last_became_peered":"2024-04-25T13:16:08.011893+0000","last_unstale":"2024-04-25T13:16:49.131648+0000","last_undegraded":"2024-04-25T13:16:49.131648+0000","last_fullsized":"2024-04-25T13:16:49.131648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:11.901170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235983+0000","last_change":"2024-04-25T13:16:08.015681+0000","last_active":"2024-04-25T13:16:49.235983+0000","last_peered":"2024-04-25T13:16:49.235983+0000","last_clean":"2024-04-25T13:16:49.235983+0000","last_became_active":"2024-04-25T13:16:08.015405+0000","last_became_peered":"2024-04-25T13:16:08.015405+0000","last_unstale":"2024-04-25T13:16:49.235983+0000","last_undegraded":"2024-04-25T13:16:49.235983+0000","last_fullsized":"2024-04-25T13:16:49.235983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:00.932243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130058+0000","last_change":"2024-04-25T13:16:08.000456+0000","last_active":"2024-04-25T13:16:49.130058+0000","last_peered":"2024-04-25T13:16:49.130058+0000","last_clean":"2024-04-25T13:16:49.130058+0000","last_became_active":"2024-04-25T13:16:08.000193+0000","last_became_peered":"2024-04-25T13:16:08.000193+0000","last_unstale":"2024-04-25T13:16:49.130058+0000","last_undegraded":"2024-04-25T13:16:49.130058+0000","last_fullsized":"2024-04-25T13:16:49.130058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:15.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129924+0000","last_change":"2024-04-25T13:16:08.016060+0000","last_active":"2024-04-25T13:16:49.129924+0000","last_peered":"2024-04-25T13:16:49.129924+0000","last_clean":"2024-04-25T13:16:49.129924+0000","last_became_active":"2024-04-25T13:16:08.014300+0000","last_became_peered":"2024-04-25T13:16:08.014300+0000","last_unstale":"2024-04-25T13:16:49.129924+0000","last_undegraded":"2024-04-25T13:16:49.129924+0000","last_fullsized":"2024-04-25T13:16:49.129924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:37.644887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130981+0000","last_change":"2024-04-25T13:16:08.004946+0000","last_active":"2024-04-25T13:16:49.130981+0000","last_peered":"2024-04-25T13:16:49.130981+0000","last_clean":"2024-04-25T13:16:49.130981+0000","last_became_active":"2024-04-25T13:16:08.004673+0000","last_became_peered":"2024-04-25T13:16:08.004673+0000","last_unstale":"2024-04-25T13:16:49.130981+0000","last_undegraded":"2024-04-25T13:16:49.130981+0000","last_fullsized":"2024-04-25T13:16:49.130981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:18.616424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131000+0000","last_change":"2024-04-25T13:16:08.015676+0000","last_active":"2024-04-25T13:16:49.131000+0000","last_peered":"2024-04-25T13:16:49.131000+0000","last_clean":"2024-04-25T13:16:49.131000+0000","last_became_active":"2024-04-25T13:16:08.014719+0000","last_became_peered":"2024-04-25T13:16:08.014719+0000","last_unstale":"2024-04-25T13:16:49.131000+0000","last_undegraded":"2024-04-25T13:16:49.131000+0000","last_fullsized":"2024-04-25T13:16:49.131000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:04.274611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134113+0000","last_change":"2024-04-25T13:16:07.997665+0000","last_active":"2024-04-25T13:16:49.134113+0000","last_peered":"2024-04-25T13:16:49.134113+0000","last_clean":"2024-04-25T13:16:49.134113+0000","last_became_active":"2024-04-25T13:16:07.996792+0000","last_became_peered":"2024-04-25T13:16:07.996792+0000","last_unstale":"2024-04-25T13:16:49.134113+0000","last_undegraded":"2024-04-25T13:16:49.134113+0000","last_fullsized":"2024-04-25T13:16:49.134113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:39.367026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129755+0000","last_change":"2024-04-25T13:16:08.001495+0000","last_active":"2024-04-25T13:16:49.129755+0000","last_peered":"2024-04-25T13:16:49.129755+0000","last_clean":"2024-04-25T13:16:49.129755+0000","last_became_active":"2024-04-25T13:16:08.001182+0000","last_became_peered":"2024-04-25T13:16:08.001182+0000","last_unstale":"2024-04-25T13:16:49.129755+0000","last_undegraded":"2024-04-25T13:16:49.129755+0000","last_fullsized":"2024-04-25T13:16:49.129755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:48.417192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131530+0000","last_change":"2024-04-25T13:16:08.006262+0000","last_active":"2024-04-25T13:16:49.131530+0000","last_peered":"2024-04-25T13:16:49.131530+0000","last_clean":"2024-04-25T13:16:49.131530+0000","last_became_active":"2024-04-25T13:16:08.005976+0000","last_became_peered":"2024-04-25T13:16:08.005976+0000","last_unstale":"2024-04-25T13:16:49.131530+0000","last_undegraded":"2024-04-25T13:16:49.131530+0000","last_fullsized":"2024-04-25T13:16:49.131530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:22.965387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":714627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":127373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":126091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":123489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":127407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":123621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":123109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":913408,"data_stored":712819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:16.214 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T13:17:16.214 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:16.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.351+0000 7fdd8aa8a640 1 Processor -- start 2024-04-25T13:17:16.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.352+0000 7fdd8aa8a640 1 -- start start 2024-04-25T13:17:16.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.352+0000 7fdd8aa8a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdd841554e0 0x7fdd8415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.352+0000 7fdd8aa8a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd840d08a0 0x7fdd840d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.352+0000 7fdd8aa8a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd841558c0 con 0x7fdd840b3c00 2024-04-25T13:17:16.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.352+0000 7fdd8aa8a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fdd840b4a80 con 0x7fdd841554e0 2024-04-25T13:17:16.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.352+0000 7fdd8aa8a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdd8415f630 con 0x7fdd840d08a0 2024-04-25T13:17:16.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.353+0000 7fdd88826640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdd841554e0 0x7fdd8415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.353+0000 7fdd89027640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd840d08a0 0x7fdd840d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.353+0000 7fdd89027640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd840d08a0 0x7fdd840d0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.52:39984/0 (socket says 172.21.15.52:39984) 2024-04-25T13:17:16.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.353+0000 7fdd89027640 1 -- 172.21.15.52:0/2646892312 learned_addr learned my addr 172.21.15.52:0/2646892312 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:16.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.353+0000 7fdd88826640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdd841554e0 0x7fdd8415f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:60392/0 (socket says 172.21.15.52:60392) 2024-04-25T13:17:16.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.353+0000 7fdd83fff640 1 --1- 172.21.15.52:0/2646892312 >> v1:172.21.15.102:6789/0 conn(0x7fdd840b3c00 0x7fdd840b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:54034/0 (socket says 172.21.15.52:54034) 2024-04-25T13:17:16.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.353+0000 7fdd89027640 1 -- 172.21.15.52:0/2646892312 >> v2:172.21.15.102:3300/0 conn(0x7fdd841554e0 msgr2=0x7fdd8415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:16.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.353+0000 7fdd89027640 1 --2- 172.21.15.52:0/2646892312 >> v2:172.21.15.102:3300/0 conn(0x7fdd841554e0 0x7fdd8415f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.353+0000 7fdd89027640 1 -- 172.21.15.52:0/2646892312 >> v1:172.21.15.102:6789/0 conn(0x7fdd840b3c00 legacy=0x7fdd840b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.353+0000 7fdd89027640 1 -- 172.21.15.52:0/2646892312 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd840cb8c0 con 0x7fdd840d08a0 2024-04-25T13:17:16.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.354+0000 7fdd89027640 1 --2- 172.21.15.52:0/2646892312 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd840d08a0 0x7fdd840d0cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009e50 tx=0x7fdd7c02a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7811360783cb467 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.354+0000 7fdd837fe640 1 -- 172.21.15.52:0/2646892312 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c036070 con 0x7fdd840d08a0 2024-04-25T13:17:16.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.354+0000 7fdd837fe640 1 -- 172.21.15.52:0/2646892312 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd7c031600 con 0x7fdd840d08a0 2024-04-25T13:17:16.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.354+0000 7fdd837fe640 1 -- 172.21.15.52:0/2646892312 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c0319d0 con 0x7fdd840d08a0 2024-04-25T13:17:16.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.354+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/2646892312 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd840d08a0 msgr2=0x7fdd840d0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.354+0000 7fdd8aa8a640 1 --2- 172.21.15.52:0/2646892312 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd840d08a0 0x7fdd840d0cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009e50 tx=0x7fdd7c02a7a0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.354+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/2646892312 shutdown_connections 2024-04-25T13:17:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.354+0000 7fdd8aa8a640 1 --2- 172.21.15.52:0/2646892312 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd840d08a0 0x7fdd840d0cd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.354+0000 7fdd8aa8a640 1 --2- 172.21.15.52:0/2646892312 >> v2:172.21.15.102:3300/0 conn(0x7fdd841554e0 0x7fdd8415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.354+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/2646892312 >> 172.21.15.52:0/2646892312 conn(0x7fdd84074d50 msgr2=0x7fdd84075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.354+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/2646892312 shutdown_connections 2024-04-25T13:17:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.355+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/2646892312 wait complete. 2024-04-25T13:17:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.356+0000 7fdd8aa8a640 1 Processor -- start 2024-04-25T13:17:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.356+0000 7fdd8aa8a640 1 -- start start 2024-04-25T13:17:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd8aa8a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd840b3c00 0x7fdd8415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd8aa8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd840d08a0 0x7fdd84150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd8aa8a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd841554e0 0x7fdd840c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd8aa8a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdd840b4430 con 0x7fdd840d08a0 2024-04-25T13:17:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd8aa8a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdd840b4150 con 0x7fdd841554e0 2024-04-25T13:17:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd8aa8a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdd840b4710 con 0x7fdd840b3c00 2024-04-25T13:17:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd83fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd840d08a0 0x7fdd84150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd83fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd840d08a0 0x7fdd84150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36156/0 (socket says 172.21.15.52:36156) 2024-04-25T13:17:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd83fff640 1 -- 172.21.15.52:0/3582567937 learned_addr learned my addr 172.21.15.52:0/3582567937 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd88826640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd840b3c00 0x7fdd8415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd89027640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd841554e0 0x7fdd840c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd83fff640 1 -- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd840b3c00 msgr2=0x7fdd8415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd83fff640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd840b3c00 0x7fdd8415e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd83fff640 1 -- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd841554e0 msgr2=0x7fdd840c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd83fff640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd841554e0 0x7fdd840c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd83fff640 1 -- 172.21.15.52:0/3582567937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8415d5f0 con 0x7fdd840d08a0 2024-04-25T13:17:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd83fff640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd840d08a0 0x7fdd84150880 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000c3f0 tx=0x7fdd7000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd817fa640 1 -- 172.21.15.52:0/3582567937 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd700074e0 con 0x7fdd840d08a0 2024-04-25T13:17:16.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd817fa640 1 -- 172.21.15.52:0/3582567937 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd70007680 con 0x7fdd840d08a0 2024-04-25T13:17:16.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/3582567937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd840cfae0 con 0x7fdd840d08a0 2024-04-25T13:17:16.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.357+0000 7fdd817fa640 1 -- 172.21.15.52:0/3582567937 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70004a00 con 0x7fdd840d08a0 2024-04-25T13:17:16.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.358+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/3582567937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd8415f0f0 con 0x7fdd840d08a0 2024-04-25T13:17:16.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.359+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/3582567937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd84068e40 con 0x7fdd840d08a0 2024-04-25T13:17:16.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.359+0000 7fdd817fa640 1 -- 172.21.15.52:0/3582567937 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd7001a020 con 0x7fdd840d08a0 2024-04-25T13:17:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.359+0000 7fdd817fa640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fdd6806c8f0 0x7fdd6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.360+0000 7fdd817fa640 1 -- 172.21.15.52:0/3582567937 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fdd7008b540 con 0x7fdd840d08a0 2024-04-25T13:17:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.360+0000 7fdd88826640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fdd6806c8f0 0x7fdd6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.360+0000 7fdd88826640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fdd6806c8f0 0x7fdd6806edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009b40 tx=0x7fdd78009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.364+0000 7fdd817fa640 1 -- 172.21.15.52:0/3582567937 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd841558c0 con 0x7fdd840d08a0 2024-04-25T13:17:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.544+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/3582567937 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd84073fc0 con 0x7fdd6806c8f0 2024-04-25T13:17:16.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.552+0000 7fdd817fa640 1 -- 172.21.15.52:0/3582567937 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7fdd84073fc0 con 0x7fdd6806c8f0 2024-04-25T13:17:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:17:16.557 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T13:17:16.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.555+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fdd6806c8f0 msgr2=0x7fdd6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.555+0000 7fdd8aa8a640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fdd6806c8f0 0x7fdd6806edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009b40 tx=0x7fdd78009190 comp rx=0 tx=0).stop 2024-04-25T13:17:16.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.555+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/3582567937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd840d08a0 msgr2=0x7fdd84150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.555+0000 7fdd8aa8a640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd840d08a0 0x7fdd84150880 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000c3f0 tx=0x7fdd7000c8b0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.555+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/3582567937 shutdown_connections 2024-04-25T13:17:16.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.555+0000 7fdd8aa8a640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fdd6806c8f0 0x7fdd6806edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.555+0000 7fdd8aa8a640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd841554e0 0x7fdd840c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.555+0000 7fdd8aa8a640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd840d08a0 0x7fdd84150880 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.555+0000 7fdd8aa8a640 1 --2- 172.21.15.52:0/3582567937 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd840b3c00 0x7fdd8415e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.555+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/3582567937 >> 172.21.15.52:0/3582567937 conn(0x7fdd84074d50 msgr2=0x7fdd840ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.555+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/3582567937 shutdown_connections 2024-04-25T13:17:16.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.555+0000 7fdd8aa8a640 1 -- 172.21.15.52:0/3582567937 wait complete. 2024-04-25T13:17:16.566 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-25T13:17:15.835809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236456,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738264,"statfs":{"total":773094113280,"available":772851982336,"internally_reserved":0,"allocated":3776512,"data_stored":2178536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2328,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003409"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.148643+0000","last_change":"2024-04-25T13:16:07.001071+0000","last_active":"2024-04-25T13:16:56.148643+0000","last_peered":"2024-04-25T13:16:56.148643+0000","last_clean":"2024-04-25T13:16:56.148643+0000","last_became_active":"2024-04-25T13:16:07.000746+0000","last_became_peered":"2024-04-25T13:16:07.000746+0000","last_unstale":"2024-04-25T13:16:56.148643+0000","last_undegraded":"2024-04-25T13:16:56.148643+0000","last_fullsized":"2024-04-25T13:16:56.148643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:36.289103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235936+0000","last_change":"2024-04-25T13:16:08.012928+0000","last_active":"2024-04-25T13:16:49.235936+0000","last_peered":"2024-04-25T13:16:49.235936+0000","last_clean":"2024-04-25T13:16:49.235936+0000","last_became_active":"2024-04-25T13:16:08.012114+0000","last_became_peered":"2024-04-25T13:16:08.012114+0000","last_unstale":"2024-04-25T13:16:49.235936+0000","last_undegraded":"2024-04-25T13:16:49.235936+0000","last_fullsized":"2024-04-25T13:16:49.235936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:01.077922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235570+0000","last_change":"2024-04-25T13:16:12.734829+0000","last_active":"2024-04-25T13:16:49.235570+0000","last_peered":"2024-04-25T13:16:49.235570+0000","last_clean":"2024-04-25T13:16:49.235570+0000","last_became_active":"2024-04-25T13:16:12.734390+0000","last_became_peered":"2024-04-25T13:16:12.734390+0000","last_unstale":"2024-04-25T13:16:49.235570+0000","last_undegraded":"2024-04-25T13:16:49.235570+0000","last_fullsized":"2024-04-25T13:16:49.235570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:33.941883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236119+0000","last_change":"2024-04-25T13:16:06.999440+0000","last_active":"2024-04-25T13:16:49.236119+0000","last_peered":"2024-04-25T13:16:49.236119+0000","last_clean":"2024-04-25T13:16:49.236119+0000","last_became_active":"2024-04-25T13:16:06.999078+0000","last_became_peered":"2024-04-25T13:16:06.999078+0000","last_unstale":"2024-04-25T13:16:49.236119+0000","last_undegraded":"2024-04-25T13:16:49.236119+0000","last_fullsized":"2024-04-25T13:16:49.236119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.819349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133600+0000","last_change":"2024-04-25T13:16:08.012743+0000","last_active":"2024-04-25T13:16:49.133600+0000","last_peered":"2024-04-25T13:16:49.133600+0000","last_clean":"2024-04-25T13:16:49.133600+0000","last_became_active":"2024-04-25T13:16:08.012036+0000","last_became_peered":"2024-04-25T13:16:08.012036+0000","last_unstale":"2024-04-25T13:16:49.133600+0000","last_undegraded":"2024-04-25T13:16:49.133600+0000","last_fullsized":"2024-04-25T13:16:49.133600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.959146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.238290+0000","last_change":"2024-04-25T13:16:49.238290+0000","last_active":"2024-04-25T13:16:49.238290+0000","last_peered":"2024-04-25T13:16:49.238290+0000","last_clean":"2024-04-25T13:16:49.238290+0000","last_became_active":"2024-04-25T13:16:49.237674+0000","last_became_peered":"2024-04-25T13:16:49.237674+0000","last_unstale":"2024-04-25T13:16:49.238290+0000","last_undegraded":"2024-04-25T13:16:49.238290+0000","last_fullsized":"2024-04-25T13:16:49.238290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:32.550364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.149564+0000","last_change":"2024-04-25T13:16:07.001022+0000","last_active":"2024-04-25T13:16:56.149564+0000","last_peered":"2024-04-25T13:16:56.149564+0000","last_clean":"2024-04-25T13:16:56.149564+0000","last_became_active":"2024-04-25T13:16:07.000751+0000","last_became_peered":"2024-04-25T13:16:07.000751+0000","last_unstale":"2024-04-25T13:16:56.149564+0000","last_undegraded":"2024-04-25T13:16:56.149564+0000","last_fullsized":"2024-04-25T13:16:56.149564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:11.597397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131104+0000","last_change":"2024-04-25T13:16:08.011361+0000","last_active":"2024-04-25T13:16:49.131104+0000","last_peered":"2024-04-25T13:16:49.131104+0000","last_clean":"2024-04-25T13:16:49.131104+0000","last_became_active":"2024-04-25T13:16:08.011073+0000","last_became_peered":"2024-04-25T13:16:08.011073+0000","last_unstale":"2024-04-25T13:16:49.131104+0000","last_undegraded":"2024-04-25T13:16:49.131104+0000","last_fullsized":"2024-04-25T13:16:49.131104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:00.471410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.238066+0000","last_change":"2024-04-25T13:16:49.238066+0000","last_active":"2024-04-25T13:16:49.238066+0000","last_peered":"2024-04-25T13:16:49.238066+0000","last_clean":"2024-04-25T13:16:49.238066+0000","last_became_active":"2024-04-25T13:16:49.237565+0000","last_became_peered":"2024-04-25T13:16:49.237565+0000","last_unstale":"2024-04-25T13:16:49.238066+0000","last_undegraded":"2024-04-25T13:16:49.238066+0000","last_fullsized":"2024-04-25T13:16:49.238066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:15.893235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.151020+0000","last_change":"2024-04-25T13:16:07.003774+0000","last_active":"2024-04-25T13:16:56.151020+0000","last_peered":"2024-04-25T13:16:56.151020+0000","last_clean":"2024-04-25T13:16:56.151020+0000","last_became_active":"2024-04-25T13:16:07.003493+0000","last_became_peered":"2024-04-25T13:16:07.003493+0000","last_unstale":"2024-04-25T13:16:56.151020+0000","last_undegraded":"2024-04-25T13:16:56.151020+0000","last_fullsized":"2024-04-25T13:16:56.151020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:12.940812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130266+0000","last_change":"2024-04-25T13:16:08.012084+0000","last_active":"2024-04-25T13:16:49.130266+0000","last_peered":"2024-04-25T13:16:49.130266+0000","last_clean":"2024-04-25T13:16:49.130266+0000","last_became_active":"2024-04-25T13:16:08.011634+0000","last_became_peered":"2024-04-25T13:16:08.011634+0000","last_unstale":"2024-04-25T13:16:49.130266+0000","last_undegraded":"2024-04-25T13:16:49.130266+0000","last_fullsized":"2024-04-25T13:16:49.130266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:26.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132146+0000","last_change":"2024-04-25T13:16:12.039238+0000","last_active":"2024-04-25T13:16:49.132146+0000","last_peered":"2024-04-25T13:16:49.132146+0000","last_clean":"2024-04-25T13:16:49.132146+0000","last_became_active":"2024-04-25T13:16:12.038508+0000","last_became_peered":"2024-04-25T13:16:12.038508+0000","last_unstale":"2024-04-25T13:16:49.132146+0000","last_undegraded":"2024-04-25T13:16:49.132146+0000","last_fullsized":"2024-04-25T13:16:49.132146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:22.183373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235784+0000","last_change":"2024-04-25T13:16:08.007741+0000","last_active":"2024-04-25T13:16:49.235784+0000","last_peered":"2024-04-25T13:16:49.235784+0000","last_clean":"2024-04-25T13:16:49.235784+0000","last_became_active":"2024-04-25T13:16:08.007478+0000","last_became_peered":"2024-04-25T13:16:08.007478+0000","last_unstale":"2024-04-25T13:16:49.235784+0000","last_undegraded":"2024-04-25T13:16:49.235784+0000","last_fullsized":"2024-04-25T13:16:49.235784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:49.162203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131314+0000","last_change":"2024-04-25T13:16:07.001183+0000","last_active":"2024-04-25T13:16:49.131314+0000","last_peered":"2024-04-25T13:16:49.131314+0000","last_clean":"2024-04-25T13:16:49.131314+0000","last_became_active":"2024-04-25T13:16:07.000880+0000","last_became_peered":"2024-04-25T13:16:07.000880+0000","last_unstale":"2024-04-25T13:16:49.131314+0000","last_undegraded":"2024-04-25T13:16:49.131314+0000","last_fullsized":"2024-04-25T13:16:49.131314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.250349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132664+0000","last_change":"2024-04-25T13:16:12.037074+0000","last_active":"2024-04-25T13:16:49.132664+0000","last_peered":"2024-04-25T13:16:49.132664+0000","last_clean":"2024-04-25T13:16:49.132664+0000","last_became_active":"2024-04-25T13:16:12.036508+0000","last_became_peered":"2024-04-25T13:16:12.036508+0000","last_unstale":"2024-04-25T13:16:49.132664+0000","last_undegraded":"2024-04-25T13:16:49.132664+0000","last_fullsized":"2024-04-25T13:16:49.132664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:01.380469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235873+0000","last_change":"2024-04-25T13:16:08.013538+0000","last_active":"2024-04-25T13:16:49.235873+0000","last_peered":"2024-04-25T13:16:49.235873+0000","last_clean":"2024-04-25T13:16:49.235873+0000","last_became_active":"2024-04-25T13:16:08.013269+0000","last_became_peered":"2024-04-25T13:16:08.013269+0000","last_unstale":"2024-04-25T13:16:49.235873+0000","last_undegraded":"2024-04-25T13:16:49.235873+0000","last_fullsized":"2024-04-25T13:16:49.235873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:05.313768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.130603+0000","last_change":"2024-04-25T13:16:06.994106+0000","last_active":"2024-04-25T13:16:51.130603+0000","last_peered":"2024-04-25T13:16:51.130603+0000","last_clean":"2024-04-25T13:16:51.130603+0000","last_became_active":"2024-04-25T13:16:06.993807+0000","last_became_peered":"2024-04-25T13:16:06.993807+0000","last_unstale":"2024-04-25T13:16:51.130603+0000","last_undegraded":"2024-04-25T13:16:51.130603+0000","last_fullsized":"2024-04-25T13:16:51.130603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:53.706175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131943+0000","last_change":"2024-04-25T13:16:12.039421+0000","last_active":"2024-04-25T13:16:49.131943+0000","last_peered":"2024-04-25T13:16:49.131943+0000","last_clean":"2024-04-25T13:16:49.131943+0000","last_became_active":"2024-04-25T13:16:12.038953+0000","last_became_peered":"2024-04-25T13:16:12.038953+0000","last_unstale":"2024-04-25T13:16:49.131943+0000","last_undegraded":"2024-04-25T13:16:49.131943+0000","last_fullsized":"2024-04-25T13:16:49.131943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:26.714224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236290+0000","last_change":"2024-04-25T13:16:08.008978+0000","last_active":"2024-04-25T13:16:49.236290+0000","last_peered":"2024-04-25T13:16:49.236290+0000","last_clean":"2024-04-25T13:16:49.236290+0000","last_became_active":"2024-04-25T13:16:08.008446+0000","last_became_peered":"2024-04-25T13:16:08.008446+0000","last_unstale":"2024-04-25T13:16:49.236290+0000","last_undegraded":"2024-04-25T13:16:49.236290+0000","last_fullsized":"2024-04-25T13:16:49.236290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:34.604344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.148428+0000","last_change":"2024-04-25T13:16:06.992902+0000","last_active":"2024-04-25T13:16:56.148428+0000","last_peered":"2024-04-25T13:16:56.148428+0000","last_clean":"2024-04-25T13:16:56.148428+0000","last_became_active":"2024-04-25T13:16:06.992593+0000","last_became_peered":"2024-04-25T13:16:06.992593+0000","last_unstale":"2024-04-25T13:16:56.148428+0000","last_undegraded":"2024-04-25T13:16:56.148428+0000","last_fullsized":"2024-04-25T13:16:56.148428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:57.665455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129441+0000","last_change":"2024-04-25T13:16:12.735412+0000","last_active":"2024-04-25T13:16:49.129441+0000","last_peered":"2024-04-25T13:16:49.129441+0000","last_clean":"2024-04-25T13:16:49.129441+0000","last_became_active":"2024-04-25T13:16:12.733485+0000","last_became_peered":"2024-04-25T13:16:12.733485+0000","last_unstale":"2024-04-25T13:16:49.129441+0000","last_undegraded":"2024-04-25T13:16:49.129441+0000","last_fullsized":"2024-04-25T13:16:49.129441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:25.265696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132357+0000","last_change":"2024-04-25T13:16:07.998941+0000","last_active":"2024-04-25T13:16:49.132357+0000","last_peered":"2024-04-25T13:16:49.132357+0000","last_clean":"2024-04-25T13:16:49.132357+0000","last_became_active":"2024-04-25T13:16:07.998658+0000","last_became_peered":"2024-04-25T13:16:07.998658+0000","last_unstale":"2024-04-25T13:16:49.132357+0000","last_undegraded":"2024-04-25T13:16:49.132357+0000","last_fullsized":"2024-04-25T13:16:49.132357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:45.473269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129850+0000","last_change":"2024-04-25T13:16:07.001542+0000","last_active":"2024-04-25T13:16:49.129850+0000","last_peered":"2024-04-25T13:16:49.129850+0000","last_clean":"2024-04-25T13:16:49.129850+0000","last_became_active":"2024-04-25T13:16:07.000846+0000","last_became_peered":"2024-04-25T13:16:07.000846+0000","last_unstale":"2024-04-25T13:16:49.129850+0000","last_undegraded":"2024-04-25T13:16:49.129850+0000","last_fullsized":"2024-04-25T13:16:49.129850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:41.121978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132197+0000","last_change":"2024-04-25T13:16:12.038493+0000","last_active":"2024-04-25T13:16:49.132197+0000","last_peered":"2024-04-25T13:16:49.132197+0000","last_clean":"2024-04-25T13:16:49.132197+0000","last_became_active":"2024-04-25T13:16:12.038032+0000","last_became_peered":"2024-04-25T13:16:12.038032+0000","last_unstale":"2024-04-25T13:16:49.132197+0000","last_undegraded":"2024-04-25T13:16:49.132197+0000","last_fullsized":"2024-04-25T13:16:49.132197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:40.222480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134580+0000","last_change":"2024-04-25T13:16:07.998444+0000","last_active":"2024-04-25T13:16:49.134580+0000","last_peered":"2024-04-25T13:16:49.134580+0000","last_clean":"2024-04-25T13:16:49.134580+0000","last_became_active":"2024-04-25T13:16:07.998037+0000","last_became_peered":"2024-04-25T13:16:07.998037+0000","last_unstale":"2024-04-25T13:16:49.134580+0000","last_undegraded":"2024-04-25T13:16:49.134580+0000","last_fullsized":"2024-04-25T13:16:49.134580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:35.706782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.347192+0000","last_change":"2024-04-25T13:16:06.995706+0000","last_active":"2024-04-25T13:16:56.347192+0000","last_peered":"2024-04-25T13:16:56.347192+0000","last_clean":"2024-04-25T13:16:56.347192+0000","last_became_active":"2024-04-25T13:16:06.995420+0000","last_became_peered":"2024-04-25T13:16:06.995420+0000","last_unstale":"2024-04-25T13:16:56.347192+0000","last_undegraded":"2024-04-25T13:16:56.347192+0000","last_fullsized":"2024-04-25T13:16:56.347192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:08.672949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132741+0000","last_change":"2024-04-25T13:16:12.734165+0000","last_active":"2024-04-25T13:16:49.132741+0000","last_peered":"2024-04-25T13:16:49.132741+0000","last_clean":"2024-04-25T13:16:49.132741+0000","last_became_active":"2024-04-25T13:16:12.733772+0000","last_became_peered":"2024-04-25T13:16:12.733772+0000","last_unstale":"2024-04-25T13:16:49.132741+0000","last_undegraded":"2024-04-25T13:16:49.132741+0000","last_fullsized":"2024-04-25T13:16:49.132741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:35.716517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236301+0000","last_change":"2024-04-25T13:16:08.017429+0000","last_active":"2024-04-25T13:16:49.236301+0000","last_peered":"2024-04-25T13:16:49.236301+0000","last_clean":"2024-04-25T13:16:49.236301+0000","last_became_active":"2024-04-25T13:16:08.017205+0000","last_became_peered":"2024-04-25T13:16:08.017205+0000","last_unstale":"2024-04-25T13:16:49.236301+0000","last_undegraded":"2024-04-25T13:16:49.236301+0000","last_fullsized":"2024-04-25T13:16:49.236301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.383669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.133433+0000","last_change":"2024-04-25T13:16:06.992063+0000","last_active":"2024-04-25T13:16:51.133433+0000","last_peered":"2024-04-25T13:16:51.133433+0000","last_clean":"2024-04-25T13:16:51.133433+0000","last_became_active":"2024-04-25T13:16:06.991766+0000","last_became_peered":"2024-04-25T13:16:06.991766+0000","last_unstale":"2024-04-25T13:16:51.133433+0000","last_undegraded":"2024-04-25T13:16:51.133433+0000","last_fullsized":"2024-04-25T13:16:51.133433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:25.728063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235811+0000","last_change":"2024-04-25T13:16:12.734837+0000","last_active":"2024-04-25T13:16:49.235811+0000","last_peered":"2024-04-25T13:16:49.235811+0000","last_clean":"2024-04-25T13:16:49.235811+0000","last_became_active":"2024-04-25T13:16:12.734394+0000","last_became_peered":"2024-04-25T13:16:12.734394+0000","last_unstale":"2024-04-25T13:16:49.235811+0000","last_undegraded":"2024-04-25T13:16:49.235811+0000","last_fullsized":"2024-04-25T13:16:49.235811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:24.740929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129513+0000","last_change":"2024-04-25T13:16:08.000277+0000","last_active":"2024-04-25T13:16:49.129513+0000","last_peered":"2024-04-25T13:16:49.129513+0000","last_clean":"2024-04-25T13:16:49.129513+0000","last_became_active":"2024-04-25T13:16:07.999797+0000","last_became_peered":"2024-04-25T13:16:07.999797+0000","last_unstale":"2024-04-25T13:16:49.129513+0000","last_undegraded":"2024-04-25T13:16:49.129513+0000","last_fullsized":"2024-04-25T13:16:49.129513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:08.860755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.133126+0000","last_change":"2024-04-25T13:16:07.002146+0000","last_active":"2024-04-25T13:16:51.133126+0000","last_peered":"2024-04-25T13:16:51.133126+0000","last_clean":"2024-04-25T13:16:51.133126+0000","last_became_active":"2024-04-25T13:16:07.001918+0000","last_became_peered":"2024-04-25T13:16:07.001918+0000","last_unstale":"2024-04-25T13:16:51.133126+0000","last_undegraded":"2024-04-25T13:16:51.133126+0000","last_fullsized":"2024-04-25T13:16:51.133126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:38.326719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134757+0000","last_change":"2024-04-25T13:16:12.733744+0000","last_active":"2024-04-25T13:16:49.134757+0000","last_peered":"2024-04-25T13:16:49.134757+0000","last_clean":"2024-04-25T13:16:49.134757+0000","last_became_active":"2024-04-25T13:16:12.733361+0000","last_became_peered":"2024-04-25T13:16:12.733361+0000","last_unstale":"2024-04-25T13:16:49.134757+0000","last_undegraded":"2024-04-25T13:16:49.134757+0000","last_fullsized":"2024-04-25T13:16:49.134757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:39.178837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130376+0000","last_change":"2024-04-25T13:16:08.016667+0000","last_active":"2024-04-25T13:16:49.130376+0000","last_peered":"2024-04-25T13:16:49.130376+0000","last_clean":"2024-04-25T13:16:49.130376+0000","last_became_active":"2024-04-25T13:16:08.015172+0000","last_became_peered":"2024-04-25T13:16:08.015172+0000","last_unstale":"2024-04-25T13:16:49.130376+0000","last_undegraded":"2024-04-25T13:16:49.130376+0000","last_fullsized":"2024-04-25T13:16:49.130376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:40.786954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129640+0000","last_change":"2024-04-25T13:16:06.996301+0000","last_active":"2024-04-25T13:16:49.129640+0000","last_peered":"2024-04-25T13:16:49.129640+0000","last_clean":"2024-04-25T13:16:49.129640+0000","last_became_active":"2024-04-25T13:16:06.995957+0000","last_became_peered":"2024-04-25T13:16:06.995957+0000","last_unstale":"2024-04-25T13:16:49.129640+0000","last_undegraded":"2024-04-25T13:16:49.129640+0000","last_fullsized":"2024-04-25T13:16:49.129640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:16.802775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129020+0000","last_change":"2024-04-25T13:16:12.040987+0000","last_active":"2024-04-25T13:16:49.129020+0000","last_peered":"2024-04-25T13:16:49.129020+0000","last_clean":"2024-04-25T13:16:49.129020+0000","last_became_active":"2024-04-25T13:16:12.039987+0000","last_became_peered":"2024-04-25T13:16:12.039987+0000","last_unstale":"2024-04-25T13:16:49.129020+0000","last_undegraded":"2024-04-25T13:16:49.129020+0000","last_fullsized":"2024-04-25T13:16:49.129020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:40.366718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133323+0000","last_change":"2024-04-25T13:16:08.002876+0000","last_active":"2024-04-25T13:16:49.133323+0000","last_peered":"2024-04-25T13:16:49.133323+0000","last_clean":"2024-04-25T13:16:49.133323+0000","last_became_active":"2024-04-25T13:16:08.002131+0000","last_became_peered":"2024-04-25T13:16:08.002131+0000","last_unstale":"2024-04-25T13:16:49.133323+0000","last_undegraded":"2024-04-25T13:16:49.133323+0000","last_fullsized":"2024-04-25T13:16:49.133323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:09.646849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.150771+0000","last_change":"2024-04-25T13:16:06.990075+0000","last_active":"2024-04-25T13:16:56.150771+0000","last_peered":"2024-04-25T13:16:56.150771+0000","last_clean":"2024-04-25T13:16:56.150771+0000","last_became_active":"2024-04-25T13:16:06.989652+0000","last_became_peered":"2024-04-25T13:16:06.989652+0000","last_unstale":"2024-04-25T13:16:56.150771+0000","last_undegraded":"2024-04-25T13:16:56.150771+0000","last_fullsized":"2024-04-25T13:16:56.150771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:29.378995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129361+0000","last_change":"2024-04-25T13:16:12.032906+0000","last_active":"2024-04-25T13:16:49.129361+0000","last_peered":"2024-04-25T13:16:49.129361+0000","last_clean":"2024-04-25T13:16:49.129361+0000","last_became_active":"2024-04-25T13:16:12.032184+0000","last_became_peered":"2024-04-25T13:16:12.032184+0000","last_unstale":"2024-04-25T13:16:49.129361+0000","last_undegraded":"2024-04-25T13:16:49.129361+0000","last_fullsized":"2024-04-25T13:16:49.129361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:19.724927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.128917+0000","last_change":"2024-04-25T13:16:07.997173+0000","last_active":"2024-04-25T13:16:49.128917+0000","last_peered":"2024-04-25T13:16:49.128917+0000","last_clean":"2024-04-25T13:16:49.128917+0000","last_became_active":"2024-04-25T13:16:07.996545+0000","last_became_peered":"2024-04-25T13:16:07.996545+0000","last_unstale":"2024-04-25T13:16:49.128917+0000","last_undegraded":"2024-04-25T13:16:49.128917+0000","last_fullsized":"2024-04-25T13:16:49.128917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:28.902563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.147729+0000","last_change":"2024-04-25T13:16:06.993674+0000","last_active":"2024-04-25T13:16:56.147729+0000","last_peered":"2024-04-25T13:16:56.147729+0000","last_clean":"2024-04-25T13:16:56.147729+0000","last_became_active":"2024-04-25T13:16:06.993387+0000","last_became_peered":"2024-04-25T13:16:06.993387+0000","last_unstale":"2024-04-25T13:16:56.147729+0000","last_undegraded":"2024-04-25T13:16:56.147729+0000","last_fullsized":"2024-04-25T13:16:56.147729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:13.104822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.238099+0000","last_change":"2024-04-25T13:16:49.237386+0000","last_active":"2024-04-25T13:16:49.238099+0000","last_peered":"2024-04-25T13:16:49.238099+0000","last_clean":"2024-04-25T13:16:49.238099+0000","last_became_active":"2024-04-25T13:16:49.236873+0000","last_became_peered":"2024-04-25T13:16:49.236873+0000","last_unstale":"2024-04-25T13:16:49.238099+0000","last_undegraded":"2024-04-25T13:16:49.238099+0000","last_fullsized":"2024-04-25T13:16:49.238099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:58.580330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133201+0000","last_change":"2024-04-25T13:16:08.004209+0000","last_active":"2024-04-25T13:16:49.133201+0000","last_peered":"2024-04-25T13:16:49.133201+0000","last_clean":"2024-04-25T13:16:49.133201+0000","last_became_active":"2024-04-25T13:16:08.003908+0000","last_became_peered":"2024-04-25T13:16:08.003908+0000","last_unstale":"2024-04-25T13:16:49.133201+0000","last_undegraded":"2024-04-25T13:16:49.133201+0000","last_fullsized":"2024-04-25T13:16:49.133201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:17.027888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130018+0000","last_change":"2024-04-25T13:16:06.999384+0000","last_active":"2024-04-25T13:16:49.130018+0000","last_peered":"2024-04-25T13:16:49.130018+0000","last_clean":"2024-04-25T13:16:49.130018+0000","last_became_active":"2024-04-25T13:16:06.999126+0000","last_became_peered":"2024-04-25T13:16:06.999126+0000","last_unstale":"2024-04-25T13:16:49.130018+0000","last_undegraded":"2024-04-25T13:16:49.130018+0000","last_fullsized":"2024-04-25T13:16:49.130018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:50.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134406+0000","last_change":"2024-04-25T13:16:12.733992+0000","last_active":"2024-04-25T13:16:49.134406+0000","last_peered":"2024-04-25T13:16:49.134406+0000","last_clean":"2024-04-25T13:16:49.134406+0000","last_became_active":"2024-04-25T13:16:12.733316+0000","last_became_peered":"2024-04-25T13:16:12.733316+0000","last_unstale":"2024-04-25T13:16:49.134406+0000","last_undegraded":"2024-04-25T13:16:49.134406+0000","last_fullsized":"2024-04-25T13:16:49.134406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:54.246728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235445+0000","last_change":"2024-04-25T13:16:08.021617+0000","last_active":"2024-04-25T13:16:49.235445+0000","last_peered":"2024-04-25T13:16:49.235445+0000","last_clean":"2024-04-25T13:16:49.235445+0000","last_became_active":"2024-04-25T13:16:08.021346+0000","last_became_peered":"2024-04-25T13:16:08.021346+0000","last_unstale":"2024-04-25T13:16:49.235445+0000","last_undegraded":"2024-04-25T13:16:49.235445+0000","last_fullsized":"2024-04-25T13:16:49.235445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:10.013805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.131254+0000","last_change":"2024-04-25T13:16:06.990638+0000","last_active":"2024-04-25T13:16:51.131254+0000","last_peered":"2024-04-25T13:16:51.131254+0000","last_clean":"2024-04-25T13:16:51.131254+0000","last_became_active":"2024-04-25T13:16:06.990379+0000","last_became_peered":"2024-04-25T13:16:06.990379+0000","last_unstale":"2024-04-25T13:16:51.131254+0000","last_undegraded":"2024-04-25T13:16:51.131254+0000","last_fullsized":"2024-04-25T13:16:51.131254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:39.385990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130081+0000","last_change":"2024-04-25T13:15:57.168598+0000","last_active":"2024-04-25T13:16:49.130081+0000","last_peered":"2024-04-25T13:16:49.130081+0000","last_clean":"2024-04-25T13:16:49.130081+0000","last_became_active":"2024-04-25T13:15:57.167692+0000","last_became_peered":"2024-04-25T13:15:57.167692+0000","last_unstale":"2024-04-25T13:16:49.130081+0000","last_undegraded":"2024-04-25T13:16:49.130081+0000","last_fullsized":"2024-04-25T13:16:49.130081+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_clean_scrub_stamp":"2024-04-25T13:15:55.844647+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:29.123100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235646+0000","last_change":"2024-04-25T13:16:12.734712+0000","last_active":"2024-04-25T13:16:49.235646+0000","last_peered":"2024-04-25T13:16:49.235646+0000","last_clean":"2024-04-25T13:16:49.235646+0000","last_became_active":"2024-04-25T13:16:12.734288+0000","last_became_peered":"2024-04-25T13:16:12.734288+0000","last_unstale":"2024-04-25T13:16:49.235646+0000","last_undegraded":"2024-04-25T13:16:49.235646+0000","last_fullsized":"2024-04-25T13:16:49.235646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:45.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131327+0000","last_change":"2024-04-25T13:16:08.014279+0000","last_active":"2024-04-25T13:16:49.131327+0000","last_peered":"2024-04-25T13:16:49.131327+0000","last_clean":"2024-04-25T13:16:49.131327+0000","last_became_active":"2024-04-25T13:16:08.013989+0000","last_became_peered":"2024-04-25T13:16:08.013989+0000","last_unstale":"2024-04-25T13:16:49.131327+0000","last_undegraded":"2024-04-25T13:16:49.131327+0000","last_fullsized":"2024-04-25T13:16:49.131327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:54.411981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.515732+0000","last_change":"2024-04-25T13:16:06.996774+0000","last_active":"2024-04-25T13:17:04.515732+0000","last_peered":"2024-04-25T13:17:04.515732+0000","last_clean":"2024-04-25T13:17:04.515732+0000","last_became_active":"2024-04-25T13:16:06.996251+0000","last_became_peered":"2024-04-25T13:16:06.996251+0000","last_unstale":"2024-04-25T13:17:04.515732+0000","last_undegraded":"2024-04-25T13:17:04.515732+0000","last_fullsized":"2024-04-25T13:17:04.515732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:01.815602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235463+0000","last_change":"2024-04-25T13:16:12.733562+0000","last_active":"2024-04-25T13:16:49.235463+0000","last_peered":"2024-04-25T13:16:49.235463+0000","last_clean":"2024-04-25T13:16:49.235463+0000","last_became_active":"2024-04-25T13:16:12.733114+0000","last_became_peered":"2024-04-25T13:16:12.733114+0000","last_unstale":"2024-04-25T13:16:49.235463+0000","last_undegraded":"2024-04-25T13:16:49.235463+0000","last_fullsized":"2024-04-25T13:16:49.235463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:20.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131209+0000","last_change":"2024-04-25T13:16:08.011389+0000","last_active":"2024-04-25T13:16:49.131209+0000","last_peered":"2024-04-25T13:16:49.131209+0000","last_clean":"2024-04-25T13:16:49.131209+0000","last_became_active":"2024-04-25T13:16:08.011113+0000","last_became_peered":"2024-04-25T13:16:08.011113+0000","last_unstale":"2024-04-25T13:16:49.131209+0000","last_undegraded":"2024-04-25T13:16:49.131209+0000","last_fullsized":"2024-04-25T13:16:49.131209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:12.339487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.130312+0000","last_change":"2024-04-25T13:16:06.988988+0000","last_active":"2024-04-25T13:16:51.130312+0000","last_peered":"2024-04-25T13:16:51.130312+0000","last_clean":"2024-04-25T13:16:51.130312+0000","last_became_active":"2024-04-25T13:16:06.988631+0000","last_became_peered":"2024-04-25T13:16:06.988631+0000","last_unstale":"2024-04-25T13:16:51.130312+0000","last_undegraded":"2024-04-25T13:16:51.130312+0000","last_fullsized":"2024-04-25T13:16:51.130312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:47.056977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134845+0000","last_change":"2024-04-25T13:16:12.047194+0000","last_active":"2024-04-25T13:16:49.134845+0000","last_peered":"2024-04-25T13:16:49.134845+0000","last_clean":"2024-04-25T13:16:49.134845+0000","last_became_active":"2024-04-25T13:16:12.046780+0000","last_became_peered":"2024-04-25T13:16:12.046780+0000","last_unstale":"2024-04-25T13:16:49.134845+0000","last_undegraded":"2024-04-25T13:16:49.134845+0000","last_fullsized":"2024-04-25T13:16:49.134845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:41.664409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131701+0000","last_change":"2024-04-25T13:16:08.007925+0000","last_active":"2024-04-25T13:16:49.131701+0000","last_peered":"2024-04-25T13:16:49.131701+0000","last_clean":"2024-04-25T13:16:49.131701+0000","last_became_active":"2024-04-25T13:16:08.007681+0000","last_became_peered":"2024-04-25T13:16:08.007681+0000","last_unstale":"2024-04-25T13:16:49.131701+0000","last_undegraded":"2024-04-25T13:16:49.131701+0000","last_fullsized":"2024-04-25T13:16:49.131701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:29.601564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.147255+0000","last_change":"2024-04-25T13:16:06.991912+0000","last_active":"2024-04-25T13:16:56.147255+0000","last_peered":"2024-04-25T13:16:56.147255+0000","last_clean":"2024-04-25T13:16:56.147255+0000","last_became_active":"2024-04-25T13:16:06.991578+0000","last_became_peered":"2024-04-25T13:16:06.991578+0000","last_unstale":"2024-04-25T13:16:56.147255+0000","last_undegraded":"2024-04-25T13:16:56.147255+0000","last_fullsized":"2024-04-25T13:16:56.147255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:59.364396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129381+0000","last_change":"2024-04-25T13:16:12.733567+0000","last_active":"2024-04-25T13:16:49.129381+0000","last_peered":"2024-04-25T13:16:49.129381+0000","last_clean":"2024-04-25T13:16:49.129381+0000","last_became_active":"2024-04-25T13:16:12.733136+0000","last_became_peered":"2024-04-25T13:16:12.733136+0000","last_unstale":"2024-04-25T13:16:49.129381+0000","last_undegraded":"2024-04-25T13:16:49.129381+0000","last_fullsized":"2024-04-25T13:16:49.129381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:29.125928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131176+0000","last_change":"2024-04-25T13:16:08.004897+0000","last_active":"2024-04-25T13:16:49.131176+0000","last_peered":"2024-04-25T13:16:49.131176+0000","last_clean":"2024-04-25T13:16:49.131176+0000","last_became_active":"2024-04-25T13:16:08.004180+0000","last_became_peered":"2024-04-25T13:16:08.004180+0000","last_unstale":"2024-04-25T13:16:49.131176+0000","last_undegraded":"2024-04-25T13:16:49.131176+0000","last_fullsized":"2024-04-25T13:16:49.131176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:12.011447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132694+0000","last_change":"2024-04-25T13:16:06.994487+0000","last_active":"2024-04-25T13:16:49.132694+0000","last_peered":"2024-04-25T13:16:49.132694+0000","last_clean":"2024-04-25T13:16:49.132694+0000","last_became_active":"2024-04-25T13:16:06.994235+0000","last_became_peered":"2024-04-25T13:16:06.994235+0000","last_unstale":"2024-04-25T13:16:49.132694+0000","last_undegraded":"2024-04-25T13:16:49.132694+0000","last_fullsized":"2024-04-25T13:16:49.132694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131872+0000","last_change":"2024-04-25T13:16:12.039277+0000","last_active":"2024-04-25T13:16:49.131872+0000","last_peered":"2024-04-25T13:16:49.131872+0000","last_clean":"2024-04-25T13:16:49.131872+0000","last_became_active":"2024-04-25T13:16:12.038534+0000","last_became_peered":"2024-04-25T13:16:12.038534+0000","last_unstale":"2024-04-25T13:16:49.131872+0000","last_undegraded":"2024-04-25T13:16:49.131872+0000","last_fullsized":"2024-04-25T13:16:49.131872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:59.495976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130166+0000","last_change":"2024-04-25T13:16:08.007302+0000","last_active":"2024-04-25T13:16:49.130166+0000","last_peered":"2024-04-25T13:16:49.130166+0000","last_clean":"2024-04-25T13:16:49.130166+0000","last_became_active":"2024-04-25T13:16:08.007050+0000","last_became_peered":"2024-04-25T13:16:08.007050+0000","last_unstale":"2024-04-25T13:16:49.130166+0000","last_undegraded":"2024-04-25T13:16:49.130166+0000","last_fullsized":"2024-04-25T13:16:49.130166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:35.369188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.131068+0000","last_change":"2024-04-25T13:16:06.982609+0000","last_active":"2024-04-25T13:16:51.131068+0000","last_peered":"2024-04-25T13:16:51.131068+0000","last_clean":"2024-04-25T13:16:51.131068+0000","last_became_active":"2024-04-25T13:16:06.982320+0000","last_became_peered":"2024-04-25T13:16:06.982320+0000","last_unstale":"2024-04-25T13:16:51.131068+0000","last_undegraded":"2024-04-25T13:16:51.131068+0000","last_fullsized":"2024-04-25T13:16:51.131068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:55.372968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134321+0000","last_change":"2024-04-25T13:16:12.043657+0000","last_active":"2024-04-25T13:16:49.134321+0000","last_peered":"2024-04-25T13:16:49.134321+0000","last_clean":"2024-04-25T13:16:49.134321+0000","last_became_active":"2024-04-25T13:16:12.042902+0000","last_became_peered":"2024-04-25T13:16:12.042902+0000","last_unstale":"2024-04-25T13:16:49.134321+0000","last_undegraded":"2024-04-25T13:16:49.134321+0000","last_fullsized":"2024-04-25T13:16:49.134321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:46.721199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236046+0000","last_change":"2024-04-25T13:16:08.008534+0000","last_active":"2024-04-25T13:16:49.236046+0000","last_peered":"2024-04-25T13:16:49.236046+0000","last_clean":"2024-04-25T13:16:49.236046+0000","last_became_active":"2024-04-25T13:16:08.008102+0000","last_became_peered":"2024-04-25T13:16:08.008102+0000","last_unstale":"2024-04-25T13:16:49.236046+0000","last_undegraded":"2024-04-25T13:16:49.236046+0000","last_fullsized":"2024-04-25T13:16:49.236046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:48.331724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.520370+0000","last_change":"2024-04-25T13:16:06.993292+0000","last_active":"2024-04-25T13:17:04.520370+0000","last_peered":"2024-04-25T13:17:04.520370+0000","last_clean":"2024-04-25T13:17:04.520370+0000","last_became_active":"2024-04-25T13:16:06.993008+0000","last_became_peered":"2024-04-25T13:16:06.993008+0000","last_unstale":"2024-04-25T13:17:04.520370+0000","last_undegraded":"2024-04-25T13:17:04.520370+0000","last_fullsized":"2024-04-25T13:17:04.520370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236165+0000","last_change":"2024-04-25T13:16:12.733945+0000","last_active":"2024-04-25T13:16:49.236165+0000","last_peered":"2024-04-25T13:16:49.236165+0000","last_clean":"2024-04-25T13:16:49.236165+0000","last_became_active":"2024-04-25T13:16:12.733359+0000","last_became_peered":"2024-04-25T13:16:12.733359+0000","last_unstale":"2024-04-25T13:16:49.236165+0000","last_undegraded":"2024-04-25T13:16:49.236165+0000","last_fullsized":"2024-04-25T13:16:49.236165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:27.352613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131189+0000","last_change":"2024-04-25T13:16:08.008034+0000","last_active":"2024-04-25T13:16:49.131189+0000","last_peered":"2024-04-25T13:16:49.131189+0000","last_clean":"2024-04-25T13:16:49.131189+0000","last_became_active":"2024-04-25T13:16:08.007790+0000","last_became_peered":"2024-04-25T13:16:08.007790+0000","last_unstale":"2024-04-25T13:16:49.131189+0000","last_undegraded":"2024-04-25T13:16:49.131189+0000","last_fullsized":"2024-04-25T13:16:49.131189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:35.903237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.130884+0000","last_change":"2024-04-25T13:16:06.996737+0000","last_active":"2024-04-25T13:16:51.130884+0000","last_peered":"2024-04-25T13:16:51.130884+0000","last_clean":"2024-04-25T13:16:51.130884+0000","last_became_active":"2024-04-25T13:16:06.996439+0000","last_became_peered":"2024-04-25T13:16:06.996439+0000","last_unstale":"2024-04-25T13:16:51.130884+0000","last_undegraded":"2024-04-25T13:16:51.130884+0000","last_fullsized":"2024-04-25T13:16:51.130884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:36.400030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235760+0000","last_change":"2024-04-25T13:16:12.734393+0000","last_active":"2024-04-25T13:16:49.235760+0000","last_peered":"2024-04-25T13:16:49.235760+0000","last_clean":"2024-04-25T13:16:49.235760+0000","last_became_active":"2024-04-25T13:16:12.733328+0000","last_became_peered":"2024-04-25T13:16:12.733328+0000","last_unstale":"2024-04-25T13:16:49.235760+0000","last_undegraded":"2024-04-25T13:16:49.235760+0000","last_fullsized":"2024-04-25T13:16:49.235760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.254012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.136838+0000","last_change":"2024-04-25T13:16:49.135983+0000","last_active":"2024-04-25T13:16:49.136838+0000","last_peered":"2024-04-25T13:16:49.136838+0000","last_clean":"2024-04-25T13:16:49.136838+0000","last_became_active":"2024-04-25T13:16:49.135704+0000","last_became_peered":"2024-04-25T13:16:49.135704+0000","last_unstale":"2024-04-25T13:16:49.136838+0000","last_undegraded":"2024-04-25T13:16:49.136838+0000","last_fullsized":"2024-04-25T13:16:49.136838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:22.268728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.150750+0000","last_change":"2024-04-25T13:16:07.000559+0000","last_active":"2024-04-25T13:16:56.150750+0000","last_peered":"2024-04-25T13:16:56.150750+0000","last_clean":"2024-04-25T13:16:56.150750+0000","last_became_active":"2024-04-25T13:16:07.000243+0000","last_became_peered":"2024-04-25T13:16:07.000243+0000","last_unstale":"2024-04-25T13:16:56.150750+0000","last_undegraded":"2024-04-25T13:16:56.150750+0000","last_fullsized":"2024-04-25T13:16:56.150750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:01.672221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130148+0000","last_change":"2024-04-25T13:16:12.733681+0000","last_active":"2024-04-25T13:16:49.130148+0000","last_peered":"2024-04-25T13:16:49.130148+0000","last_clean":"2024-04-25T13:16:49.130148+0000","last_became_active":"2024-04-25T13:16:12.733245+0000","last_became_peered":"2024-04-25T13:16:12.733245+0000","last_unstale":"2024-04-25T13:16:49.130148+0000","last_undegraded":"2024-04-25T13:16:49.130148+0000","last_fullsized":"2024-04-25T13:16:49.130148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.028858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131242+0000","last_change":"2024-04-25T13:16:08.008790+0000","last_active":"2024-04-25T13:16:49.131242+0000","last_peered":"2024-04-25T13:16:49.131242+0000","last_clean":"2024-04-25T13:16:49.131242+0000","last_became_active":"2024-04-25T13:16:08.008530+0000","last_became_peered":"2024-04-25T13:16:08.008530+0000","last_unstale":"2024-04-25T13:16:49.131242+0000","last_undegraded":"2024-04-25T13:16:49.131242+0000","last_fullsized":"2024-04-25T13:16:49.131242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:44.215930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.525527+0000","last_change":"2024-04-25T13:16:06.997575+0000","last_active":"2024-04-25T13:17:04.525527+0000","last_peered":"2024-04-25T13:17:04.525527+0000","last_clean":"2024-04-25T13:17:04.525527+0000","last_became_active":"2024-04-25T13:16:06.997289+0000","last_became_peered":"2024-04-25T13:16:06.997289+0000","last_unstale":"2024-04-25T13:17:04.525527+0000","last_undegraded":"2024-04-25T13:17:04.525527+0000","last_fullsized":"2024-04-25T13:17:04.525527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:54.096662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129133+0000","last_change":"2024-04-25T13:16:12.040456+0000","last_active":"2024-04-25T13:16:49.129133+0000","last_peered":"2024-04-25T13:16:49.129133+0000","last_clean":"2024-04-25T13:16:49.129133+0000","last_became_active":"2024-04-25T13:16:12.039443+0000","last_became_peered":"2024-04-25T13:16:12.039443+0000","last_unstale":"2024-04-25T13:16:49.129133+0000","last_undegraded":"2024-04-25T13:16:49.129133+0000","last_fullsized":"2024-04-25T13:16:49.129133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:23.192500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132567+0000","last_change":"2024-04-25T13:16:08.004618+0000","last_active":"2024-04-25T13:16:49.132567+0000","last_peered":"2024-04-25T13:16:49.132567+0000","last_clean":"2024-04-25T13:16:49.132567+0000","last_became_active":"2024-04-25T13:16:08.002583+0000","last_became_peered":"2024-04-25T13:16:08.002583+0000","last_unstale":"2024-04-25T13:16:49.132567+0000","last_undegraded":"2024-04-25T13:16:49.132567+0000","last_fullsized":"2024-04-25T13:16:49.132567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:25.609409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129519+0000","last_change":"2024-04-25T13:16:06.996610+0000","last_active":"2024-04-25T13:16:49.129519+0000","last_peered":"2024-04-25T13:16:49.129519+0000","last_clean":"2024-04-25T13:16:49.129519+0000","last_became_active":"2024-04-25T13:16:06.995616+0000","last_became_peered":"2024-04-25T13:16:06.995616+0000","last_unstale":"2024-04-25T13:16:49.129519+0000","last_undegraded":"2024-04-25T13:16:49.129519+0000","last_fullsized":"2024-04-25T13:16:49.129519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:21.135053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133232+0000","last_change":"2024-04-25T13:16:12.043744+0000","last_active":"2024-04-25T13:16:49.133232+0000","last_peered":"2024-04-25T13:16:49.133232+0000","last_clean":"2024-04-25T13:16:49.133232+0000","last_became_active":"2024-04-25T13:16:12.043267+0000","last_became_peered":"2024-04-25T13:16:12.043267+0000","last_unstale":"2024-04-25T13:16:49.133232+0000","last_undegraded":"2024-04-25T13:16:49.133232+0000","last_fullsized":"2024-04-25T13:16:49.133232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:52.316751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.137097+0000","last_change":"2024-04-25T13:16:49.137097+0000","last_active":"2024-04-25T13:16:49.137097+0000","last_peered":"2024-04-25T13:16:49.137097+0000","last_clean":"2024-04-25T13:16:49.137097+0000","last_became_active":"2024-04-25T13:16:49.136773+0000","last_became_peered":"2024-04-25T13:16:49.136773+0000","last_unstale":"2024-04-25T13:16:49.137097+0000","last_undegraded":"2024-04-25T13:16:49.137097+0000","last_fullsized":"2024-04-25T13:16:49.137097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:56.580060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.148921+0000","last_change":"2024-04-25T13:16:06.997061+0000","last_active":"2024-04-25T13:16:56.148921+0000","last_peered":"2024-04-25T13:16:56.148921+0000","last_clean":"2024-04-25T13:16:56.148921+0000","last_became_active":"2024-04-25T13:16:06.996418+0000","last_became_peered":"2024-04-25T13:16:06.996418+0000","last_unstale":"2024-04-25T13:16:56.148921+0000","last_undegraded":"2024-04-25T13:16:56.148921+0000","last_fullsized":"2024-04-25T13:16:56.148921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:34.878260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236082+0000","last_change":"2024-04-25T13:16:12.042796+0000","last_active":"2024-04-25T13:16:49.236082+0000","last_peered":"2024-04-25T13:16:49.236082+0000","last_clean":"2024-04-25T13:16:49.236082+0000","last_became_active":"2024-04-25T13:16:12.042252+0000","last_became_peered":"2024-04-25T13:16:12.042252+0000","last_unstale":"2024-04-25T13:16:49.236082+0000","last_undegraded":"2024-04-25T13:16:49.236082+0000","last_fullsized":"2024-04-25T13:16:49.236082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:51.334438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130623+0000","last_change":"2024-04-25T13:16:08.016203+0000","last_active":"2024-04-25T13:16:49.130623+0000","last_peered":"2024-04-25T13:16:49.130623+0000","last_clean":"2024-04-25T13:16:49.130623+0000","last_became_active":"2024-04-25T13:16:08.015820+0000","last_became_peered":"2024-04-25T13:16:08.015820+0000","last_unstale":"2024-04-25T13:16:49.130623+0000","last_undegraded":"2024-04-25T13:16:49.130623+0000","last_fullsized":"2024-04-25T13:16:49.130623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.518227+0000","last_change":"2024-04-25T13:16:06.996624+0000","last_active":"2024-04-25T13:17:04.518227+0000","last_peered":"2024-04-25T13:17:04.518227+0000","last_clean":"2024-04-25T13:17:04.518227+0000","last_became_active":"2024-04-25T13:16:06.996373+0000","last_became_peered":"2024-04-25T13:16:06.996373+0000","last_unstale":"2024-04-25T13:17:04.518227+0000","last_undegraded":"2024-04-25T13:17:04.518227+0000","last_fullsized":"2024-04-25T13:17:04.518227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:29.929030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235595+0000","last_change":"2024-04-25T13:16:12.733792+0000","last_active":"2024-04-25T13:16:49.235595+0000","last_peered":"2024-04-25T13:16:49.235595+0000","last_clean":"2024-04-25T13:16:49.235595+0000","last_became_active":"2024-04-25T13:16:12.733314+0000","last_became_peered":"2024-04-25T13:16:12.733314+0000","last_unstale":"2024-04-25T13:16:49.235595+0000","last_undegraded":"2024-04-25T13:16:49.235595+0000","last_fullsized":"2024-04-25T13:16:49.235595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.836368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134224+0000","last_change":"2024-04-25T13:16:12.734573+0000","last_active":"2024-04-25T13:16:49.134224+0000","last_peered":"2024-04-25T13:16:49.134224+0000","last_clean":"2024-04-25T13:16:49.134224+0000","last_became_active":"2024-04-25T13:16:12.733908+0000","last_became_peered":"2024-04-25T13:16:12.733908+0000","last_unstale":"2024-04-25T13:16:49.134224+0000","last_undegraded":"2024-04-25T13:16:49.134224+0000","last_fullsized":"2024-04-25T13:16:49.134224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:59.673528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.128734+0000","last_change":"2024-04-25T13:16:08.008915+0000","last_active":"2024-04-25T13:16:49.128734+0000","last_peered":"2024-04-25T13:16:49.128734+0000","last_clean":"2024-04-25T13:16:49.128734+0000","last_became_active":"2024-04-25T13:16:08.008586+0000","last_became_peered":"2024-04-25T13:16:08.008586+0000","last_unstale":"2024-04-25T13:16:49.128734+0000","last_undegraded":"2024-04-25T13:16:49.128734+0000","last_fullsized":"2024-04-25T13:16:49.128734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:46.905065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.132985+0000","last_change":"2024-04-25T13:16:06.994489+0000","last_active":"2024-04-25T13:16:51.132985+0000","last_peered":"2024-04-25T13:16:51.132985+0000","last_clean":"2024-04-25T13:16:51.132985+0000","last_became_active":"2024-04-25T13:16:06.994005+0000","last_became_peered":"2024-04-25T13:16:06.994005+0000","last_unstale":"2024-04-25T13:16:51.132985+0000","last_undegraded":"2024-04-25T13:16:51.132985+0000","last_fullsized":"2024-04-25T13:16:51.132985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:43.921452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235786+0000","last_change":"2024-04-25T13:16:12.037008+0000","last_active":"2024-04-25T13:16:49.235786+0000","last_peered":"2024-04-25T13:16:49.235786+0000","last_clean":"2024-04-25T13:16:49.235786+0000","last_became_active":"2024-04-25T13:16:12.036569+0000","last_became_peered":"2024-04-25T13:16:12.036569+0000","last_unstale":"2024-04-25T13:16:49.235786+0000","last_undegraded":"2024-04-25T13:16:49.235786+0000","last_fullsized":"2024-04-25T13:16:49.235786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:48.224913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236198+0000","last_change":"2024-04-25T13:16:08.008747+0000","last_active":"2024-04-25T13:16:49.236198+0000","last_peered":"2024-04-25T13:16:49.236198+0000","last_clean":"2024-04-25T13:16:49.236198+0000","last_became_active":"2024-04-25T13:16:08.008078+0000","last_became_peered":"2024-04-25T13:16:08.008078+0000","last_unstale":"2024-04-25T13:16:49.236198+0000","last_undegraded":"2024-04-25T13:16:49.236198+0000","last_fullsized":"2024-04-25T13:16:49.236198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:19.590099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236018+0000","last_change":"2024-04-25T13:16:06.997642+0000","last_active":"2024-04-25T13:16:49.236018+0000","last_peered":"2024-04-25T13:16:49.236018+0000","last_clean":"2024-04-25T13:16:49.236018+0000","last_became_active":"2024-04-25T13:16:06.996985+0000","last_became_peered":"2024-04-25T13:16:06.996985+0000","last_unstale":"2024-04-25T13:16:49.236018+0000","last_undegraded":"2024-04-25T13:16:49.236018+0000","last_fullsized":"2024-04-25T13:16:49.236018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:49.853125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.133935+0000","last_change":"2024-04-25T13:16:06.992687+0000","last_active":"2024-04-25T13:16:51.133935+0000","last_peered":"2024-04-25T13:16:51.133935+0000","last_clean":"2024-04-25T13:16:51.133935+0000","last_became_active":"2024-04-25T13:16:06.992407+0000","last_became_peered":"2024-04-25T13:16:06.992407+0000","last_unstale":"2024-04-25T13:16:51.133935+0000","last_undegraded":"2024-04-25T13:16:51.133935+0000","last_fullsized":"2024-04-25T13:16:51.133935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:37.658458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134927+0000","last_change":"2024-04-25T13:16:08.004510+0000","last_active":"2024-04-25T13:16:49.134927+0000","last_peered":"2024-04-25T13:16:49.134927+0000","last_clean":"2024-04-25T13:16:49.134927+0000","last_became_active":"2024-04-25T13:16:08.003959+0000","last_became_peered":"2024-04-25T13:16:08.003959+0000","last_unstale":"2024-04-25T13:16:49.134927+0000","last_undegraded":"2024-04-25T13:16:49.134927+0000","last_fullsized":"2024-04-25T13:16:49.134927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:45.142873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131981+0000","last_change":"2024-04-25T13:16:12.037097+0000","last_active":"2024-04-25T13:16:49.131981+0000","last_peered":"2024-04-25T13:16:49.131981+0000","last_clean":"2024-04-25T13:16:49.131981+0000","last_became_active":"2024-04-25T13:16:12.036651+0000","last_became_peered":"2024-04-25T13:16:12.036651+0000","last_unstale":"2024-04-25T13:16:49.131981+0000","last_undegraded":"2024-04-25T13:16:49.131981+0000","last_fullsized":"2024-04-25T13:16:49.131981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:34.443514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.518175+0000","last_change":"2024-04-25T13:16:06.996311+0000","last_active":"2024-04-25T13:17:04.518175+0000","last_peered":"2024-04-25T13:17:04.518175+0000","last_clean":"2024-04-25T13:17:04.518175+0000","last_became_active":"2024-04-25T13:16:06.996010+0000","last_became_peered":"2024-04-25T13:16:06.996010+0000","last_unstale":"2024-04-25T13:17:04.518175+0000","last_undegraded":"2024-04-25T13:17:04.518175+0000","last_fullsized":"2024-04-25T13:17:04.518175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:08.835482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132357+0000","last_change":"2024-04-25T13:16:08.002159+0000","last_active":"2024-04-25T13:16:49.132357+0000","last_peered":"2024-04-25T13:16:49.132357+0000","last_clean":"2024-04-25T13:16:49.132357+0000","last_became_active":"2024-04-25T13:16:08.001833+0000","last_became_peered":"2024-04-25T13:16:08.001833+0000","last_unstale":"2024-04-25T13:16:49.132357+0000","last_undegraded":"2024-04-25T13:16:49.132357+0000","last_fullsized":"2024-04-25T13:16:49.132357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:25.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236270+0000","last_change":"2024-04-25T13:16:12.042721+0000","last_active":"2024-04-25T13:16:49.236270+0000","last_peered":"2024-04-25T13:16:49.236270+0000","last_clean":"2024-04-25T13:16:49.236270+0000","last_became_active":"2024-04-25T13:16:12.042000+0000","last_became_peered":"2024-04-25T13:16:12.042000+0000","last_unstale":"2024-04-25T13:16:49.236270+0000","last_undegraded":"2024-04-25T13:16:49.236270+0000","last_fullsized":"2024-04-25T13:16:49.236270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:18.702032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235823+0000","last_change":"2024-04-25T13:16:08.008364+0000","last_active":"2024-04-25T13:16:49.235823+0000","last_peered":"2024-04-25T13:16:49.235823+0000","last_clean":"2024-04-25T13:16:49.235823+0000","last_became_active":"2024-04-25T13:16:08.007728+0000","last_became_peered":"2024-04-25T13:16:08.007728+0000","last_unstale":"2024-04-25T13:16:49.235823+0000","last_undegraded":"2024-04-25T13:16:49.235823+0000","last_fullsized":"2024-04-25T13:16:49.235823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:08.731178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131539+0000","last_change":"2024-04-25T13:16:08.011273+0000","last_active":"2024-04-25T13:16:49.131539+0000","last_peered":"2024-04-25T13:16:49.131539+0000","last_clean":"2024-04-25T13:16:49.131539+0000","last_became_active":"2024-04-25T13:16:08.010981+0000","last_became_peered":"2024-04-25T13:16:08.010981+0000","last_unstale":"2024-04-25T13:16:49.131539+0000","last_undegraded":"2024-04-25T13:16:49.131539+0000","last_fullsized":"2024-04-25T13:16:49.131539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:03.835422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130170+0000","last_change":"2024-04-25T13:16:08.016413+0000","last_active":"2024-04-25T13:16:49.130170+0000","last_peered":"2024-04-25T13:16:49.130170+0000","last_clean":"2024-04-25T13:16:49.130170+0000","last_became_active":"2024-04-25T13:16:08.016084+0000","last_became_peered":"2024-04-25T13:16:08.016084+0000","last_unstale":"2024-04-25T13:16:49.130170+0000","last_undegraded":"2024-04-25T13:16:49.130170+0000","last_fullsized":"2024-04-25T13:16:49.130170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:41.014999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.138094+0000","last_change":"2024-04-25T13:16:49.138094+0000","last_active":"2024-04-25T13:16:49.138094+0000","last_peered":"2024-04-25T13:16:49.138094+0000","last_clean":"2024-04-25T13:16:49.138094+0000","last_became_active":"2024-04-25T13:16:49.137825+0000","last_became_peered":"2024-04-25T13:16:49.137825+0000","last_unstale":"2024-04-25T13:16:49.138094+0000","last_undegraded":"2024-04-25T13:16:49.138094+0000","last_fullsized":"2024-04-25T13:16:49.138094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:52.534923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236041+0000","last_change":"2024-04-25T13:16:08.012814+0000","last_active":"2024-04-25T13:16:49.236041+0000","last_peered":"2024-04-25T13:16:49.236041+0000","last_clean":"2024-04-25T13:16:49.236041+0000","last_became_active":"2024-04-25T13:16:08.012481+0000","last_became_peered":"2024-04-25T13:16:08.012481+0000","last_unstale":"2024-04-25T13:16:49.236041+0000","last_undegraded":"2024-04-25T13:16:49.236041+0000","last_fullsized":"2024-04-25T13:16:49.236041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:05.409701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129200+0000","last_change":"2024-04-25T13:16:08.008843+0000","last_active":"2024-04-25T13:16:49.129200+0000","last_peered":"2024-04-25T13:16:49.129200+0000","last_clean":"2024-04-25T13:16:49.129200+0000","last_became_active":"2024-04-25T13:16:08.008489+0000","last_became_peered":"2024-04-25T13:16:08.008489+0000","last_unstale":"2024-04-25T13:16:49.129200+0000","last_undegraded":"2024-04-25T13:16:49.129200+0000","last_fullsized":"2024-04-25T13:16:49.129200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:35.740816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236176+0000","last_change":"2024-04-25T13:16:08.008121+0000","last_active":"2024-04-25T13:16:49.236176+0000","last_peered":"2024-04-25T13:16:49.236176+0000","last_clean":"2024-04-25T13:16:49.236176+0000","last_became_active":"2024-04-25T13:16:08.007727+0000","last_became_peered":"2024-04-25T13:16:08.007727+0000","last_unstale":"2024-04-25T13:16:49.236176+0000","last_undegraded":"2024-04-25T13:16:49.236176+0000","last_fullsized":"2024-04-25T13:16:49.236176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:11.193610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236219+0000","last_change":"2024-04-25T13:16:08.014997+0000","last_active":"2024-04-25T13:16:49.236219+0000","last_peered":"2024-04-25T13:16:49.236219+0000","last_clean":"2024-04-25T13:16:49.236219+0000","last_became_active":"2024-04-25T13:16:08.014579+0000","last_became_peered":"2024-04-25T13:16:08.014579+0000","last_unstale":"2024-04-25T13:16:49.236219+0000","last_undegraded":"2024-04-25T13:16:49.236219+0000","last_fullsized":"2024-04-25T13:16:49.236219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:07.884249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129692+0000","last_change":"2024-04-25T13:16:08.015379+0000","last_active":"2024-04-25T13:16:49.129692+0000","last_peered":"2024-04-25T13:16:49.129692+0000","last_clean":"2024-04-25T13:16:49.129692+0000","last_became_active":"2024-04-25T13:16:08.014693+0000","last_became_peered":"2024-04-25T13:16:08.014693+0000","last_unstale":"2024-04-25T13:16:49.129692+0000","last_undegraded":"2024-04-25T13:16:49.129692+0000","last_fullsized":"2024-04-25T13:16:49.129692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:41.305358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235707+0000","last_change":"2024-04-25T13:16:08.014873+0000","last_active":"2024-04-25T13:16:49.235707+0000","last_peered":"2024-04-25T13:16:49.235707+0000","last_clean":"2024-04-25T13:16:49.235707+0000","last_became_active":"2024-04-25T13:16:08.014575+0000","last_became_peered":"2024-04-25T13:16:08.014575+0000","last_unstale":"2024-04-25T13:16:49.235707+0000","last_undegraded":"2024-04-25T13:16:49.235707+0000","last_fullsized":"2024-04-25T13:16:49.235707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:41.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.135573+0000","last_change":"2024-04-25T13:16:49.133825+0000","last_active":"2024-04-25T13:16:49.135573+0000","last_peered":"2024-04-25T13:16:49.135573+0000","last_clean":"2024-04-25T13:16:49.135573+0000","last_became_active":"2024-04-25T13:16:49.133449+0000","last_became_peered":"2024-04-25T13:16:49.133449+0000","last_unstale":"2024-04-25T13:16:49.135573+0000","last_undegraded":"2024-04-25T13:16:49.135573+0000","last_fullsized":"2024-04-25T13:16:49.135573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:44.601144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134802+0000","last_change":"2024-04-25T13:16:08.000447+0000","last_active":"2024-04-25T13:16:49.134802+0000","last_peered":"2024-04-25T13:16:49.134802+0000","last_clean":"2024-04-25T13:16:49.134802+0000","last_became_active":"2024-04-25T13:16:08.000102+0000","last_became_peered":"2024-04-25T13:16:08.000102+0000","last_unstale":"2024-04-25T13:16:49.134802+0000","last_undegraded":"2024-04-25T13:16:49.134802+0000","last_fullsized":"2024-04-25T13:16:49.134802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:30.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235889+0000","last_change":"2024-04-25T13:16:08.008437+0000","last_active":"2024-04-25T13:16:49.235889+0000","last_peered":"2024-04-25T13:16:49.235889+0000","last_clean":"2024-04-25T13:16:49.235889+0000","last_became_active":"2024-04-25T13:16:08.008173+0000","last_became_peered":"2024-04-25T13:16:08.008173+0000","last_unstale":"2024-04-25T13:16:49.235889+0000","last_undegraded":"2024-04-25T13:16:49.235889+0000","last_fullsized":"2024-04-25T13:16:49.235889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:54.362757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131654+0000","last_change":"2024-04-25T13:16:08.004689+0000","last_active":"2024-04-25T13:16:49.131654+0000","last_peered":"2024-04-25T13:16:49.131654+0000","last_clean":"2024-04-25T13:16:49.131654+0000","last_became_active":"2024-04-25T13:16:08.004340+0000","last_became_peered":"2024-04-25T13:16:08.004340+0000","last_unstale":"2024-04-25T13:16:49.131654+0000","last_undegraded":"2024-04-25T13:16:49.131654+0000","last_fullsized":"2024-04-25T13:16:49.131654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:18.870731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132255+0000","last_change":"2024-04-25T13:16:08.005344+0000","last_active":"2024-04-25T13:16:49.132255+0000","last_peered":"2024-04-25T13:16:49.132255+0000","last_clean":"2024-04-25T13:16:49.132255+0000","last_became_active":"2024-04-25T13:16:08.005041+0000","last_became_peered":"2024-04-25T13:16:08.005041+0000","last_unstale":"2024-04-25T13:16:49.132255+0000","last_undegraded":"2024-04-25T13:16:49.132255+0000","last_fullsized":"2024-04-25T13:16:49.132255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.389800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.136388+0000","last_change":"2024-04-25T13:16:49.135779+0000","last_active":"2024-04-25T13:16:49.136388+0000","last_peered":"2024-04-25T13:16:49.136388+0000","last_clean":"2024-04-25T13:16:49.136388+0000","last_became_active":"2024-04-25T13:16:49.135476+0000","last_became_peered":"2024-04-25T13:16:49.135476+0000","last_unstale":"2024-04-25T13:16:49.136388+0000","last_undegraded":"2024-04-25T13:16:49.136388+0000","last_fullsized":"2024-04-25T13:16:49.136388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:47.445270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129582+0000","last_change":"2024-04-25T13:16:08.012737+0000","last_active":"2024-04-25T13:16:49.129582+0000","last_peered":"2024-04-25T13:16:49.129582+0000","last_clean":"2024-04-25T13:16:49.129582+0000","last_became_active":"2024-04-25T13:16:08.012472+0000","last_became_peered":"2024-04-25T13:16:08.012472+0000","last_unstale":"2024-04-25T13:16:49.129582+0000","last_undegraded":"2024-04-25T13:16:49.129582+0000","last_fullsized":"2024-04-25T13:16:49.129582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:36.880757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.128898+0000","last_change":"2024-04-25T13:16:08.007177+0000","last_active":"2024-04-25T13:16:49.128898+0000","last_peered":"2024-04-25T13:16:49.128898+0000","last_clean":"2024-04-25T13:16:49.128898+0000","last_became_active":"2024-04-25T13:16:08.006866+0000","last_became_peered":"2024-04-25T13:16:08.006866+0000","last_unstale":"2024-04-25T13:16:49.128898+0000","last_undegraded":"2024-04-25T13:16:49.128898+0000","last_fullsized":"2024-04-25T13:16:49.128898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:16.707771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133723+0000","last_change":"2024-04-25T13:16:07.999761+0000","last_active":"2024-04-25T13:16:49.133723+0000","last_peered":"2024-04-25T13:16:49.133723+0000","last_clean":"2024-04-25T13:16:49.133723+0000","last_became_active":"2024-04-25T13:16:07.999033+0000","last_became_peered":"2024-04-25T13:16:07.999033+0000","last_unstale":"2024-04-25T13:16:49.133723+0000","last_undegraded":"2024-04-25T13:16:49.133723+0000","last_fullsized":"2024-04-25T13:16:49.133723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:40.420290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235662+0000","last_change":"2024-04-25T13:16:08.016370+0000","last_active":"2024-04-25T13:16:49.235662+0000","last_peered":"2024-04-25T13:16:49.235662+0000","last_clean":"2024-04-25T13:16:49.235662+0000","last_became_active":"2024-04-25T13:16:08.016068+0000","last_became_peered":"2024-04-25T13:16:08.016068+0000","last_unstale":"2024-04-25T13:16:49.235662+0000","last_undegraded":"2024-04-25T13:16:49.235662+0000","last_fullsized":"2024-04-25T13:16:49.235662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:11.475920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132457+0000","last_change":"2024-04-25T13:16:08.005195+0000","last_active":"2024-04-25T13:16:49.132457+0000","last_peered":"2024-04-25T13:16:49.132457+0000","last_clean":"2024-04-25T13:16:49.132457+0000","last_became_active":"2024-04-25T13:16:08.004655+0000","last_became_peered":"2024-04-25T13:16:08.004655+0000","last_unstale":"2024-04-25T13:16:49.132457+0000","last_undegraded":"2024-04-25T13:16:49.132457+0000","last_fullsized":"2024-04-25T13:16:49.132457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:28.249616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235787+0000","last_change":"2024-04-25T13:16:08.011310+0000","last_active":"2024-04-25T13:16:49.235787+0000","last_peered":"2024-04-25T13:16:49.235787+0000","last_clean":"2024-04-25T13:16:49.235787+0000","last_became_active":"2024-04-25T13:16:08.011047+0000","last_became_peered":"2024-04-25T13:16:08.011047+0000","last_unstale":"2024-04-25T13:16:49.235787+0000","last_undegraded":"2024-04-25T13:16:49.235787+0000","last_fullsized":"2024-04-25T13:16:49.235787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:55.447995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236059+0000","last_change":"2024-04-25T13:16:08.012191+0000","last_active":"2024-04-25T13:16:49.236059+0000","last_peered":"2024-04-25T13:16:49.236059+0000","last_clean":"2024-04-25T13:16:49.236059+0000","last_became_active":"2024-04-25T13:16:08.011916+0000","last_became_peered":"2024-04-25T13:16:08.011916+0000","last_unstale":"2024-04-25T13:16:49.236059+0000","last_undegraded":"2024-04-25T13:16:49.236059+0000","last_fullsized":"2024-04-25T13:16:49.236059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:33.520554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131648+0000","last_change":"2024-04-25T13:16:08.012349+0000","last_active":"2024-04-25T13:16:49.131648+0000","last_peered":"2024-04-25T13:16:49.131648+0000","last_clean":"2024-04-25T13:16:49.131648+0000","last_became_active":"2024-04-25T13:16:08.011893+0000","last_became_peered":"2024-04-25T13:16:08.011893+0000","last_unstale":"2024-04-25T13:16:49.131648+0000","last_undegraded":"2024-04-25T13:16:49.131648+0000","last_fullsized":"2024-04-25T13:16:49.131648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:11.901170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235983+0000","last_change":"2024-04-25T13:16:08.015681+0000","last_active":"2024-04-25T13:16:49.235983+0000","last_peered":"2024-04-25T13:16:49.235983+0000","last_clean":"2024-04-25T13:16:49.235983+0000","last_became_active":"2024-04-25T13:16:08.015405+0000","last_became_peered":"2024-04-25T13:16:08.015405+0000","last_unstale":"2024-04-25T13:16:49.235983+0000","last_undegraded":"2024-04-25T13:16:49.235983+0000","last_fullsized":"2024-04-25T13:16:49.235983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:00.932243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130058+0000","last_change":"2024-04-25T13:16:08.000456+0000","last_active":"2024-04-25T13:16:49.130058+0000","last_peered":"2024-04-25T13:16:49.130058+0000","last_clean":"2024-04-25T13:16:49.130058+0000","last_became_active":"2024-04-25T13:16:08.000193+0000","last_became_peered":"2024-04-25T13:16:08.000193+0000","last_unstale":"2024-04-25T13:16:49.130058+0000","last_undegraded":"2024-04-25T13:16:49.130058+0000","last_fullsized":"2024-04-25T13:16:49.130058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:15.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129924+0000","last_change":"2024-04-25T13:16:08.016060+0000","last_active":"2024-04-25T13:16:49.129924+0000","last_peered":"2024-04-25T13:16:49.129924+0000","last_clean":"2024-04-25T13:16:49.129924+0000","last_became_active":"2024-04-25T13:16:08.014300+0000","last_became_peered":"2024-04-25T13:16:08.014300+0000","last_unstale":"2024-04-25T13:16:49.129924+0000","last_undegraded":"2024-04-25T13:16:49.129924+0000","last_fullsized":"2024-04-25T13:16:49.129924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:37.644887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130981+0000","last_change":"2024-04-25T13:16:08.004946+0000","last_active":"2024-04-25T13:16:49.130981+0000","last_peered":"2024-04-25T13:16:49.130981+0000","last_clean":"2024-04-25T13:16:49.130981+0000","last_became_active":"2024-04-25T13:16:08.004673+0000","last_became_peered":"2024-04-25T13:16:08.004673+0000","last_unstale":"2024-04-25T13:16:49.130981+0000","last_undegraded":"2024-04-25T13:16:49.130981+0000","last_fullsized":"2024-04-25T13:16:49.130981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:18.616424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131000+0000","last_change":"2024-04-25T13:16:08.015676+0000","last_active":"2024-04-25T13:16:49.131000+0000","last_peered":"2024-04-25T13:16:49.131000+0000","last_clean":"2024-04-25T13:16:49.131000+0000","last_became_active":"2024-04-25T13:16:08.014719+0000","last_became_peered":"2024-04-25T13:16:08.014719+0000","last_unstale":"2024-04-25T13:16:49.131000+0000","last_undegraded":"2024-04-25T13:16:49.131000+0000","last_fullsized":"2024-04-25T13:16:49.131000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:04.274611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134113+0000","last_change":"2024-04-25T13:16:07.997665+0000","last_active":"2024-04-25T13:16:49.134113+0000","last_peered":"2024-04-25T13:16:49.134113+0000","last_clean":"2024-04-25T13:16:49.134113+0000","last_became_active":"2024-04-25T13:16:07.996792+0000","last_became_peered":"2024-04-25T13:16:07.996792+0000","last_unstale":"2024-04-25T13:16:49.134113+0000","last_undegraded":"2024-04-25T13:16:49.134113+0000","last_fullsized":"2024-04-25T13:16:49.134113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:39.367026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129755+0000","last_change":"2024-04-25T13:16:08.001495+0000","last_active":"2024-04-25T13:16:49.129755+0000","last_peered":"2024-04-25T13:16:49.129755+0000","last_clean":"2024-04-25T13:16:49.129755+0000","last_became_active":"2024-04-25T13:16:08.001182+0000","last_became_peered":"2024-04-25T13:16:08.001182+0000","last_unstale":"2024-04-25T13:16:49.129755+0000","last_undegraded":"2024-04-25T13:16:49.129755+0000","last_fullsized":"2024-04-25T13:16:49.129755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:48.417192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131530+0000","last_change":"2024-04-25T13:16:08.006262+0000","last_active":"2024-04-25T13:16:49.131530+0000","last_peered":"2024-04-25T13:16:49.131530+0000","last_clean":"2024-04-25T13:16:49.131530+0000","last_became_active":"2024-04-25T13:16:08.005976+0000","last_became_peered":"2024-04-25T13:16:08.005976+0000","last_unstale":"2024-04-25T13:16:49.131530+0000","last_undegraded":"2024-04-25T13:16:49.131530+0000","last_fullsized":"2024-04-25T13:16:49.131530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:22.965387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":714627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":127373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":126091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":123489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":127407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":123621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":123109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":913408,"data_stored":712819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:16.571 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:16.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.708+0000 7f75a499b640 1 Processor -- start 2024-04-25T13:17:16.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.708+0000 7f75a499b640 1 -- start start 2024-04-25T13:17:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f75a499b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75a01554e0 0x7f75a015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f75a499b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75a00b3c00 0x7f75a00b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f75a499b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a01558c0 con 0x7f75a00b5450 2024-04-25T13:17:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f75a499b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f75a00b4a80 con 0x7f75a01554e0 2024-04-25T13:17:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f75a499b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f75a015f630 con 0x7f75a00b3c00 2024-04-25T13:17:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f759e59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75a01554e0 0x7f75a015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f759ed9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f75a00b5450 0x7f75a00d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51174/0 (socket says 172.21.15.52:51174) 2024-04-25T13:17:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f759ed9d640 1 -- 172.21.15.52:0/2696637026 learned_addr learned my addr 172.21.15.52:0/2696637026 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f7597fff640 1 --2- 172.21.15.52:0/2696637026 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75a00b3c00 0x7f75a00b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f759e59c640 1 -- 172.21.15.52:0/2696637026 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75a00b3c00 msgr2=0x7f75a00b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f759e59c640 1 --2- 172.21.15.52:0/2696637026 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75a00b3c00 0x7f75a00b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f759e59c640 1 -- 172.21.15.52:0/2696637026 >> v1:172.21.15.52:6789/0 conn(0x7f75a00b5450 legacy=0x7f75a00d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f759e59c640 1 -- 172.21.15.52:0/2696637026 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a00cb8c0 con 0x7f75a01554e0 2024-04-25T13:17:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.709+0000 7f759dd9b640 1 -- 172.21.15.52:0/2696637026 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944405115 0 0) 0x7f7598001490 con 0x7f75a00b5450 2024-04-25T13:17:16.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.710+0000 7f759e59c640 1 --2- 172.21.15.52:0/2696637026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75a01554e0 0x7f75a015f0f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f75900097a0 tx=0x7f759002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4544aa3e2b9509 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.710+0000 7f759dd9b640 1 -- 172.21.15.52:0/2696637026 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590037070 con 0x7f75a01554e0 2024-04-25T13:17:16.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.710+0000 7f759dd9b640 1 -- 172.21.15.52:0/2696637026 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7590032440 con 0x7f75a01554e0 2024-04-25T13:17:16.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.710+0000 7f759dd9b640 1 -- 172.21.15.52:0/2696637026 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590032810 con 0x7f75a01554e0 2024-04-25T13:17:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.710+0000 7f75a499b640 1 -- 172.21.15.52:0/2696637026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75a01554e0 msgr2=0x7f75a015f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.710+0000 7f75a499b640 1 --2- 172.21.15.52:0/2696637026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75a01554e0 0x7f75a015f0f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f75900097a0 tx=0x7f759002a210 comp rx=0 tx=0).stop 2024-04-25T13:17:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.711+0000 7f75a499b640 1 -- 172.21.15.52:0/2696637026 shutdown_connections 2024-04-25T13:17:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.711+0000 7f75a499b640 1 --2- 172.21.15.52:0/2696637026 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75a00b3c00 0x7f75a00b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.711+0000 7f75a499b640 1 --2- 172.21.15.52:0/2696637026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75a01554e0 0x7f75a015f0f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.711+0000 7f75a499b640 1 -- 172.21.15.52:0/2696637026 >> 172.21.15.52:0/2696637026 conn(0x7f75a0074d50 msgr2=0x7f75a0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.711+0000 7f75a499b640 1 -- 172.21.15.52:0/2696637026 shutdown_connections 2024-04-25T13:17:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.711+0000 7f75a499b640 1 -- 172.21.15.52:0/2696637026 wait complete. 2024-04-25T13:17:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.712+0000 7f75a499b640 1 Processor -- start 2024-04-25T13:17:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.712+0000 7f75a499b640 1 -- start start 2024-04-25T13:17:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f75a499b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a00b3c00 0x7f75a01e7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f75a499b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75a00b5450 0x7f75a01e4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f75a499b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75a01554e0 0x7f75a01e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f75a499b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75a00b4430 con 0x7f75a00b5450 2024-04-25T13:17:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f75a499b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f75a00b4150 con 0x7f75a00b3c00 2024-04-25T13:17:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f75a499b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f75a00b4710 con 0x7f75a01554e0 2024-04-25T13:17:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f7597fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75a00b5450 0x7f75a01e4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f7597fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75a00b5450 0x7f75a01e4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36162/0 (socket says 172.21.15.52:36162) 2024-04-25T13:17:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f7597fff640 1 -- 172.21.15.52:0/3927626514 learned_addr learned my addr 172.21.15.52:0/3927626514 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f759e59c640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a00b3c00 0x7f75a01e7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f759ed9d640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75a01554e0 0x7f75a01e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f7597fff640 1 -- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75a01554e0 msgr2=0x7f75a01e53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f7597fff640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75a01554e0 0x7f75a01e53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f7597fff640 1 -- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a00b3c00 msgr2=0x7f75a01e7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f7597fff640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a00b3c00 0x7f75a01e7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f7597fff640 1 -- 172.21.15.52:0/3927626514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a015a0c0 con 0x7f75a00b5450 2024-04-25T13:17:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f759ed9d640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75a01554e0 0x7f75a01e53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f759e59c640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a00b3c00 0x7f75a01e7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f7597fff640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75a00b5450 0x7f75a01e4e60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f758800e870 tx=0x7f758800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f7596ffd640 1 -- 172.21.15.52:0/3927626514 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588017070 con 0x7f75a00b5450 2024-04-25T13:17:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f7596ffd640 1 -- 172.21.15.52:0/3927626514 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758800c940 con 0x7f75a00b5450 2024-04-25T13:17:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f75a499b640 1 -- 172.21.15.52:0/3927626514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a015a3a0 con 0x7f75a00b5450 2024-04-25T13:17:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.713+0000 7f7596ffd640 1 -- 172.21.15.52:0/3927626514 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758800cd30 con 0x7f75a00b5450 2024-04-25T13:17:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.714+0000 7f75a499b640 1 -- 172.21.15.52:0/3927626514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a01e4940 con 0x7f75a00b5450 2024-04-25T13:17:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.714+0000 7f75a499b640 1 -- 172.21.15.52:0/3927626514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a0068e40 con 0x7f75a00b5450 2024-04-25T13:17:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.715+0000 7f7596ffd640 1 -- 172.21.15.52:0/3927626514 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f758801a070 con 0x7f75a00b5450 2024-04-25T13:17:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.715+0000 7f7596ffd640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f758006c920 0x7f758006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.716+0000 7f7596ffd640 1 -- 172.21.15.52:0/3927626514 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f758808c0a0 con 0x7f75a00b5450 2024-04-25T13:17:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.716+0000 7f759e59c640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f758006c920 0x7f758006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.716+0000 7f759e59c640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f758006c920 0x7f758006ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7590034000 tx=0x7f759002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.720+0000 7f7596ffd640 1 -- 172.21.15.52:0/3927626514 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f758805a140 con 0x7f75a00b5450 2024-04-25T13:17:16.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.908+0000 7f75a499b640 1 -- 172.21.15.52:0/3927626514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75a00cc260 con 0x7f75a00b5450 2024-04-25T13:17:16.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.909+0000 7f7596ffd640 1 -- 172.21.15.52:0/3927626514 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18927 (secure 0 0 0) 0x7f7588059a40 con 0x7f75a00b5450 2024-04-25T13:17:16.909 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:17:16.910 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:49.125761+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:16.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.911+0000 7f75a499b640 1 -- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f758006c920 msgr2=0x7f758006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.911+0000 7f75a499b640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f758006c920 0x7f758006ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7590034000 tx=0x7f759002e000 comp rx=0 tx=0).stop 2024-04-25T13:17:16.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.911+0000 7f75a499b640 1 -- 172.21.15.52:0/3927626514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75a00b5450 msgr2=0x7f75a01e4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.911+0000 7f75a499b640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75a00b5450 0x7f75a01e4e60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f758800e870 tx=0x7f758800ed30 comp rx=0 tx=0).stop 2024-04-25T13:17:16.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.911+0000 7f75a499b640 1 -- 172.21.15.52:0/3927626514 shutdown_connections 2024-04-25T13:17:16.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.911+0000 7f75a499b640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f758006c920 0x7f758006ede0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.911+0000 7f75a499b640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75a01554e0 0x7f75a01e53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.911+0000 7f75a499b640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75a00b5450 0x7f75a01e4e60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.911+0000 7f75a499b640 1 --2- 172.21.15.52:0/3927626514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75a00b3c00 0x7f75a01e7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.911+0000 7f75a499b640 1 -- 172.21.15.52:0/3927626514 >> 172.21.15.52:0/3927626514 conn(0x7f75a0074d50 msgr2=0x7f75a0152540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.911+0000 7f75a499b640 1 -- 172.21.15.52:0/3927626514 shutdown_connections 2024-04-25T13:17:16.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:16.911+0000 7f75a499b640 1 -- 172.21.15.52:0/3927626514 wait complete. 2024-04-25T13:17:17.923 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T13:17:17.924 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:18.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.041+0000 7faee3435640 1 Processor -- start 2024-04-25T13:17:18.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.041+0000 7faee3435640 1 -- start start 2024-04-25T13:17:18.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.042+0000 7faee3435640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faedc0c83b0 0x7faedc1587f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.042+0000 7faee3435640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faedc0c8790 0x7faedc0c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.042+0000 7faee3435640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc151950 0x7faedc151da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.042+0000 7faee3435640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7faedc15c2d0 con 0x7faedc0c8790 2024-04-25T13:17:18.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.042+0000 7faee3435640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7faedc158d30 con 0x7faedc0c83b0 2024-04-25T13:17:18.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.042+0000 7faee3435640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7faedc15b470 con 0x7faedc151950 2024-04-25T13:17:18.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.042+0000 7faee09d0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faedc0c8790 0x7faedc0c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.042+0000 7faee09d0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faedc0c8790 0x7faedc0c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36164/0 (socket says 172.21.15.52:36164) 2024-04-25T13:17:18.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.042+0000 7faee09d0640 1 -- 172.21.15.52:0/2626262461 learned_addr learned my addr 172.21.15.52:0/2626262461 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:18.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.042+0000 7faee11d1640 1 --2- 172.21.15.52:0/2626262461 >> v2:172.21.15.102:3300/0 conn(0x7faedc0c83b0 0x7faedc1587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.042+0000 7faee19d2640 1 --2- 172.21.15.52:0/2626262461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc151950 0x7faedc151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.043+0000 7faee09d0640 1 -- 172.21.15.52:0/2626262461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc151950 msgr2=0x7faedc151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:18.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.043+0000 7faee09d0640 1 --2- 172.21.15.52:0/2626262461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc151950 0x7faedc151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.043+0000 7faee09d0640 1 -- 172.21.15.52:0/2626262461 >> v2:172.21.15.102:3300/0 conn(0x7faedc0c83b0 msgr2=0x7faedc1587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:18.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.043+0000 7faee09d0640 1 --2- 172.21.15.52:0/2626262461 >> v2:172.21.15.102:3300/0 conn(0x7faedc0c83b0 0x7faedc1587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.043+0000 7faee09d0640 1 -- 172.21.15.52:0/2626262461 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faedc15b750 con 0x7faedc0c8790 2024-04-25T13:17:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.043+0000 7faee09d0640 1 --2- 172.21.15.52:0/2626262461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faedc0c8790 0x7faedc0c9610 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faedc0cd6f0 tx=0x7faed002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b61f2b829860794 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.044+0000 7faedbfff640 1 -- 172.21.15.52:0/2626262461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0037070 con 0x7faedc0c8790 2024-04-25T13:17:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.044+0000 7faedbfff640 1 -- 172.21.15.52:0/2626262461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed0032440 con 0x7faedc0c8790 2024-04-25T13:17:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.044+0000 7faedbfff640 1 -- 172.21.15.52:0/2626262461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0032810 con 0x7faedc0c8790 2024-04-25T13:17:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.044+0000 7faee3435640 1 -- 172.21.15.52:0/2626262461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faedc0c8790 msgr2=0x7faedc0c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.044+0000 7faee3435640 1 --2- 172.21.15.52:0/2626262461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faedc0c8790 0x7faedc0c9610 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faedc0cd6f0 tx=0x7faed002a1e0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.044+0000 7faee3435640 1 -- 172.21.15.52:0/2626262461 shutdown_connections 2024-04-25T13:17:18.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.044+0000 7faee3435640 1 --2- 172.21.15.52:0/2626262461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc151950 0x7faedc151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.044+0000 7faee3435640 1 --2- 172.21.15.52:0/2626262461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faedc0c8790 0x7faedc0c9610 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.044+0000 7faee3435640 1 --2- 172.21.15.52:0/2626262461 >> v2:172.21.15.102:3300/0 conn(0x7faedc0c83b0 0x7faedc1587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.044+0000 7faee3435640 1 -- 172.21.15.52:0/2626262461 >> 172.21.15.52:0/2626262461 conn(0x7faedc068120 msgr2=0x7faedc06eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:18.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.044+0000 7faee3435640 1 -- 172.21.15.52:0/2626262461 shutdown_connections 2024-04-25T13:17:18.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.044+0000 7faee3435640 1 -- 172.21.15.52:0/2626262461 wait complete. 2024-04-25T13:17:18.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.045+0000 7faee3435640 1 Processor -- start 2024-04-25T13:17:18.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.046+0000 7faee3435640 1 -- start start 2024-04-25T13:17:18.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.046+0000 7faee3435640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc0c83b0 0x7faedc1ea530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.046+0000 7faee3435640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faedc0c8790 0x7faedc1efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.046+0000 7faee3435640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faedc151950 0x7faedc14af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.046+0000 7faee3435640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faedc15bff0 con 0x7faedc0c8790 2024-04-25T13:17:18.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.046+0000 7faee3435640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faedc15bd10 con 0x7faedc151950 2024-04-25T13:17:18.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.046+0000 7faee3435640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7faedc0c9b50 con 0x7faedc0c83b0 2024-04-25T13:17:18.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.046+0000 7faee09d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faedc0c8790 0x7faedc1efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.046+0000 7faee09d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faedc0c8790 0x7faedc1efd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36172/0 (socket says 172.21.15.52:36172) 2024-04-25T13:17:18.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.046+0000 7faee09d0640 1 -- 172.21.15.52:0/1505315905 learned_addr learned my addr 172.21.15.52:0/1505315905 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:18.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faee19d2640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faedc151950 0x7faedc14af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faee11d1640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc0c83b0 0x7faedc1ea530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faee09d0640 1 -- 172.21.15.52:0/1505315905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc0c83b0 msgr2=0x7faedc1ea530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faee09d0640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc0c83b0 0x7faedc1ea530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faee09d0640 1 -- 172.21.15.52:0/1505315905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faedc151950 msgr2=0x7faedc14af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faee09d0640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faedc151950 0x7faedc14af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faee09d0640 1 -- 172.21.15.52:0/1505315905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faedc1eaa70 con 0x7faedc0c8790 2024-04-25T13:17:18.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faee19d2640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faedc151950 0x7faedc14af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:18.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faee09d0640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faedc0c8790 0x7faedc1efd30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faed0000c00 tx=0x7faed00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faed9ffb640 1 -- 172.21.15.52:0/1505315905 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0041020 con 0x7faedc0c8790 2024-04-25T13:17:18.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faed9ffb640 1 -- 172.21.15.52:0/1505315905 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed003d620 con 0x7faedc0c8790 2024-04-25T13:17:18.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faee3435640 1 -- 172.21.15.52:0/1505315905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faedc152b00 con 0x7faedc0c8790 2024-04-25T13:17:18.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faed9ffb640 1 -- 172.21.15.52:0/1505315905 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0037040 con 0x7faedc0c8790 2024-04-25T13:17:18.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.047+0000 7faee3435640 1 -- 172.21.15.52:0/1505315905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faedc072db0 con 0x7faedc0c8790 2024-04-25T13:17:18.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.048+0000 7faee3435640 1 -- 172.21.15.52:0/1505315905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faedc068f50 con 0x7faedc0c8790 2024-04-25T13:17:18.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.049+0000 7faed9ffb640 1 -- 172.21.15.52:0/1505315905 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faed0044020 con 0x7faedc0c8790 2024-04-25T13:17:18.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.049+0000 7faed9ffb640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7faec806c8f0 0x7faec806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.049+0000 7faed9ffb640 1 -- 172.21.15.52:0/1505315905 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7faed00ac690 con 0x7faedc0c8790 2024-04-25T13:17:18.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.050+0000 7faed9ffb640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] conn(0x7faec8076390 0x7faec8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.050+0000 7faee11d1640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7faec806c8f0 0x7faec806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.050+0000 7faed9ffb640 1 -- 172.21.15.52:0/1505315905 --> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faed0032440 con 0x7faec8076390 2024-04-25T13:17:18.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.050+0000 7faed9ffb640 1 -- 172.21.15.52:0/1505315905 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faed00b3050 con 0x7faedc0c8790 2024-04-25T13:17:18.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.050+0000 7faee19d2640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] conn(0x7faec8076390 0x7faec8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.050+0000 7faee19d2640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] conn(0x7faec8076390 0x7faec8078830 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.050+0000 7faee11d1640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7faec806c8f0 0x7faec806edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faecc0073f0 tx=0x7faecc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.051+0000 7faed9ffb640 1 -- 172.21.15.52:0/1505315905 <== osd.0 v2:172.21.15.52:6817/4019725320 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faed0032440 con 0x7faec8076390 2024-04-25T13:17:18.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.064+0000 7faee3435640 1 -- 172.21.15.52:0/1505315905 --> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faedc073520 con 0x7faec8076390 2024-04-25T13:17:18.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.064+0000 7faed9ffb640 1 -- 172.21.15.52:0/1505315905 <== osd.0 v2:172.21.15.52:6817/4019725320 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faedc073520 con 0x7faec8076390 2024-04-25T13:17:18.065 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:18.065 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:18.065 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:18.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.065+0000 7faee3435640 1 -- 172.21.15.52:0/1505315905 >> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] conn(0x7faec8076390 msgr2=0x7faec8078830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.065+0000 7faee3435640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.52:6817/4019725320,v1:172.21.15.52:6819/4019725320] conn(0x7faec8076390 0x7faec8078830 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.065+0000 7faee3435640 1 -- 172.21.15.52:0/1505315905 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7faec806c8f0 msgr2=0x7faec806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.065+0000 7faee3435640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7faec806c8f0 0x7faec806edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faecc0073f0 tx=0x7faecc00b040 comp rx=0 tx=0).stop 2024-04-25T13:17:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.065+0000 7faee3435640 1 -- 172.21.15.52:0/1505315905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faedc0c8790 msgr2=0x7faedc1efd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.065+0000 7faee3435640 1 --2- 172.21.15.52:0/1505315905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faedc0c8790 0x7faedc1efd30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faed0000c00 tx=0x7faed00046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.065+0000 7faee19d2640 1 -- 172.21.15.52:0/1505315905 reap_dead start 2024-04-25T13:17:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.065+0000 7faee3435640 1 -- 172.21.15.52:0/1505315905 shutdown_connections 2024-04-25T13:17:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.065+0000 7faee3435640 1 -- 172.21.15.52:0/1505315905 >> 172.21.15.52:0/1505315905 conn(0x7faedc068120 msgr2=0x7faedc1575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.065+0000 7faee3435640 1 -- 172.21.15.52:0/1505315905 shutdown_connections 2024-04-25T13:17:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.065+0000 7faee3435640 1 -- 172.21.15.52:0/1505315905 wait complete. 2024-04-25T13:17:18.076 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T13:17:18.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.178+0000 7ff993e23640 1 Processor -- start 2024-04-25T13:17:18.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.178+0000 7ff993e23640 1 -- start start 2024-04-25T13:17:18.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.178+0000 7ff993e23640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff98c0d08a0 0x7ff98c0d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.178+0000 7ff993e23640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff98c1558c0 con 0x7ff98c0b3c00 2024-04-25T13:17:18.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.178+0000 7ff993e23640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff98c0cb8c0 con 0x7ff98c1554e0 2024-04-25T13:17:18.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.178+0000 7ff993e23640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff98c0b4a80 con 0x7ff98c0d08a0 2024-04-25T13:17:18.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.179+0000 7ff9923c0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff98c0d08a0 0x7ff98c0d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.179+0000 7ff9913be640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff98c0b3c00 0x7ff98c0b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51178/0 (socket says 172.21.15.52:51178) 2024-04-25T13:17:18.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.179+0000 7ff9913be640 1 -- 172.21.15.52:0/1636133584 learned_addr learned my addr 172.21.15.52:0/1636133584 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:18.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.179+0000 7ff9923c0640 1 -- 172.21.15.52:0/1636133584 >> v1:172.21.15.102:6789/0 conn(0x7ff98c1554e0 legacy=0x7ff98c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.179+0000 7ff9923c0640 1 -- 172.21.15.52:0/1636133584 >> v1:172.21.15.52:6789/0 conn(0x7ff98c0b3c00 legacy=0x7ff98c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.179+0000 7ff9923c0640 1 -- 172.21.15.52:0/1636133584 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98c0cbba0 con 0x7ff98c0d08a0 2024-04-25T13:17:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.180+0000 7ff9923c0640 1 --2- 172.21.15.52:0/1636133584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff98c0d08a0 0x7ff98c0d0cd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff984009d90 tx=0x7ff98402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b996e46ddefbf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.180+0000 7ff990bbd640 1 -- 172.21.15.52:0/1636133584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984037070 con 0x7ff98c0d08a0 2024-04-25T13:17:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.180+0000 7ff990bbd640 1 -- 172.21.15.52:0/1636133584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff984007740 con 0x7ff98c0d08a0 2024-04-25T13:17:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.180+0000 7ff990bbd640 1 -- 172.21.15.52:0/1636133584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984007b10 con 0x7ff98c0d08a0 2024-04-25T13:17:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.180+0000 7ff993e23640 1 -- 172.21.15.52:0/1636133584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff98c0d08a0 msgr2=0x7ff98c0d0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.180+0000 7ff993e23640 1 --2- 172.21.15.52:0/1636133584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff98c0d08a0 0x7ff98c0d0cd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff984009d90 tx=0x7ff98402a780 comp rx=0 tx=0).stop 2024-04-25T13:17:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.180+0000 7ff993e23640 1 -- 172.21.15.52:0/1636133584 shutdown_connections 2024-04-25T13:17:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.180+0000 7ff993e23640 1 --2- 172.21.15.52:0/1636133584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff98c0d08a0 0x7ff98c0d0cd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.180+0000 7ff993e23640 1 -- 172.21.15.52:0/1636133584 >> 172.21.15.52:0/1636133584 conn(0x7ff98c074d50 msgr2=0x7ff98c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.181+0000 7ff993e23640 1 -- 172.21.15.52:0/1636133584 shutdown_connections 2024-04-25T13:17:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.181+0000 7ff993e23640 1 -- 172.21.15.52:0/1636133584 wait complete. 2024-04-25T13:17:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.182+0000 7ff993e23640 1 Processor -- start 2024-04-25T13:17:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.182+0000 7ff993e23640 1 -- start start 2024-04-25T13:17:18.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.182+0000 7ff993e23640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff98c0b3c00 0x7ff98c1f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.182+0000 7ff993e23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff98c0d08a0 0x7ff98c148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.182+0000 7ff993e23640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff98c1554e0 0x7ff98c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.182+0000 7ff993e23640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c0b4710 con 0x7ff98c0d08a0 2024-04-25T13:17:18.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.182+0000 7ff993e23640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c0b4430 con 0x7ff98c1554e0 2024-04-25T13:17:18.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.182+0000 7ff993e23640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff98c0b3580 con 0x7ff98c0b3c00 2024-04-25T13:17:18.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.182+0000 7ff9913be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff98c0d08a0 0x7ff98c148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.182+0000 7ff9913be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff98c0d08a0 0x7ff98c148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36190/0 (socket says 172.21.15.52:36190) 2024-04-25T13:17:18.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.182+0000 7ff9913be640 1 -- 172.21.15.52:0/3442839789 learned_addr learned my addr 172.21.15.52:0/3442839789 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:18.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff9923c0640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff98c1554e0 0x7ff98c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff991bbf640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff98c0b3c00 0x7ff98c1f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff9913be640 1 -- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff98c0b3c00 msgr2=0x7ff98c1f1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff9913be640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff98c0b3c00 0x7ff98c1f1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff9913be640 1 -- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff98c1554e0 msgr2=0x7ff98c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff9913be640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff98c1554e0 0x7ff98c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff9913be640 1 -- 172.21.15.52:0/3442839789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98c1494c0 con 0x7ff98c0d08a0 2024-04-25T13:17:18.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff9913be640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff98c0d08a0 0x7ff98c148f80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00c4b0 tx=0x7ff97c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff9827fc640 1 -- 172.21.15.52:0/3442839789 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c017070 con 0x7ff98c0d08a0 2024-04-25T13:17:18.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff9827fc640 1 -- 172.21.15.52:0/3442839789 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97c005ce0 con 0x7ff98c0d08a0 2024-04-25T13:17:18.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff9827fc640 1 -- 172.21.15.52:0/3442839789 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c007270 con 0x7ff98c0d08a0 2024-04-25T13:17:18.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff993e23640 1 -- 172.21.15.52:0/3442839789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98c1f1e40 con 0x7ff98c0d08a0 2024-04-25T13:17:18.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.183+0000 7ff993e23640 1 -- 172.21.15.52:0/3442839789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98c1f2400 con 0x7ff98c0d08a0 2024-04-25T13:17:18.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.184+0000 7ff993e23640 1 -- 172.21.15.52:0/3442839789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98c152aa0 con 0x7ff98c0d08a0 2024-04-25T13:17:18.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.185+0000 7ff9827fc640 1 -- 172.21.15.52:0/3442839789 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff97c01a070 con 0x7ff98c0d08a0 2024-04-25T13:17:18.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.185+0000 7ff9827fc640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff97006c8f0 0x7ff97006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.185+0000 7ff9827fc640 1 -- 172.21.15.52:0/3442839789 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ff97c08b0e0 con 0x7ff98c0d08a0 2024-04-25T13:17:18.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.185+0000 7ff991bbf640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff97006c8f0 0x7ff97006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.186+0000 7ff991bbf640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff97006c8f0 0x7ff97006edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff988001780 tx=0x7ff988009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.189+0000 7ff9827fc640 1 -- 172.21.15.52:0/3442839789 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff98c152aa0 con 0x7ff98c0d08a0 2024-04-25T13:17:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.375+0000 7ff993e23640 1 -- 172.21.15.52:0/3442839789 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff98c075ac0 con 0x7ff97006c8f0 2024-04-25T13:17:18.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.376+0000 7ff9827fc640 1 -- 172.21.15.52:0/3442839789 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff98c075ac0 con 0x7ff97006c8f0 2024-04-25T13:17:18.377 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T13:17:18.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.378+0000 7ff993e23640 1 -- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff97006c8f0 msgr2=0x7ff97006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.378+0000 7ff993e23640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff97006c8f0 0x7ff97006edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff988001780 tx=0x7ff988009040 comp rx=0 tx=0).stop 2024-04-25T13:17:18.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.378+0000 7ff993e23640 1 -- 172.21.15.52:0/3442839789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff98c0d08a0 msgr2=0x7ff98c148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.378+0000 7ff993e23640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff98c0d08a0 0x7ff98c148f80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00c4b0 tx=0x7ff97c00c970 comp rx=0 tx=0).stop 2024-04-25T13:17:18.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.378+0000 7ff993e23640 1 -- 172.21.15.52:0/3442839789 shutdown_connections 2024-04-25T13:17:18.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.378+0000 7ff993e23640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff97006c8f0 0x7ff97006edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.378+0000 7ff993e23640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff98c1554e0 0x7ff98c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.378+0000 7ff993e23640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff98c0d08a0 0x7ff98c148f80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.378+0000 7ff993e23640 1 --2- 172.21.15.52:0/3442839789 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff98c0b3c00 0x7ff98c1f1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.378+0000 7ff993e23640 1 -- 172.21.15.52:0/3442839789 >> 172.21.15.52:0/3442839789 conn(0x7ff98c074d50 msgr2=0x7ff98c150ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:18.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.378+0000 7ff993e23640 1 -- 172.21.15.52:0/3442839789 shutdown_connections 2024-04-25T13:17:18.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.378+0000 7ff993e23640 1 -- 172.21.15.52:0/3442839789 wait complete. 2024-04-25T13:17:18.390 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T13:17:18.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:18.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.497+0000 7f6b31ce8640 1 Processor -- start 2024-04-25T13:17:18.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.497+0000 7f6b31ce8640 1 -- start start 2024-04-25T13:17:18.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b31ce8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b2c0cc600 0x7f6b2c15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b31ce8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b2c0cd170 0x7f6b2c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b31ce8640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b2c0cbb60 con 0x7f6b2c1556d0 2024-04-25T13:17:18.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b31ce8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6b2c0b35b0 con 0x7f6b2c0cc600 2024-04-25T13:17:18.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b31ce8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2c0cdb20 con 0x7f6b2c0cd170 2024-04-25T13:17:18.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b2affd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b2c0cc600 0x7f6b2c15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b2b7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6b2c1556d0 0x7f6b2c0d0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51180/0 (socket says 172.21.15.52:51180) 2024-04-25T13:17:18.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b2b7fe640 1 -- 172.21.15.52:0/1351509494 learned_addr learned my addr 172.21.15.52:0/1351509494 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:18.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b2bfff640 1 --2- 172.21.15.52:0/1351509494 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b2c0cd170 0x7f6b2c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b2affd640 1 -- 172.21.15.52:0/1351509494 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b2c0cd170 msgr2=0x7f6b2c0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:18.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b2affd640 1 --2- 172.21.15.52:0/1351509494 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b2c0cd170 0x7f6b2c0cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b2affd640 1 -- 172.21.15.52:0/1351509494 >> v1:172.21.15.52:6789/0 conn(0x7f6b2c1556d0 legacy=0x7f6b2c0d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b2affd640 1 -- 172.21.15.52:0/1351509494 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c0b3990 con 0x7f6b2c0cc600 2024-04-25T13:17:18.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.498+0000 7f6b2a7fc640 1 -- 172.21.15.52:0/1351509494 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2227230323 0 0) 0x7f6b2c0cbb60 con 0x7f6b2c1556d0 2024-04-25T13:17:18.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.499+0000 7f6b2affd640 1 --2- 172.21.15.52:0/1351509494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c0cc600 0x7f6b2c15bbf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6b200097a0 tx=0x7f6b2002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddf6645d3ebbf4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.499+0000 7f6b2a7fc640 1 -- 172.21.15.52:0/1351509494 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b20037070 con 0x7f6b2c0cc600 2024-04-25T13:17:18.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.499+0000 7f6b2a7fc640 1 -- 172.21.15.52:0/1351509494 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b20032440 con 0x7f6b2c0cc600 2024-04-25T13:17:18.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.499+0000 7f6b2a7fc640 1 -- 172.21.15.52:0/1351509494 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b20032810 con 0x7f6b2c0cc600 2024-04-25T13:17:18.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.500+0000 7f6b31ce8640 1 -- 172.21.15.52:0/1351509494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c0cc600 msgr2=0x7f6b2c15bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.500+0000 7f6b31ce8640 1 --2- 172.21.15.52:0/1351509494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c0cc600 0x7f6b2c15bbf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6b200097a0 tx=0x7f6b2002a180 comp rx=0 tx=0).stop 2024-04-25T13:17:18.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.500+0000 7f6b31ce8640 1 -- 172.21.15.52:0/1351509494 shutdown_connections 2024-04-25T13:17:18.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.500+0000 7f6b31ce8640 1 --2- 172.21.15.52:0/1351509494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c0cc600 0x7f6b2c15bbf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.500+0000 7f6b31ce8640 1 --2- 172.21.15.52:0/1351509494 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b2c0cd170 0x7f6b2c0cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.500+0000 7f6b31ce8640 1 -- 172.21.15.52:0/1351509494 >> 172.21.15.52:0/1351509494 conn(0x7f6b2c068360 msgr2=0x7f6b2c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:18.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.500+0000 7f6b31ce8640 1 -- 172.21.15.52:0/1351509494 shutdown_connections 2024-04-25T13:17:18.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.500+0000 7f6b31ce8640 1 -- 172.21.15.52:0/1351509494 wait complete. 2024-04-25T13:17:18.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.501+0000 7f6b31ce8640 1 Processor -- start 2024-04-25T13:17:18.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.501+0000 7f6b31ce8640 1 -- start start 2024-04-25T13:17:18.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b31ce8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b2c0cc600 0x7f6b2c151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b31ce8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b2c0cd170 0x7f6b2c158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b31ce8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c1556d0 0x7f6b2c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b31ce8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c0b3c30 con 0x7f6b2c1556d0 2024-04-25T13:17:18.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b31ce8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c0cb880 con 0x7f6b2c0cd170 2024-04-25T13:17:18.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b31ce8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2c0d0fa0 con 0x7f6b2c0cc600 2024-04-25T13:17:18.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b2bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c1556d0 0x7f6b2c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b2bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c1556d0 0x7f6b2c0ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36214/0 (socket says 172.21.15.52:36214) 2024-04-25T13:17:18.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b2bfff640 1 -- 172.21.15.52:0/2138802169 learned_addr learned my addr 172.21.15.52:0/2138802169 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:18.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b2c0cc600 0x7f6b2c151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b2affd640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b2c0cd170 0x7f6b2c158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b2bfff640 1 -- 172.21.15.52:0/2138802169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b2c0cc600 msgr2=0x7f6b2c151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b2bfff640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b2c0cc600 0x7f6b2c151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b2bfff640 1 -- 172.21.15.52:0/2138802169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b2c0cd170 msgr2=0x7f6b2c158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b2bfff640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b2c0cd170 0x7f6b2c158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b2bfff640 1 -- 172.21.15.52:0/2138802169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c1f0e30 con 0x7f6b2c1556d0 2024-04-25T13:17:18.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b2bfff640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c1556d0 0x7f6b2c0ce7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400cda0 tx=0x7f6b2400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b13fff640 1 -- 172.21.15.52:0/2138802169 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24003b90 con 0x7f6b2c1556d0 2024-04-25T13:17:18.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b13fff640 1 -- 172.21.15.52:0/2138802169 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b24003d30 con 0x7f6b2c1556d0 2024-04-25T13:17:18.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b31ce8640 1 -- 172.21.15.52:0/2138802169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b2c0c6be0 con 0x7f6b2c1556d0 2024-04-25T13:17:18.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.502+0000 7f6b13fff640 1 -- 172.21.15.52:0/2138802169 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24004240 con 0x7f6b2c1556d0 2024-04-25T13:17:18.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.503+0000 7f6b31ce8640 1 -- 172.21.15.52:0/2138802169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b2c1f13d0 con 0x7f6b2c1556d0 2024-04-25T13:17:18.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.503+0000 7f6b31ce8640 1 -- 172.21.15.52:0/2138802169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b2c068f50 con 0x7f6b2c1556d0 2024-04-25T13:17:18.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.504+0000 7f6b13fff640 1 -- 172.21.15.52:0/2138802169 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b240043e0 con 0x7f6b2c1556d0 2024-04-25T13:17:18.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.504+0000 7f6b13fff640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6b1806c920 0x7f6b1806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.504+0000 7f6b13fff640 1 -- 172.21.15.52:0/2138802169 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f6b2408c930 con 0x7f6b2c1556d0 2024-04-25T13:17:18.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.504+0000 7f6b13fff640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] conn(0x7f6b180763c0 0x7f6b18078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.504+0000 7f6b13fff640 1 -- 172.21.15.52:0/2138802169 --> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b18078f30 con 0x7f6b180763c0 2024-04-25T13:17:18.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.504+0000 7f6b13fff640 1 -- 172.21.15.52:0/2138802169 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6b240912a0 con 0x7f6b2c1556d0 2024-04-25T13:17:18.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.505+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6b1806c920 0x7f6b1806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.505+0000 7f6b2affd640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] conn(0x7f6b180763c0 0x7f6b18078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.505+0000 7f6b2affd640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] conn(0x7f6b180763c0 0x7f6b18078860 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.505+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6b1806c920 0x7f6b1806ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c000f60 tx=0x7f6b1c007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.506+0000 7f6b13fff640 1 -- 172.21.15.52:0/2138802169 <== osd.1 v2:172.21.15.52:6800/760490446 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b18078f30 con 0x7f6b180763c0 2024-04-25T13:17:18.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.519+0000 7f6b31ce8640 1 -- 172.21.15.52:0/2138802169 --> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6b2c0cc130 con 0x7f6b180763c0 2024-04-25T13:17:18.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.519+0000 7f6b13fff640 1 -- 172.21.15.52:0/2138802169 <== osd.1 v2:172.21.15.52:6800/760490446 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6b2c0cc130 con 0x7f6b180763c0 2024-04-25T13:17:18.520 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:18.520 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:18.520 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:18.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.519+0000 7f6b31ce8640 1 -- 172.21.15.52:0/2138802169 >> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] conn(0x7f6b180763c0 msgr2=0x7f6b18078860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.519+0000 7f6b31ce8640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.52:6800/760490446,v1:172.21.15.52:6801/760490446] conn(0x7f6b180763c0 0x7f6b18078860 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.520+0000 7f6b31ce8640 1 -- 172.21.15.52:0/2138802169 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6b1806c920 msgr2=0x7f6b1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.520+0000 7f6b31ce8640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6b1806c920 0x7f6b1806ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c000f60 tx=0x7f6b1c007d50 comp rx=0 tx=0).stop 2024-04-25T13:17:18.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.520+0000 7f6b31ce8640 1 -- 172.21.15.52:0/2138802169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c1556d0 msgr2=0x7f6b2c0ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.520+0000 7f6b31ce8640 1 --2- 172.21.15.52:0/2138802169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c1556d0 0x7f6b2c0ce7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400cda0 tx=0x7f6b2400a660 comp rx=0 tx=0).stop 2024-04-25T13:17:18.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.520+0000 7f6b2bfff640 1 -- 172.21.15.52:0/2138802169 reap_dead start 2024-04-25T13:17:18.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.520+0000 7f6b31ce8640 1 -- 172.21.15.52:0/2138802169 shutdown_connections 2024-04-25T13:17:18.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.520+0000 7f6b31ce8640 1 -- 172.21.15.52:0/2138802169 >> 172.21.15.52:0/2138802169 conn(0x7f6b2c068360 msgr2=0x7f6b2c0b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:18.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.520+0000 7f6b31ce8640 1 -- 172.21.15.52:0/2138802169 shutdown_connections 2024-04-25T13:17:18.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.520+0000 7f6b31ce8640 1 -- 172.21.15.52:0/2138802169 wait complete. 2024-04-25T13:17:18.530 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T13:17:18.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.632+0000 7f7591af6640 1 Processor -- start 2024-04-25T13:17:18.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.632+0000 7f7591af6640 1 -- start start 2024-04-25T13:17:18.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.632+0000 7f7591af6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f758c0b2b50 0x7f758c072390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.632+0000 7f7591af6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758c159de0 con 0x7f758c0c90f0 2024-04-25T13:17:18.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.632+0000 7f7591af6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758c071a50 con 0x7f758c074390 2024-04-25T13:17:18.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.632+0000 7f7591af6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f758c0b2f30 con 0x7f758c0b2b50 2024-04-25T13:17:18.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.633+0000 7f758bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f758c0c90f0 0x7f758c1638a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51182/0 (socket says 172.21.15.52:51182) 2024-04-25T13:17:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.633+0000 7f758bfff640 1 -- 172.21.15.52:0/2539656693 learned_addr learned my addr 172.21.15.52:0/2539656693 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.633+0000 7f758b7fe640 1 --2- 172.21.15.52:0/2539656693 >> v2:172.21.15.102:3300/0 conn(0x7f758c0b2b50 0x7f758c072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.633+0000 7f758affd640 1 -- 172.21.15.52:0/2539656693 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1985285138 0 0) 0x7f758c159de0 con 0x7f758c0c90f0 2024-04-25T13:17:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.633+0000 7f758affd640 1 -- 172.21.15.52:0/2539656693 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7578003520 con 0x7f758c0c90f0 2024-04-25T13:17:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.633+0000 7f758b7fe640 1 -- 172.21.15.52:0/2539656693 >> v1:172.21.15.102:6789/0 conn(0x7f758c074390 legacy=0x7f758c0c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.633+0000 7f758b7fe640 1 -- 172.21.15.52:0/2539656693 >> v1:172.21.15.52:6789/0 conn(0x7f758c0c90f0 legacy=0x7f758c1638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.633+0000 7f758b7fe640 1 -- 172.21.15.52:0/2539656693 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758c071d30 con 0x7f758c0b2b50 2024-04-25T13:17:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.634+0000 7f758b7fe640 1 --2- 172.21.15.52:0/2539656693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f758c0b2b50 0x7f758c072390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f757c0097a0 tx=0x7f757c02a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1289a3214a43a0da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.634+0000 7f758affd640 1 -- 172.21.15.52:0/2539656693 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c037070 con 0x7f758c0b2b50 2024-04-25T13:17:18.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.634+0000 7f758affd640 1 -- 172.21.15.52:0/2539656693 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757c032640 con 0x7f758c0b2b50 2024-04-25T13:17:18.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.634+0000 7f758affd640 1 -- 172.21.15.52:0/2539656693 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c032a10 con 0x7f758c0b2b50 2024-04-25T13:17:18.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.634+0000 7f7591af6640 1 -- 172.21.15.52:0/2539656693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f758c0b2b50 msgr2=0x7f758c072390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.634+0000 7f7591af6640 1 --2- 172.21.15.52:0/2539656693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f758c0b2b50 0x7f758c072390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f757c0097a0 tx=0x7f757c02a2c0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.634+0000 7f7591af6640 1 -- 172.21.15.52:0/2539656693 shutdown_connections 2024-04-25T13:17:18.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.634+0000 7f7591af6640 1 --2- 172.21.15.52:0/2539656693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f758c0b2b50 0x7f758c072390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.634+0000 7f7591af6640 1 -- 172.21.15.52:0/2539656693 >> 172.21.15.52:0/2539656693 conn(0x7f758c0c9a70 msgr2=0x7f758c0c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:18.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.635+0000 7f7591af6640 1 -- 172.21.15.52:0/2539656693 shutdown_connections 2024-04-25T13:17:18.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.635+0000 7f7591af6640 1 -- 172.21.15.52:0/2539656693 wait complete. 2024-04-25T13:17:18.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.636+0000 7f7591af6640 1 Processor -- start 2024-04-25T13:17:18.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.636+0000 7f7591af6640 1 -- start start 2024-04-25T13:17:18.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.636+0000 7f7591af6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f758c074390 0x7f758c1e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.636+0000 7f7591af6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f758c0b2b50 0x7f758c157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.636+0000 7f7591af6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f758c0c90f0 0x7f758c1f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.636+0000 7f7591af6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f758c0c84c0 con 0x7f758c0b2b50 2024-04-25T13:17:18.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.636+0000 7f7591af6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f758c0c8270 con 0x7f758c074390 2024-04-25T13:17:18.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.636+0000 7f7591af6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f758c0c7970 con 0x7f758c0c90f0 2024-04-25T13:17:18.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.636+0000 7f7583fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f758c0b2b50 0x7f758c157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.636+0000 7f7583fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f758c0b2b50 0x7f758c157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36228/0 (socket says 172.21.15.52:36228) 2024-04-25T13:17:18.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.636+0000 7f7583fff640 1 -- 172.21.15.52:0/3103023159 learned_addr learned my addr 172.21.15.52:0/3103023159 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:18.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f758b7fe640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f758c074390 0x7f758c1e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f758bfff640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f758c0c90f0 0x7f758c1f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f7583fff640 1 -- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f758c0c90f0 msgr2=0x7f758c1f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f7583fff640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f758c0c90f0 0x7f758c1f2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f7583fff640 1 -- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f758c074390 msgr2=0x7f758c1e4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f7583fff640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f758c074390 0x7f758c1e4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f7583fff640 1 -- 172.21.15.52:0/3103023159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758c1e5250 con 0x7f758c0b2b50 2024-04-25T13:17:18.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f7583fff640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f758c0b2b50 0x7f758c157ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f757400c440 tx=0x7f7574001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f7588ff9640 1 -- 172.21.15.52:0/3103023159 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75740052d0 con 0x7f758c0b2b50 2024-04-25T13:17:18.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f7588ff9640 1 -- 172.21.15.52:0/3103023159 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7574005470 con 0x7f758c0b2b50 2024-04-25T13:17:18.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f7588ff9640 1 -- 172.21.15.52:0/3103023159 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574007260 con 0x7f758c0b2b50 2024-04-25T13:17:18.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f7591af6640 1 -- 172.21.15.52:0/3103023159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758c1562b0 con 0x7f758c0b2b50 2024-04-25T13:17:18.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.637+0000 7f7591af6640 1 -- 172.21.15.52:0/3103023159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f758c156550 con 0x7f758c0b2b50 2024-04-25T13:17:18.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.638+0000 7f7591af6640 1 -- 172.21.15.52:0/3103023159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f758c069520 con 0x7f758c0b2b50 2024-04-25T13:17:18.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.639+0000 7f7588ff9640 1 -- 172.21.15.52:0/3103023159 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7574007400 con 0x7f758c0b2b50 2024-04-25T13:17:18.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.639+0000 7f7588ff9640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f756c06c8f0 0x7f756c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.639+0000 7f7588ff9640 1 -- 172.21.15.52:0/3103023159 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f757408b4a0 con 0x7f758c0b2b50 2024-04-25T13:17:18.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.639+0000 7f758b7fe640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f756c06c8f0 0x7f756c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.640+0000 7f758b7fe640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f756c06c8f0 0x7f756c06edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f757c034000 tx=0x7f757c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.644+0000 7f7588ff9640 1 -- 172.21.15.52:0/3103023159 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f758c069520 con 0x7f758c0b2b50 2024-04-25T13:17:18.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.829+0000 7f7591af6640 1 -- 172.21.15.52:0/3103023159 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f758c068e40 con 0x7f756c06c8f0 2024-04-25T13:17:18.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.830+0000 7f7588ff9640 1 -- 172.21.15.52:0/3103023159 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f758c068e40 con 0x7f756c06c8f0 2024-04-25T13:17:18.830 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T13:17:18.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.832+0000 7f7591af6640 1 -- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f756c06c8f0 msgr2=0x7f756c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.832+0000 7f7591af6640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f756c06c8f0 0x7f756c06edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f757c034000 tx=0x7f757c02e000 comp rx=0 tx=0).stop 2024-04-25T13:17:18.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.832+0000 7f7591af6640 1 -- 172.21.15.52:0/3103023159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f758c0b2b50 msgr2=0x7f758c157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.832+0000 7f7591af6640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f758c0b2b50 0x7f758c157ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f757400c440 tx=0x7f7574001e70 comp rx=0 tx=0).stop 2024-04-25T13:17:18.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.832+0000 7f7591af6640 1 -- 172.21.15.52:0/3103023159 shutdown_connections 2024-04-25T13:17:18.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.832+0000 7f7591af6640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f756c06c8f0 0x7f756c06edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.832+0000 7f7591af6640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f758c0c90f0 0x7f758c1f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.832+0000 7f7591af6640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f758c0b2b50 0x7f758c157ed0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.832+0000 7f7591af6640 1 --2- 172.21.15.52:0/3103023159 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f758c074390 0x7f758c1e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.832+0000 7f7591af6640 1 -- 172.21.15.52:0/3103023159 >> 172.21.15.52:0/3103023159 conn(0x7f758c0c9a70 msgr2=0x7f758c0cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:18.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.832+0000 7f7591af6640 1 -- 172.21.15.52:0/3103023159 shutdown_connections 2024-04-25T13:17:18.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.832+0000 7f7591af6640 1 -- 172.21.15.52:0/3103023159 wait complete. 2024-04-25T13:17:18.843 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T13:17:18.843 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:18.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.947+0000 7f6ed6544640 1 Processor -- start 2024-04-25T13:17:18.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.947+0000 7f6ed6544640 1 -- start start 2024-04-25T13:17:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.948+0000 7f6ed6544640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ed0073620 0x7f6ed00cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.948+0000 7f6ed6544640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed0073a00 0x7f6ed0154db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.948+0000 7f6ed6544640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6ed00cbd20 0x7f6ed01552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.948+0000 7f6ed6544640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed015e610 con 0x7f6ed0073620 2024-04-25T13:17:18.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.948+0000 7f6ed6544640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed015e8f0 con 0x7f6ed00cbd20 2024-04-25T13:17:18.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.948+0000 7f6ed6544640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed015ebd0 con 0x7f6ed0073a00 2024-04-25T13:17:18.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.948+0000 7f6ecffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ed0073620 0x7f6ed00cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.948+0000 7f6ecffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ed0073620 0x7f6ed00cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39452/0 (socket says 172.21.15.52:39452) 2024-04-25T13:17:18.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.948+0000 7f6ecffff640 1 -- 172.21.15.52:0/4108919435 learned_addr learned my addr 172.21.15.52:0/4108919435 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:18.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.949+0000 7f6ed4ae1640 1 --2- 172.21.15.52:0/4108919435 >> v2:172.21.15.102:3300/0 conn(0x7f6ed00cbd20 0x7f6ed01552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.949+0000 7f6ecffff640 1 -- 172.21.15.52:0/4108919435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed0073a00 msgr2=0x7f6ed0154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:18.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.949+0000 7f6ecf7fe640 1 --2- 172.21.15.52:0/4108919435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed0073a00 0x7f6ed0154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.949+0000 7f6ecffff640 1 --2- 172.21.15.52:0/4108919435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed0073a00 0x7f6ed0154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.949+0000 7f6ecffff640 1 -- 172.21.15.52:0/4108919435 >> v2:172.21.15.102:3300/0 conn(0x7f6ed00cbd20 msgr2=0x7f6ed01552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:18.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.949+0000 7f6ecffff640 1 --2- 172.21.15.52:0/4108919435 >> v2:172.21.15.102:3300/0 conn(0x7f6ed00cbd20 0x7f6ed01552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.949+0000 7f6ecffff640 1 -- 172.21.15.52:0/4108919435 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed015eeb0 con 0x7f6ed0073620 2024-04-25T13:17:18.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.949+0000 7f6ed4ae1640 1 --2- 172.21.15.52:0/4108919435 >> v2:172.21.15.102:3300/0 conn(0x7f6ed00cbd20 0x7f6ed01552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.949+0000 7f6ecf7fe640 1 --2- 172.21.15.52:0/4108919435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed0073a00 0x7f6ed0154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.949+0000 7f6ecffff640 1 --2- 172.21.15.52:0/4108919435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0073620 0x7f6ed00cb550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6ed006dae0 tx=0x7f6ec002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42cd939401f2afe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.950+0000 7f6eceffd640 1 -- 172.21.15.52:0/4108919435 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0037070 con 0x7f6ed0073620 2024-04-25T13:17:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.950+0000 7f6eceffd640 1 -- 172.21.15.52:0/4108919435 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec0032440 con 0x7f6ed0073620 2024-04-25T13:17:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.950+0000 7f6eceffd640 1 -- 172.21.15.52:0/4108919435 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0032810 con 0x7f6ed0073620 2024-04-25T13:17:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.950+0000 7f6ed6544640 1 -- 172.21.15.52:0/4108919435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0073620 msgr2=0x7f6ed00cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.950+0000 7f6ed6544640 1 --2- 172.21.15.52:0/4108919435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0073620 0x7f6ed00cb550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6ed006dae0 tx=0x7f6ec002a1e0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.950+0000 7f6ed6544640 1 -- 172.21.15.52:0/4108919435 shutdown_connections 2024-04-25T13:17:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.950+0000 7f6ed6544640 1 --2- 172.21.15.52:0/4108919435 >> v2:172.21.15.102:3300/0 conn(0x7f6ed00cbd20 0x7f6ed01552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.950+0000 7f6ed6544640 1 --2- 172.21.15.52:0/4108919435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed0073a00 0x7f6ed0154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.950+0000 7f6ed6544640 1 --2- 172.21.15.52:0/4108919435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed0073620 0x7f6ed00cb550 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.950+0000 7f6ed6544640 1 -- 172.21.15.52:0/4108919435 >> 172.21.15.52:0/4108919435 conn(0x7f6ed0068120 msgr2=0x7f6ed0070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.950+0000 7f6ed6544640 1 -- 172.21.15.52:0/4108919435 shutdown_connections 2024-04-25T13:17:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.950+0000 7f6ed6544640 1 -- 172.21.15.52:0/4108919435 wait complete. 2024-04-25T13:17:18.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.951+0000 7f6ed6544640 1 Processor -- start 2024-04-25T13:17:18.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.951+0000 7f6ed6544640 1 -- start start 2024-04-25T13:17:18.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.952+0000 7f6ed6544640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ed0073620 0x7f6ed0156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.952+0000 7f6ed6544640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed0073a00 0x7f6ed01e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.952+0000 7f6ed6544640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed00cbd20 0x7f6ed01f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.952+0000 7f6ed6544640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed00c90c0 con 0x7f6ed00cbd20 2024-04-25T13:17:18.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.952+0000 7f6ed6544640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed00cba90 con 0x7f6ed0073620 2024-04-25T13:17:18.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.952+0000 7f6ed6544640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed00c9240 con 0x7f6ed0073a00 2024-04-25T13:17:18.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.952+0000 7f6ed4ae1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed00cbd20 0x7f6ed01f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.952+0000 7f6ecffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ed0073620 0x7f6ed0156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.952+0000 7f6ed4ae1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed00cbd20 0x7f6ed01f4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39456/0 (socket says 172.21.15.52:39456) 2024-04-25T13:17:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.952+0000 7f6ed4ae1640 1 -- 172.21.15.52:0/2721659862 learned_addr learned my addr 172.21.15.52:0/2721659862 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.952+0000 7f6ecf7fe640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed0073a00 0x7f6ed01e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.953+0000 7f6ed4ae1640 1 -- 172.21.15.52:0/2721659862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed0073a00 msgr2=0x7f6ed01e7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.953+0000 7f6ed4ae1640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed0073a00 0x7f6ed01e7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.953+0000 7f6ed4ae1640 1 -- 172.21.15.52:0/2721659862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ed0073620 msgr2=0x7f6ed0156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.953+0000 7f6ed4ae1640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ed0073620 0x7f6ed0156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.953+0000 7f6ed4ae1640 1 -- 172.21.15.52:0/2721659862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed00cd8d0 con 0x7f6ed00cbd20 2024-04-25T13:17:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.953+0000 7f6ed4ae1640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed00cbd20 0x7f6ed01f4340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800cef0 tx=0x7f6ec800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.953+0000 7f6eccff9640 1 -- 172.21.15.52:0/2721659862 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec801a070 con 0x7f6ed00cbd20 2024-04-25T13:17:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.953+0000 7f6eccff9640 1 -- 172.21.15.52:0/2721659862 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec800d860 con 0x7f6ed00cbd20 2024-04-25T13:17:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.953+0000 7f6ed6544640 1 -- 172.21.15.52:0/2721659862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed0156b90 con 0x7f6ed00cbd20 2024-04-25T13:17:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.953+0000 7f6eccff9640 1 -- 172.21.15.52:0/2721659862 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec800dc50 con 0x7f6ed00cbd20 2024-04-25T13:17:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.953+0000 7f6ed6544640 1 -- 172.21.15.52:0/2721659862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed00cde70 con 0x7f6ed00cbd20 2024-04-25T13:17:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.954+0000 7f6ed6544640 1 -- 172.21.15.52:0/2721659862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ed00cb550 con 0x7f6ed00cbd20 2024-04-25T13:17:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.954+0000 7f6eccff9640 1 -- 172.21.15.52:0/2721659862 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ec801d070 con 0x7f6ed00cbd20 2024-04-25T13:17:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.955+0000 7f6eccff9640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6ebc06c8f0 0x7f6ebc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.955+0000 7f6eccff9640 1 -- 172.21.15.52:0/2721659862 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f6ec808c7c0 con 0x7f6ed00cbd20 2024-04-25T13:17:18.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.955+0000 7f6eccff9640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] conn(0x7f6ebc076380 0x7f6ebc078820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:18.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.955+0000 7f6eccff9640 1 -- 172.21.15.52:0/2721659862 --> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ebc078ef0 con 0x7f6ebc076380 2024-04-25T13:17:18.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.955+0000 7f6eccff9640 1 -- 172.21.15.52:0/2721659862 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6ec80912c0 con 0x7f6ed00cbd20 2024-04-25T13:17:18.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.955+0000 7f6ecffff640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6ebc06c8f0 0x7f6ebc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.955+0000 7f6ecf7fe640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] conn(0x7f6ebc076380 0x7f6ebc078820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:18.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.955+0000 7f6ecf7fe640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] conn(0x7f6ebc076380 0x7f6ebc078820 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.956+0000 7f6ecffff640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6ebc06c8f0 0x7f6ebc06edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0034000 tx=0x7f6ec002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:18.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.956+0000 7f6eccff9640 1 -- 172.21.15.52:0/2721659862 <== osd.2 v2:172.21.15.52:6808/3392002317 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ebc078ef0 con 0x7f6ebc076380 2024-04-25T13:17:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.969+0000 7f6ed6544640 1 -- 172.21.15.52:0/2721659862 --> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6ed0071b80 con 0x7f6ebc076380 2024-04-25T13:17:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.970+0000 7f6eccff9640 1 -- 172.21.15.52:0/2721659862 <== osd.2 v2:172.21.15.52:6808/3392002317 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6ed0071b80 con 0x7f6ebc076380 2024-04-25T13:17:18.970 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:18.970 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:18.970 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:18.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.970+0000 7f6ed6544640 1 -- 172.21.15.52:0/2721659862 >> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] conn(0x7f6ebc076380 msgr2=0x7f6ebc078820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.970+0000 7f6ed6544640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.52:6808/3392002317,v1:172.21.15.52:6809/3392002317] conn(0x7f6ebc076380 0x7f6ebc078820 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.970+0000 7f6ed6544640 1 -- 172.21.15.52:0/2721659862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6ebc06c8f0 msgr2=0x7f6ebc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.970+0000 7f6ed6544640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f6ebc06c8f0 0x7f6ebc06edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0034000 tx=0x7f6ec002e000 comp rx=0 tx=0).stop 2024-04-25T13:17:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.970+0000 7f6ed6544640 1 -- 172.21.15.52:0/2721659862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed00cbd20 msgr2=0x7f6ed01f4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.970+0000 7f6ed6544640 1 --2- 172.21.15.52:0/2721659862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed00cbd20 0x7f6ed01f4340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800cef0 tx=0x7f6ec800a710 comp rx=0 tx=0).stop 2024-04-25T13:17:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.970+0000 7f6ed4ae1640 1 -- 172.21.15.52:0/2721659862 reap_dead start 2024-04-25T13:17:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.970+0000 7f6ed6544640 1 -- 172.21.15.52:0/2721659862 shutdown_connections 2024-04-25T13:17:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.970+0000 7f6ed6544640 1 -- 172.21.15.52:0/2721659862 >> 172.21.15.52:0/2721659862 conn(0x7f6ed0068120 msgr2=0x7f6ed00ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.970+0000 7f6ed6544640 1 -- 172.21.15.52:0/2721659862 shutdown_connections 2024-04-25T13:17:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:18.970+0000 7f6ed6544640 1 -- 172.21.15.52:0/2721659862 wait complete. 2024-04-25T13:17:18.981 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T13:17:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.083+0000 7fe49f805640 1 Processor -- start 2024-04-25T13:17:19.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.083+0000 7fe49f805640 1 -- start start 2024-04-25T13:17:19.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49f805640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe498144270 0x7fe49815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49f805640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4980c9290 0x7fe498075460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49f805640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe498144650 con 0x7fe4980c8e70 2024-04-25T13:17:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49f805640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe49815f4e0 con 0x7fe498144270 2024-04-25T13:17:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49f805640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe4980ce080 con 0x7fe4980c9290 2024-04-25T13:17:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49d5a1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe498144270 0x7fe49815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49d5a1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe498144270 0x7fe49815efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39470/0 (socket says 172.21.15.52:39470) 2024-04-25T13:17:19.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49d5a1640 1 -- 172.21.15.52:0/4091601694 learned_addr learned my addr 172.21.15.52:0/4091601694 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:19.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49dda2640 1 --2- 172.21.15.52:0/4091601694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4980c9290 0x7fe498075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49d5a1640 1 -- 172.21.15.52:0/4091601694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4980c9290 msgr2=0x7fe498075460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:19.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49d5a1640 1 --2- 172.21.15.52:0/4091601694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4980c9290 0x7fe498075460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49d5a1640 1 -- 172.21.15.52:0/4091601694 >> v1:172.21.15.102:6789/0 conn(0x7fe4980c8e70 legacy=0x7fe498074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:19.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.084+0000 7fe49d5a1640 1 -- 172.21.15.52:0/4091601694 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49815b0b0 con 0x7fe498144270 2024-04-25T13:17:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.085+0000 7fe49d5a1640 1 --2- 172.21.15.52:0/4091601694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498144270 0x7fe49815efa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe494009870 tx=0x7fe49402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ce7d0643ad8f12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.085+0000 7fe48ffff640 1 -- 172.21.15.52:0/4091601694 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494037070 con 0x7fe498144270 2024-04-25T13:17:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.085+0000 7fe48ffff640 1 -- 172.21.15.52:0/4091601694 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe494032440 con 0x7fe498144270 2024-04-25T13:17:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.085+0000 7fe48ffff640 1 -- 172.21.15.52:0/4091601694 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494032810 con 0x7fe498144270 2024-04-25T13:17:19.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.086+0000 7fe49f805640 1 -- 172.21.15.52:0/4091601694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498144270 msgr2=0x7fe49815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.086+0000 7fe49f805640 1 --2- 172.21.15.52:0/4091601694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498144270 0x7fe49815efa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe494009870 tx=0x7fe49402a2a0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.086+0000 7fe49f805640 1 -- 172.21.15.52:0/4091601694 shutdown_connections 2024-04-25T13:17:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.086+0000 7fe49f805640 1 --2- 172.21.15.52:0/4091601694 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4980c9290 0x7fe498075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.086+0000 7fe49f805640 1 --2- 172.21.15.52:0/4091601694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498144270 0x7fe49815efa0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.086+0000 7fe49f805640 1 -- 172.21.15.52:0/4091601694 >> 172.21.15.52:0/4091601694 conn(0x7fe49806b920 msgr2=0x7fe49806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.086+0000 7fe49f805640 1 -- 172.21.15.52:0/4091601694 shutdown_connections 2024-04-25T13:17:19.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.086+0000 7fe49f805640 1 -- 172.21.15.52:0/4091601694 wait complete. 2024-04-25T13:17:19.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.087+0000 7fe49f805640 1 Processor -- start 2024-04-25T13:17:19.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.087+0000 7fe49f805640 1 -- start start 2024-04-25T13:17:19.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49f805640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4980c8e70 0x7fe4981e4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49f805640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4980c9290 0x7fe4981e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49f805640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498144270 0x7fe4981f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49f805640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe49815b8e0 con 0x7fe498144270 2024-04-25T13:17:19.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49f805640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe49815b600 con 0x7fe4980c8e70 2024-04-25T13:17:19.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49f805640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe4980ce360 con 0x7fe4980c9290 2024-04-25T13:17:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49dda2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498144270 0x7fe4981f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49dda2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498144270 0x7fe4981f5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39486/0 (socket says 172.21.15.52:39486) 2024-04-25T13:17:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49dda2640 1 -- 172.21.15.52:0/2574679564 learned_addr learned my addr 172.21.15.52:0/2574679564 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49d5a1640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4980c8e70 0x7fe4981e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49cda0640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4980c9290 0x7fe4981e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49dda2640 1 -- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4980c9290 msgr2=0x7fe4981e4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49dda2640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4980c9290 0x7fe4981e4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49dda2640 1 -- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4980c8e70 msgr2=0x7fe4981e4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49dda2640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4980c8e70 0x7fe4981e4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49dda2640 1 -- 172.21.15.52:0/2574679564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4980cd6e0 con 0x7fe498144270 2024-04-25T13:17:19.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.088+0000 7fe49dda2640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498144270 0x7fe4981f5060 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe49000cd90 tx=0x7fe49000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.089+0000 7fe48dffb640 1 -- 172.21.15.52:0/2574679564 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490003b90 con 0x7fe498144270 2024-04-25T13:17:19.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.089+0000 7fe48dffb640 1 -- 172.21.15.52:0/2574679564 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe490003d50 con 0x7fe498144270 2024-04-25T13:17:19.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.089+0000 7fe49f805640 1 -- 172.21.15.52:0/2574679564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4981f1280 con 0x7fe498144270 2024-04-25T13:17:19.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.089+0000 7fe48dffb640 1 -- 172.21.15.52:0/2574679564 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490004260 con 0x7fe498144270 2024-04-25T13:17:19.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.089+0000 7fe49f805640 1 -- 172.21.15.52:0/2574679564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4980cd400 con 0x7fe498144270 2024-04-25T13:17:19.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.090+0000 7fe49f805640 1 -- 172.21.15.52:0/2574679564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe498159750 con 0x7fe498144270 2024-04-25T13:17:19.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.090+0000 7fe48dffb640 1 -- 172.21.15.52:0/2574679564 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe490004400 con 0x7fe498144270 2024-04-25T13:17:19.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.091+0000 7fe48dffb640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe47c06c8f0 0x7fe47c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.091+0000 7fe48dffb640 1 -- 172.21.15.52:0/2574679564 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fe49008c900 con 0x7fe498144270 2024-04-25T13:17:19.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.091+0000 7fe49d5a1640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe47c06c8f0 0x7fe47c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.091+0000 7fe49d5a1640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe47c06c8f0 0x7fe47c06edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe494034000 tx=0x7fe49402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.095+0000 7fe48dffb640 1 -- 172.21.15.52:0/2574679564 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe498159750 con 0x7fe498144270 2024-04-25T13:17:19.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.281+0000 7fe49f805640 1 -- 172.21.15.52:0/2574679564 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe498068e40 con 0x7fe47c06c8f0 2024-04-25T13:17:19.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.281+0000 7fe48dffb640 1 -- 172.21.15.52:0/2574679564 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe498068e40 con 0x7fe47c06c8f0 2024-04-25T13:17:19.282 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T13:17:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.283+0000 7fe49f805640 1 -- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe47c06c8f0 msgr2=0x7fe47c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.283+0000 7fe49f805640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe47c06c8f0 0x7fe47c06edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe494034000 tx=0x7fe49402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.283+0000 7fe49f805640 1 -- 172.21.15.52:0/2574679564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498144270 msgr2=0x7fe4981f5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.283+0000 7fe49f805640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498144270 0x7fe4981f5060 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe49000cd90 tx=0x7fe49000a660 comp rx=0 tx=0).stop 2024-04-25T13:17:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.283+0000 7fe49f805640 1 -- 172.21.15.52:0/2574679564 shutdown_connections 2024-04-25T13:17:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.283+0000 7fe49f805640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fe47c06c8f0 0x7fe47c06edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.283+0000 7fe49f805640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4980c9290 0x7fe4981e4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.283+0000 7fe49f805640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498144270 0x7fe4981f5060 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.283+0000 7fe49f805640 1 --2- 172.21.15.52:0/2574679564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4980c8e70 0x7fe4981e4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.283+0000 7fe49f805640 1 -- 172.21.15.52:0/2574679564 >> 172.21.15.52:0/2574679564 conn(0x7fe49806b920 msgr2=0x7fe498072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.283+0000 7fe49f805640 1 -- 172.21.15.52:0/2574679564 shutdown_connections 2024-04-25T13:17:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.284+0000 7fe49f805640 1 -- 172.21.15.52:0/2574679564 wait complete. 2024-04-25T13:17:19.295 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T13:17:19.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:19.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.400+0000 7f332ebed640 1 Processor -- start 2024-04-25T13:17:19.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.400+0000 7f332ebed640 1 -- start start 2024-04-25T13:17:19.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f332ebed640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f33280c5d30 0x7f33280c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f332ebed640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f33280cb590 0x7f33280c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f332ebed640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f332815bea0 con 0x7f33281553b0 2024-04-25T13:17:19.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f332ebed640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f33280c6230 con 0x7f33280cb590 2024-04-25T13:17:19.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f332ebed640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f33280c7420 con 0x7f33280c5d30 2024-04-25T13:17:19.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f332d18a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f33280cb590 0x7f33280c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f332d18a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f33280cb590 0x7f33280c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39502/0 (socket says 172.21.15.52:39502) 2024-04-25T13:17:19.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f332d18a640 1 -- 172.21.15.52:0/307478 learned_addr learned my addr 172.21.15.52:0/307478 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:19.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f3327fff640 1 --2- 172.21.15.52:0/307478 >> v2:172.21.15.102:3300/0 conn(0x7f33280c5d30 0x7f33280c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f332d18a640 1 -- 172.21.15.52:0/307478 >> v2:172.21.15.102:3300/0 conn(0x7f33280c5d30 msgr2=0x7f33280c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:19.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f332d18a640 1 --2- 172.21.15.52:0/307478 >> v2:172.21.15.102:3300/0 conn(0x7f33280c5d30 0x7f33280c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f332d18a640 1 -- 172.21.15.52:0/307478 >> v1:172.21.15.102:6789/0 conn(0x7f33281553b0 legacy=0x7f33280d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.401+0000 7f332d18a640 1 -- 172.21.15.52:0/307478 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33280cc710 con 0x7f33280cb590 2024-04-25T13:17:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.402+0000 7f332d18a640 1 --2- 172.21.15.52:0/307478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33280cb590 0x7f33280c6ee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f33280c63b0 tx=0x7f332002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d34ccb3d6317e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.402+0000 7f33277fe640 1 -- 172.21.15.52:0/307478 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320036070 con 0x7f33280cb590 2024-04-25T13:17:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.402+0000 7f33277fe640 1 -- 172.21.15.52:0/307478 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3320031600 con 0x7f33280cb590 2024-04-25T13:17:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.402+0000 7f33277fe640 1 -- 172.21.15.52:0/307478 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200319d0 con 0x7f33280cb590 2024-04-25T13:17:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.403+0000 7f332ebed640 1 -- 172.21.15.52:0/307478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33280cb590 msgr2=0x7f33280c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.403+0000 7f332ebed640 1 --2- 172.21.15.52:0/307478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33280cb590 0x7f33280c6ee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f33280c63b0 tx=0x7f332002a730 comp rx=0 tx=0).stop 2024-04-25T13:17:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.403+0000 7f332ebed640 1 -- 172.21.15.52:0/307478 shutdown_connections 2024-04-25T13:17:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.403+0000 7f332ebed640 1 --2- 172.21.15.52:0/307478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33280cb590 0x7f33280c6ee0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.403+0000 7f332ebed640 1 --2- 172.21.15.52:0/307478 >> v2:172.21.15.102:3300/0 conn(0x7f33280c5d30 0x7f33280c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.403+0000 7f332ebed640 1 -- 172.21.15.52:0/307478 >> 172.21.15.52:0/307478 conn(0x7f3328074d50 msgr2=0x7f3328075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.403+0000 7f332ebed640 1 -- 172.21.15.52:0/307478 shutdown_connections 2024-04-25T13:17:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.403+0000 7f332ebed640 1 -- 172.21.15.52:0/307478 wait complete. 2024-04-25T13:17:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.404+0000 7f332ebed640 1 Processor -- start 2024-04-25T13:17:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.404+0000 7f332ebed640 1 -- start start 2024-04-25T13:17:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f332ebed640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33280c5d30 0x7f33281f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f332ebed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33280cb590 0x7f33280b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f332ebed640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33281553b0 0x7f332815c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f332ebed640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3328155790 con 0x7f33280cb590 2024-04-25T13:17:19.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f332ebed640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f33280c6480 con 0x7f33280c5d30 2024-04-25T13:17:19.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f332ebed640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f332815bb60 con 0x7f33281553b0 2024-04-25T13:17:19.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f3327fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33280cb590 0x7f33280b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f3327fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33280cb590 0x7f33280b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39516/0 (socket says 172.21.15.52:39516) 2024-04-25T13:17:19.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f3327fff640 1 -- 172.21.15.52:0/505155323 learned_addr learned my addr 172.21.15.52:0/505155323 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:19.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f332c989640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33280c5d30 0x7f33281f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f332d18a640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33281553b0 0x7f332815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f3327fff640 1 -- 172.21.15.52:0/505155323 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33281553b0 msgr2=0x7f332815c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f3327fff640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33281553b0 0x7f332815c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f3327fff640 1 -- 172.21.15.52:0/505155323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33280c5d30 msgr2=0x7f33281f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f3327fff640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33280c5d30 0x7f33281f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f3327fff640 1 -- 172.21.15.52:0/505155323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33281f1f50 con 0x7f33280cb590 2024-04-25T13:17:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.405+0000 7f332c989640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33280c5d30 0x7f33281f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.406+0000 7f3327fff640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33280cb590 0x7f33280b4bc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f331c00e9e0 tx=0x7f331c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.406+0000 7f33257fa640 1 -- 172.21.15.52:0/505155323 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c017070 con 0x7f33280cb590 2024-04-25T13:17:19.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.406+0000 7f33257fa640 1 -- 172.21.15.52:0/505155323 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331c00c9d0 con 0x7f33280cb590 2024-04-25T13:17:19.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.406+0000 7f33257fa640 1 -- 172.21.15.52:0/505155323 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c00cdc0 con 0x7f33280cb590 2024-04-25T13:17:19.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.406+0000 7f332ebed640 1 -- 172.21.15.52:0/505155323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332815f4d0 con 0x7f33280cb590 2024-04-25T13:17:19.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.406+0000 7f332ebed640 1 -- 172.21.15.52:0/505155323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f332815e5b0 con 0x7f33280cb590 2024-04-25T13:17:19.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.406+0000 7f332ebed640 1 -- 172.21.15.52:0/505155323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3328068f50 con 0x7f33280cb590 2024-04-25T13:17:19.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.407+0000 7f33257fa640 1 -- 172.21.15.52:0/505155323 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f331c01a070 con 0x7f33280cb590 2024-04-25T13:17:19.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.408+0000 7f33257fa640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f331406c8f0 0x7f331406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.408+0000 7f33257fa640 1 -- 172.21.15.52:0/505155323 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f331c08c0a0 con 0x7f33280cb590 2024-04-25T13:17:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.408+0000 7f332c989640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f331406c8f0 0x7f331406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.408+0000 7f33257fa640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] conn(0x7f3314076380 0x7f3314078820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.408+0000 7f33257fa640 1 -- 172.21.15.52:0/505155323 --> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f331c004470 con 0x7f3314076380 2024-04-25T13:17:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.408+0000 7f33257fa640 1 -- 172.21.15.52:0/505155323 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f331c093050 con 0x7f33280cb590 2024-04-25T13:17:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.408+0000 7f332d18a640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] conn(0x7f3314076380 0x7f3314078820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.408+0000 7f332d18a640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] conn(0x7f3314076380 0x7f3314078820 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.408+0000 7f332c989640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f331406c8f0 0x7f331406edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3318001660 tx=0x7f3318009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.409+0000 7f33257fa640 1 -- 172.21.15.52:0/505155323 <== osd.3 v2:172.21.15.52:6816/3429485352 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f331c004470 con 0x7f3314076380 2024-04-25T13:17:19.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.426+0000 7f332ebed640 1 -- 172.21.15.52:0/505155323 --> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f33280b65c0 con 0x7f3314076380 2024-04-25T13:17:19.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.426+0000 7f33257fa640 1 -- 172.21.15.52:0/505155323 <== osd.3 v2:172.21.15.52:6816/3429485352 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f33280b65c0 con 0x7f3314076380 2024-04-25T13:17:19.427 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:19.427 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:19.427 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.426+0000 7f332ebed640 1 -- 172.21.15.52:0/505155323 >> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] conn(0x7f3314076380 msgr2=0x7f3314078820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.426+0000 7f332ebed640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.52:6816/3429485352,v1:172.21.15.52:6818/3429485352] conn(0x7f3314076380 0x7f3314078820 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.426+0000 7f332ebed640 1 -- 172.21.15.52:0/505155323 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f331406c8f0 msgr2=0x7f331406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.426+0000 7f332ebed640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f331406c8f0 0x7f331406edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3318001660 tx=0x7f3318009040 comp rx=0 tx=0).stop 2024-04-25T13:17:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.426+0000 7f332ebed640 1 -- 172.21.15.52:0/505155323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33280cb590 msgr2=0x7f33280b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.426+0000 7f332ebed640 1 --2- 172.21.15.52:0/505155323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33280cb590 0x7f33280b4bc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f331c00e9e0 tx=0x7f331c00eea0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.427+0000 7f332d18a640 1 -- 172.21.15.52:0/505155323 reap_dead start 2024-04-25T13:17:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.427+0000 7f332ebed640 1 -- 172.21.15.52:0/505155323 shutdown_connections 2024-04-25T13:17:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.427+0000 7f332ebed640 1 -- 172.21.15.52:0/505155323 >> 172.21.15.52:0/505155323 conn(0x7f3328074d50 msgr2=0x7f3328075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.427+0000 7f332ebed640 1 -- 172.21.15.52:0/505155323 shutdown_connections 2024-04-25T13:17:19.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.427+0000 7f332ebed640 1 -- 172.21.15.52:0/505155323 wait complete. 2024-04-25T13:17:19.437 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T13:17:19.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.539+0000 7ff13a144640 1 Processor -- start 2024-04-25T13:17:19.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.539+0000 7ff13a144640 1 -- start start 2024-04-25T13:17:19.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff13a144640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff13406bb90 0x7ff13415af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff13a144640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff1340c99f0 0x7ff1340c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff13a144640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff13415bef0 con 0x7ff13406bf70 2024-04-25T13:17:19.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff13a144640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff13415f510 con 0x7ff13406bb90 2024-04-25T13:17:19.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff13a144640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff13415b650 con 0x7ff1340c99f0 2024-04-25T13:17:19.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff1337fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff13406bb90 0x7ff13415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff132ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff13406bf70 0x7ff13415ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55186/0 (socket says 172.21.15.52:55186) 2024-04-25T13:17:19.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff132ffd640 1 -- 172.21.15.52:0/4156493686 learned_addr learned my addr 172.21.15.52:0/4156493686 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:19.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff133fff640 1 --2- 172.21.15.52:0/4156493686 >> v2:172.21.15.102:3300/0 conn(0x7ff1340c99f0 0x7ff1340c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff1337fe640 1 -- 172.21.15.52:0/4156493686 >> v2:172.21.15.102:3300/0 conn(0x7ff1340c99f0 msgr2=0x7ff1340c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:19.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff1337fe640 1 --2- 172.21.15.52:0/4156493686 >> v2:172.21.15.102:3300/0 conn(0x7ff1340c99f0 0x7ff1340c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff1337fe640 1 -- 172.21.15.52:0/4156493686 >> v1:172.21.15.52:6789/0 conn(0x7ff13406bf70 legacy=0x7ff13415ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff1337fe640 1 -- 172.21.15.52:0/4156493686 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13415b930 con 0x7ff13406bb90 2024-04-25T13:17:19.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.540+0000 7ff1327fc640 1 -- 172.21.15.52:0/4156493686 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355993508 0 0) 0x7ff13415bef0 con 0x7ff13406bf70 2024-04-25T13:17:19.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.541+0000 7ff1337fe640 1 --2- 172.21.15.52:0/4156493686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13406bb90 0x7ff13415af70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff1340732e0 tx=0x7ff12402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5f250301740d5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.541+0000 7ff1327fc640 1 -- 172.21.15.52:0/4156493686 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124037070 con 0x7ff13406bb90 2024-04-25T13:17:19.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.541+0000 7ff1327fc640 1 -- 172.21.15.52:0/4156493686 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff124032440 con 0x7ff13406bb90 2024-04-25T13:17:19.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.541+0000 7ff1327fc640 1 -- 172.21.15.52:0/4156493686 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124032810 con 0x7ff13406bb90 2024-04-25T13:17:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.541+0000 7ff13a144640 1 -- 172.21.15.52:0/4156493686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13406bb90 msgr2=0x7ff13415af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.541+0000 7ff13a144640 1 --2- 172.21.15.52:0/4156493686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13406bb90 0x7ff13415af70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff1340732e0 tx=0x7ff12402a230 comp rx=0 tx=0).stop 2024-04-25T13:17:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.542+0000 7ff13a144640 1 -- 172.21.15.52:0/4156493686 shutdown_connections 2024-04-25T13:17:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.542+0000 7ff13a144640 1 --2- 172.21.15.52:0/4156493686 >> v2:172.21.15.102:3300/0 conn(0x7ff1340c99f0 0x7ff1340c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.542+0000 7ff13a144640 1 --2- 172.21.15.52:0/4156493686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13406bb90 0x7ff13415af70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.542+0000 7ff13a144640 1 -- 172.21.15.52:0/4156493686 >> 172.21.15.52:0/4156493686 conn(0x7ff134074d50 msgr2=0x7ff134075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.542+0000 7ff13a144640 1 -- 172.21.15.52:0/4156493686 shutdown_connections 2024-04-25T13:17:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.542+0000 7ff13a144640 1 -- 172.21.15.52:0/4156493686 wait complete. 2024-04-25T13:17:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.543+0000 7ff13a144640 1 Processor -- start 2024-04-25T13:17:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.543+0000 7ff13a144640 1 -- start start 2024-04-25T13:17:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff13a144640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff13406bb90 0x7ff13414b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff13a144640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13406bf70 0x7ff13414b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff13a144640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1340c99f0 0x7ff1340ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff13a144640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff13415e8e0 con 0x7ff13406bf70 2024-04-25T13:17:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff13a144640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff13415e600 con 0x7ff1340c99f0 2024-04-25T13:17:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff13a144640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff134074560 con 0x7ff13406bb90 2024-04-25T13:17:19.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff132ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13406bf70 0x7ff13414b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff132ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13406bf70 0x7ff13414b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39540/0 (socket says 172.21.15.52:39540) 2024-04-25T13:17:19.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff132ffd640 1 -- 172.21.15.52:0/1646709140 learned_addr learned my addr 172.21.15.52:0/1646709140 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:19.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff133fff640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1340c99f0 0x7ff1340ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff1337fe640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff13406bb90 0x7ff13414b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff132ffd640 1 -- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff13406bb90 msgr2=0x7ff13414b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff132ffd640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff13406bb90 0x7ff13414b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff132ffd640 1 -- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1340c99f0 msgr2=0x7ff1340ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff132ffd640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1340c99f0 0x7ff1340ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff132ffd640 1 -- 172.21.15.52:0/1646709140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff134152360 con 0x7ff13406bf70 2024-04-25T13:17:19.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff132ffd640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13406bf70 0x7ff13414b590 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff12800c440 tx=0x7ff12800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff11bfff640 1 -- 172.21.15.52:0/1646709140 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1280074e0 con 0x7ff13406bf70 2024-04-25T13:17:19.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff11bfff640 1 -- 172.21.15.52:0/1646709140 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1280047e0 con 0x7ff13406bf70 2024-04-25T13:17:19.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff13a144640 1 -- 172.21.15.52:0/1646709140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1340cd5c0 con 0x7ff13406bf70 2024-04-25T13:17:19.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff11bfff640 1 -- 172.21.15.52:0/1646709140 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128004bd0 con 0x7ff13406bf70 2024-04-25T13:17:19.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.544+0000 7ff13a144640 1 -- 172.21.15.52:0/1646709140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1340cc950 con 0x7ff13406bf70 2024-04-25T13:17:19.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.545+0000 7ff13a144640 1 -- 172.21.15.52:0/1646709140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff134068e40 con 0x7ff13406bf70 2024-04-25T13:17:19.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.546+0000 7ff11bfff640 1 -- 172.21.15.52:0/1646709140 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff128011070 con 0x7ff13406bf70 2024-04-25T13:17:19.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.546+0000 7ff11bfff640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff12006c8f0 0x7ff12006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.546+0000 7ff11bfff640 1 -- 172.21.15.52:0/1646709140 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ff12808bb60 con 0x7ff13406bf70 2024-04-25T13:17:19.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.546+0000 7ff1337fe640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff12006c8f0 0x7ff12006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.547+0000 7ff1337fe640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff12006c8f0 0x7ff12006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff124034000 tx=0x7ff12402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.551+0000 7ff11bfff640 1 -- 172.21.15.52:0/1646709140 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff128059b70 con 0x7ff13406bf70 2024-04-25T13:17:19.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.735+0000 7ff13a144640 1 -- 172.21.15.52:0/1646709140 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7ff13414f0a0 con 0x7ff12006c8f0 2024-04-25T13:17:19.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.736+0000 7ff11bfff640 1 -- 172.21.15.52:0/1646709140 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff13414f0a0 con 0x7ff12006c8f0 2024-04-25T13:17:19.736 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T13:17:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.738+0000 7ff13a144640 1 -- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff12006c8f0 msgr2=0x7ff12006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.738+0000 7ff13a144640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff12006c8f0 0x7ff12006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff124034000 tx=0x7ff12402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.738+0000 7ff13a144640 1 -- 172.21.15.52:0/1646709140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13406bf70 msgr2=0x7ff13414b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.738+0000 7ff13a144640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13406bf70 0x7ff13414b590 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff12800c440 tx=0x7ff12800c900 comp rx=0 tx=0).stop 2024-04-25T13:17:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.738+0000 7ff13a144640 1 -- 172.21.15.52:0/1646709140 shutdown_connections 2024-04-25T13:17:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.738+0000 7ff13a144640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff12006c8f0 0x7ff12006edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.738+0000 7ff13a144640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1340c99f0 0x7ff1340ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.738+0000 7ff13a144640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13406bf70 0x7ff13414b590 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.738+0000 7ff13a144640 1 --2- 172.21.15.52:0/1646709140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff13406bb90 0x7ff13414b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.738+0000 7ff13a144640 1 -- 172.21.15.52:0/1646709140 >> 172.21.15.52:0/1646709140 conn(0x7ff134074d50 msgr2=0x7ff134154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.738+0000 7ff13a144640 1 -- 172.21.15.52:0/1646709140 shutdown_connections 2024-04-25T13:17:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.738+0000 7ff13a144640 1 -- 172.21.15.52:0/1646709140 wait complete. 2024-04-25T13:17:19.749 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T13:17:19.750 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.854+0000 7fed964a7640 1 Processor -- start 2024-04-25T13:17:19.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.854+0000 7fed964a7640 1 -- start start 2024-04-25T13:17:19.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.855+0000 7fed964a7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed900cf490 0x7fed90164690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.855+0000 7fed964a7640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed900c9740 con 0x7fed900c5fc0 2024-04-25T13:17:19.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.855+0000 7fed964a7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed900c9a20 con 0x7fed900c57c0 2024-04-25T13:17:19.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.855+0000 7fed964a7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fed90159800 con 0x7fed900cf490 2024-04-25T13:17:19.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.855+0000 7fed8ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fed900c5fc0 0x7fed9015c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55196/0 (socket says 172.21.15.52:55196) 2024-04-25T13:17:19.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.855+0000 7fed8ffff640 1 -- 172.21.15.52:0/2528953039 learned_addr learned my addr 172.21.15.52:0/2528953039 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:19.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.855+0000 7fed94a44640 1 --2- 172.21.15.52:0/2528953039 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed900cf490 0x7fed90164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574604641 0 0) 0x7fed900c9740 con 0x7fed900c5fc0 2024-04-25T13:17:19.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed7c003520 con 0x7fed900c5fc0 2024-04-25T13:17:19.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605317518 0 0) 0x7fed900c9a20 con 0x7fed900c57c0 2024-04-25T13:17:19.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed900c9740 con 0x7fed900c57c0 2024-04-25T13:17:19.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2551734866 0 0) 0x7fed7c003520 con 0x7fed900c5fc0 2024-04-25T13:17:19.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed900cf490 msgr2=0x7fed90164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:19.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 --2- 172.21.15.52:0/2528953039 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed900cf490 0x7fed90164690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 >> v1:172.21.15.102:6789/0 conn(0x7fed900c57c0 legacy=0x7fed90152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed90158ed0 con 0x7fed900c5fc0 2024-04-25T13:17:19.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7fed78001670 con 0x7fed900c5fc0 2024-04-25T13:17:19.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 >> v1:172.21.15.52:6789/0 conn(0x7fed900c5fc0 legacy=0x7fed9015c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 --2- 172.21.15.52:0/2528953039 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed900cf490 0x7fed7c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 --2- 172.21.15.52:0/2528953039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c004140 0x7fed7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 --2- 172.21.15.52:0/2528953039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed7c004d40 0x7fed7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fed90159800 con 0x7fed7c004d40 2024-04-25T13:17:19.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c00bb00 con 0x7fed7c004140 2024-04-25T13:17:19.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fed7c00bd00 con 0x7fed900cf490 2024-04-25T13:17:19.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed94a44640 1 --2- 172.21.15.52:0/2528953039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed7c004d40 0x7fed7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8ffff640 1 --2- 172.21.15.52:0/2528953039 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed900cf490 0x7fed7c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed8f7fe640 1 --2- 172.21.15.52:0/2528953039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c004140 0x7fed7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed94a44640 1 -- 172.21.15.52:0/2528953039 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed900cf490 msgr2=0x7fed7c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:19.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed94a44640 1 --2- 172.21.15.52:0/2528953039 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed900cf490 0x7fed7c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed94a44640 1 -- 172.21.15.52:0/2528953039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c004140 msgr2=0x7fed7c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:19.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed94a44640 1 --2- 172.21.15.52:0/2528953039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c004140 0x7fed7c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.856+0000 7fed94a44640 1 -- 172.21.15.52:0/2528953039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c003520 con 0x7fed7c004d40 2024-04-25T13:17:19.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.857+0000 7fed94a44640 1 --2- 172.21.15.52:0/2528953039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed7c004d40 0x7fed7c0051c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fed88009f90 tx=0x7fed7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d19d5c661de2772 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.857+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88009c10 con 0x7fed7c004d40 2024-04-25T13:17:19.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.857+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed88036070 con 0x7fed7c004d40 2024-04-25T13:17:19.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.857+0000 7fed8effd640 1 -- 172.21.15.52:0/2528953039 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88031810 con 0x7fed7c004d40 2024-04-25T13:17:19.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.858+0000 7fed964a7640 1 -- 172.21.15.52:0/2528953039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed7c004d40 msgr2=0x7fed7c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.858+0000 7fed964a7640 1 --2- 172.21.15.52:0/2528953039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed7c004d40 0x7fed7c0051c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fed88009f90 tx=0x7fed7c005830 comp rx=0 tx=0).stop 2024-04-25T13:17:19.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.858+0000 7fed94a44640 1 -- 172.21.15.52:0/2528953039 reap_dead start 2024-04-25T13:17:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.858+0000 7fed964a7640 1 -- 172.21.15.52:0/2528953039 shutdown_connections 2024-04-25T13:17:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.858+0000 7fed964a7640 1 -- 172.21.15.52:0/2528953039 >> 172.21.15.52:0/2528953039 conn(0x7fed900ce850 msgr2=0x7fed900cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.858+0000 7fed964a7640 1 -- 172.21.15.52:0/2528953039 shutdown_connections 2024-04-25T13:17:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.858+0000 7fed964a7640 1 -- 172.21.15.52:0/2528953039 wait complete. 2024-04-25T13:17:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.859+0000 7fed964a7640 1 Processor -- start 2024-04-25T13:17:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.859+0000 7fed964a7640 1 -- start start 2024-04-25T13:17:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed964a7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed90155ee0 0x7fed90155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed964a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed901562c0 0x7fed9015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed964a7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed9015a990 0x7fed9014bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed964a7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fed9015ca40 con 0x7fed9015a990 2024-04-25T13:17:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed964a7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fed90159490 con 0x7fed901562c0 2024-04-25T13:17:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed964a7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fed90159c90 con 0x7fed90155ee0 2024-04-25T13:17:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed94a44640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed9015a990 0x7fed9014bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed94a44640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed9015a990 0x7fed9014bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39566/0 (socket says 172.21.15.52:39566) 2024-04-25T13:17:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed94a44640 1 -- 172.21.15.52:0/3399224951 learned_addr learned my addr 172.21.15.52:0/3399224951 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed8f7fe640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed901562c0 0x7fed9015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed8ffff640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed90155ee0 0x7fed90155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed94a44640 1 -- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed90155ee0 msgr2=0x7fed90155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed94a44640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed90155ee0 0x7fed90155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed94a44640 1 -- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed901562c0 msgr2=0x7fed9015a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed94a44640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed901562c0 0x7fed9015a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed94a44640 1 -- 172.21.15.52:0/3399224951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9015c860 con 0x7fed9015a990 2024-04-25T13:17:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed94a44640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed9015a990 0x7fed9014bf40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fed88009f90 tx=0x7fed88009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.860+0000 7fed8cff9640 1 -- 172.21.15.52:0/3399224951 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88009c10 con 0x7fed9015a990 2024-04-25T13:17:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.861+0000 7fed8cff9640 1 -- 172.21.15.52:0/3399224951 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed88045430 con 0x7fed9015a990 2024-04-25T13:17:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.861+0000 7fed964a7640 1 -- 172.21.15.52:0/3399224951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed901ee6e0 con 0x7fed9015a990 2024-04-25T13:17:19.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.861+0000 7fed8cff9640 1 -- 172.21.15.52:0/3399224951 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88045800 con 0x7fed9015a990 2024-04-25T13:17:19.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.861+0000 7fed964a7640 1 -- 172.21.15.52:0/3399224951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed901eec80 con 0x7fed9015a990 2024-04-25T13:17:19.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.861+0000 7fed964a7640 1 -- 172.21.15.52:0/3399224951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed9015ae40 con 0x7fed9015a990 2024-04-25T13:17:19.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.862+0000 7fed8cff9640 1 -- 172.21.15.52:0/3399224951 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed88005d10 con 0x7fed9015a990 2024-04-25T13:17:19.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.862+0000 7fed8cff9640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fed7006c8f0 0x7fed7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.862+0000 7fed8cff9640 1 -- 172.21.15.52:0/3399224951 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fed880ace50 con 0x7fed9015a990 2024-04-25T13:17:19.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.863+0000 7fed8cff9640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] conn(0x7fed70076390 0x7fed70078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.863+0000 7fed8cff9640 1 -- 172.21.15.52:0/3399224951 --> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed70078f00 con 0x7fed70076390 2024-04-25T13:17:19.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.863+0000 7fed8cff9640 1 -- 172.21.15.52:0/3399224951 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fed880af470 con 0x7fed9015a990 2024-04-25T13:17:19.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.863+0000 7fed8ffff640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fed7006c8f0 0x7fed7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.863+0000 7fed8f7fe640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] conn(0x7fed70076390 0x7fed70078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.863+0000 7fed8ffff640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fed7006c8f0 0x7fed7006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed78001050 tx=0x7fed78009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.863+0000 7fed8f7fe640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] conn(0x7fed70076390 0x7fed70078830 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.864+0000 7fed8cff9640 1 -- 172.21.15.52:0/3399224951 <== osd.4 v2:172.21.15.102:6808/3635677901 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed70078f00 con 0x7fed70076390 2024-04-25T13:17:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.877+0000 7fed964a7640 1 -- 172.21.15.52:0/3399224951 --> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fed900c6890 con 0x7fed70076390 2024-04-25T13:17:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.878+0000 7fed8cff9640 1 -- 172.21.15.52:0/3399224951 <== osd.4 v2:172.21.15.102:6808/3635677901 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fed900c6890 con 0x7fed70076390 2024-04-25T13:17:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:19.878 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.878+0000 7fed964a7640 1 -- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] conn(0x7fed70076390 msgr2=0x7fed70078830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.878+0000 7fed964a7640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:6808/3635677901,v1:172.21.15.102:6809/3635677901] conn(0x7fed70076390 0x7fed70078830 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.878+0000 7fed964a7640 1 -- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fed7006c8f0 msgr2=0x7fed7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.878+0000 7fed964a7640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fed7006c8f0 0x7fed7006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed78001050 tx=0x7fed78009040 comp rx=0 tx=0).stop 2024-04-25T13:17:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.878+0000 7fed964a7640 1 -- 172.21.15.52:0/3399224951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed9015a990 msgr2=0x7fed9014bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.878+0000 7fed964a7640 1 --2- 172.21.15.52:0/3399224951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed9015a990 0x7fed9014bf40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fed88009f90 tx=0x7fed88009750 comp rx=0 tx=0).stop 2024-04-25T13:17:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.878+0000 7fed94a44640 1 -- 172.21.15.52:0/3399224951 reap_dead start 2024-04-25T13:17:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.878+0000 7fed964a7640 1 -- 172.21.15.52:0/3399224951 shutdown_connections 2024-04-25T13:17:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.878+0000 7fed964a7640 1 -- 172.21.15.52:0/3399224951 >> 172.21.15.52:0/3399224951 conn(0x7fed900ce850 msgr2=0x7fed90070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.878+0000 7fed964a7640 1 -- 172.21.15.52:0/3399224951 shutdown_connections 2024-04-25T13:17:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.878+0000 7fed964a7640 1 -- 172.21.15.52:0/3399224951 wait complete. 2024-04-25T13:17:19.889 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T13:17:19.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.990+0000 7fd511fad640 1 Processor -- start 2024-04-25T13:17:19.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.990+0000 7fd511fad640 1 -- start start 2024-04-25T13:17:19.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.991+0000 7fd511fad640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd50c152f70 0x7fd50c0c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.991+0000 7fd511fad640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50c158fe0 con 0x7fd50c0c8870 2024-04-25T13:17:19.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.991+0000 7fd511fad640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50c1592c0 con 0x7fd50c15cbd0 2024-04-25T13:17:19.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.991+0000 7fd511fad640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd50c1595a0 con 0x7fd50c152f70 2024-04-25T13:17:19.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.991+0000 7fd50affd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd50c0c8870 0x7fd50c15c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55204/0 (socket says 172.21.15.52:55204) 2024-04-25T13:17:19.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.991+0000 7fd50affd640 1 -- 172.21.15.52:0/1644195388 learned_addr learned my addr 172.21.15.52:0/1644195388 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:19.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.991+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1717489312 0 0) 0x7fd50c158fe0 con 0x7fd50c0c8870 2024-04-25T13:17:19.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.991+0000 7fd50b7fe640 1 --2- 172.21.15.52:0/1644195388 >> v2:172.21.15.102:3300/0 conn(0x7fd50c152f70 0x7fd50c0c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.991+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4f4003520 con 0x7fd50c0c8870 2024-04-25T13:17:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.991+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2280741002 0 0) 0x7fd4f4003520 con 0x7fd50c0c8870 2024-04-25T13:17:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 >> v2:172.21.15.102:3300/0 conn(0x7fd50c152f70 msgr2=0x7fd50c0c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50a7fc640 1 --2- 172.21.15.52:0/1644195388 >> v2:172.21.15.102:3300/0 conn(0x7fd50c152f70 0x7fd50c0c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 >> v1:172.21.15.102:6789/0 conn(0x7fd50c15cbd0 legacy=0x7fd50c073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c159880 con 0x7fd50c0c8870 2024-04-25T13:17:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7fd500001670 con 0x7fd50c0c8870 2024-04-25T13:17:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 >> v1:172.21.15.52:6789/0 conn(0x7fd50c0c8870 legacy=0x7fd50c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50a7fc640 1 --2- 172.21.15.52:0/1644195388 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f40039b0 0x7fd4f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50a7fc640 1 --2- 172.21.15.52:0/1644195388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4004800 0x7fd4f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50a7fc640 1 --2- 172.21.15.52:0/1644195388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4f40051c0 0x7fd4f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c1595a0 con 0x7fd4f4004800 2024-04-25T13:17:19.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f400c060 con 0x7fd4f40051c0 2024-04-25T13:17:19.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f400c260 con 0x7fd4f40039b0 2024-04-25T13:17:19.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50affd640 1 --2- 172.21.15.52:0/1644195388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4004800 0x7fd4f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50bfff640 1 --2- 172.21.15.52:0/1644195388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4f40051c0 0x7fd4f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50b7fe640 1 --2- 172.21.15.52:0/1644195388 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f40039b0 0x7fd4f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50affd640 1 -- 172.21.15.52:0/1644195388 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f40039b0 msgr2=0x7fd4f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50affd640 1 --2- 172.21.15.52:0/1644195388 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f40039b0 0x7fd4f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50affd640 1 -- 172.21.15.52:0/1644195388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4f40051c0 msgr2=0x7fd4f400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50affd640 1 --2- 172.21.15.52:0/1644195388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4f40051c0 0x7fd4f400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50bfff640 1 -- 172.21.15.52:0/1644195388 reap_dead start 2024-04-25T13:17:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.992+0000 7fd50affd640 1 -- 172.21.15.52:0/1644195388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f4003520 con 0x7fd4f4004800 2024-04-25T13:17:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.993+0000 7fd50affd640 1 --2- 172.21.15.52:0/1644195388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4004800 0x7fd4f4004c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c210 tx=0x7fd4f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5663e82e18b20682 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.993+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500007cf0 con 0x7fd4f4004800 2024-04-25T13:17:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.993+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd500005af0 con 0x7fd4f4004800 2024-04-25T13:17:19.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.993+0000 7fd50a7fc640 1 -- 172.21.15.52:0/1644195388 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500007070 con 0x7fd4f4004800 2024-04-25T13:17:19.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.993+0000 7fd511fad640 1 -- 172.21.15.52:0/1644195388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4004800 msgr2=0x7fd4f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.993+0000 7fd511fad640 1 --2- 172.21.15.52:0/1644195388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4004800 0x7fd4f4004c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c210 tx=0x7fd4f4005830 comp rx=0 tx=0).stop 2024-04-25T13:17:19.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.993+0000 7fd511fad640 1 -- 172.21.15.52:0/1644195388 shutdown_connections 2024-04-25T13:17:20.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.993+0000 7fd511fad640 1 --2- 172.21.15.52:0/1644195388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4004800 0x7fd4f4004c80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.993+0000 7fd511fad640 1 -- 172.21.15.52:0/1644195388 >> 172.21.15.52:0/1644195388 conn(0x7fd50c074d50 msgr2=0x7fd50c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.993+0000 7fd511fad640 1 -- 172.21.15.52:0/1644195388 shutdown_connections 2024-04-25T13:17:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.994+0000 7fd511fad640 1 -- 172.21.15.52:0/1644195388 wait complete. 2024-04-25T13:17:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.995+0000 7fd511fad640 1 Processor -- start 2024-04-25T13:17:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.995+0000 7fd511fad640 1 -- start start 2024-04-25T13:17:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.995+0000 7fd511fad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f4004800 0x7fd50c0cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.995+0000 7fd511fad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd50c14f040 0x7fd50c143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.995+0000 7fd511fad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd50c144ed0 0x7fd50c143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.995+0000 7fd511fad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c1534d0 con 0x7fd50c14f040 2024-04-25T13:17:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.995+0000 7fd511fad640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c153350 con 0x7fd50c144ed0 2024-04-25T13:17:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.995+0000 7fd511fad640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd50c15c4c0 con 0x7fd4f4004800 2024-04-25T13:17:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd50affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd50c14f040 0x7fd50c143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd50affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd50c14f040 0x7fd50c143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39576/0 (socket says 172.21.15.52:39576) 2024-04-25T13:17:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd50affd640 1 -- 172.21.15.52:0/3360930487 learned_addr learned my addr 172.21.15.52:0/3360930487 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd50b7fe640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f4004800 0x7fd50c0cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd50bfff640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd50c144ed0 0x7fd50c143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd50affd640 1 -- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f4004800 msgr2=0x7fd50c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd50affd640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f4004800 0x7fd50c0cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd50affd640 1 -- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd50c144ed0 msgr2=0x7fd50c143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd50affd640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd50c144ed0 0x7fd50c143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd50affd640 1 -- 172.21.15.52:0/3360930487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c156de0 con 0x7fd50c14f040 2024-04-25T13:17:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd50affd640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd50c14f040 0x7fd50c143400 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c330 tx=0x7fd50c0c71b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd4f3fff640 1 -- 172.21.15.52:0/3360930487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500001630 con 0x7fd50c14f040 2024-04-25T13:17:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd4f3fff640 1 -- 172.21.15.52:0/3360930487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd500042070 con 0x7fd50c14f040 2024-04-25T13:17:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd4f3fff640 1 -- 172.21.15.52:0/3360930487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500007290 con 0x7fd50c14f040 2024-04-25T13:17:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd511fad640 1 -- 172.21.15.52:0/3360930487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50c1570c0 con 0x7fd50c14f040 2024-04-25T13:17:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.996+0000 7fd511fad640 1 -- 172.21.15.52:0/3360930487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50c157680 con 0x7fd50c14f040 2024-04-25T13:17:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.998+0000 7fd511fad640 1 -- 172.21.15.52:0/3360930487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd50c15c850 con 0x7fd50c14f040 2024-04-25T13:17:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.998+0000 7fd4f3fff640 1 -- 172.21.15.52:0/3360930487 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd500007430 con 0x7fd50c14f040 2024-04-25T13:17:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.998+0000 7fd4f3fff640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd4f806c8f0 0x7fd4f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.998+0000 7fd4f3fff640 1 -- 172.21.15.52:0/3360930487 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fd5000abea0 con 0x7fd50c14f040 2024-04-25T13:17:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.999+0000 7fd50b7fe640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd4f806c8f0 0x7fd4f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:19.999+0000 7fd50b7fe640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd4f806c8f0 0x7fd4f806edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009c40 tx=0x7fd4fc009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.003+0000 7fd4f3fff640 1 -- 172.21.15.52:0/3360930487 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd50c15c850 con 0x7fd50c14f040 2024-04-25T13:17:20.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.189+0000 7fd511fad640 1 -- 172.21.15.52:0/3360930487 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fd50c068e40 con 0x7fd4f806c8f0 2024-04-25T13:17:20.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.190+0000 7fd4f3fff640 1 -- 172.21.15.52:0/3360930487 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd50c068e40 con 0x7fd4f806c8f0 2024-04-25T13:17:20.190 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T13:17:20.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.192+0000 7fd511fad640 1 -- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd4f806c8f0 msgr2=0x7fd4f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.192+0000 7fd511fad640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd4f806c8f0 0x7fd4f806edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009c40 tx=0x7fd4fc009190 comp rx=0 tx=0).stop 2024-04-25T13:17:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.192+0000 7fd511fad640 1 -- 172.21.15.52:0/3360930487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd50c14f040 msgr2=0x7fd50c143400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.192+0000 7fd511fad640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd50c14f040 0x7fd50c143400 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c330 tx=0x7fd50c0c71b0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.192+0000 7fd511fad640 1 -- 172.21.15.52:0/3360930487 shutdown_connections 2024-04-25T13:17:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.192+0000 7fd511fad640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd4f806c8f0 0x7fd4f806edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.192+0000 7fd511fad640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd50c144ed0 0x7fd50c143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.192+0000 7fd511fad640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd50c14f040 0x7fd50c143400 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.192+0000 7fd511fad640 1 --2- 172.21.15.52:0/3360930487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f4004800 0x7fd50c0cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.192+0000 7fd511fad640 1 -- 172.21.15.52:0/3360930487 >> 172.21.15.52:0/3360930487 conn(0x7fd50c074d50 msgr2=0x7fd50c150d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.192+0000 7fd511fad640 1 -- 172.21.15.52:0/3360930487 shutdown_connections 2024-04-25T13:17:20.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.192+0000 7fd511fad640 1 -- 172.21.15.52:0/3360930487 wait complete. 2024-04-25T13:17:20.203 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T13:17:20.203 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:20.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.307+0000 7f4aedfad640 1 Processor -- start 2024-04-25T13:17:20.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.307+0000 7f4aedfad640 1 -- start start 2024-04-25T13:17:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.308+0000 7f4aedfad640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4ae8073620 0x7f4ae80c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.308+0000 7f4aedfad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae8153280 0x7f4ae80ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.308+0000 7f4aedfad640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae80c6100 con 0x7f4ae80ca650 2024-04-25T13:17:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.308+0000 7f4aedfad640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae80cbf20 con 0x7f4ae8073620 2024-04-25T13:17:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.308+0000 7f4aedfad640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae80c6390 con 0x7f4ae8153280 2024-04-25T13:17:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.308+0000 7f4ae6ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4ae80ca650 0x7f4ae8152b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55206/0 (socket says 172.21.15.52:55206) 2024-04-25T13:17:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.308+0000 7f4ae6ffd640 1 -- 172.21.15.52:0/4267600988 learned_addr learned my addr 172.21.15.52:0/4267600988 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.308+0000 7f4ae7fff640 1 --2- 172.21.15.52:0/4267600988 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae8153280 0x7f4ae80ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.308+0000 7f4ae77fe640 1 --2- 172.21.15.52:0/4267600988 >> v2:172.21.15.102:3300/0 conn(0x7f4ae8073620 0x7f4ae80c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 898574965 0 0) 0x7f4ae80c6100 con 0x7f4ae80ca650 2024-04-25T13:17:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ad0003520 con 0x7f4ae80ca650 2024-04-25T13:17:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3070071292 0 0) 0x7f4ad0003520 con 0x7f4ae80ca650 2024-04-25T13:17:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae8153280 msgr2=0x7f4ae80ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 --2- 172.21.15.52:0/4267600988 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae8153280 0x7f4ae80ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 >> v2:172.21.15.102:3300/0 conn(0x7f4ae8073620 msgr2=0x7f4ae80c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 --2- 172.21.15.52:0/4267600988 >> v2:172.21.15.102:3300/0 conn(0x7f4ae8073620 0x7f4ae80c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae80cb5f0 con 0x7f4ae80ca650 2024-04-25T13:17:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7f4adc001670 con 0x7f4ae80ca650 2024-04-25T13:17:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae77fe640 1 --2- 172.21.15.52:0/4267600988 >> v2:172.21.15.102:3300/0 conn(0x7f4ae8073620 0x7f4ae80c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 >> v1:172.21.15.52:6789/0 conn(0x7f4ae80ca650 legacy=0x7f4ae8152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 --2- 172.21.15.52:0/4267600988 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae8153280 0x7f4ad00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 --2- 172.21.15.52:0/4267600988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ad0003f30 0x7f4ad0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 --2- 172.21.15.52:0/4267600988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ad0004d40 0x7f4ad00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae80cbf20 con 0x7f4ad0003f30 2024-04-25T13:17:20.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae80c6390 con 0x7f4ad0004d40 2024-04-25T13:17:20.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad000b9c0 con 0x7f4ae8153280 2024-04-25T13:17:20.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae6ffd640 1 --2- 172.21.15.52:0/4267600988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ad0003f30 0x7f4ad0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae77fe640 1 --2- 172.21.15.52:0/4267600988 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae8153280 0x7f4ad00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae7fff640 1 --2- 172.21.15.52:0/4267600988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ad0004d40 0x7f4ad00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae6ffd640 1 -- 172.21.15.52:0/4267600988 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae8153280 msgr2=0x7f4ad00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae6ffd640 1 --2- 172.21.15.52:0/4267600988 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae8153280 0x7f4ad00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae6ffd640 1 -- 172.21.15.52:0/4267600988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ad0004d40 msgr2=0x7f4ad00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae6ffd640 1 --2- 172.21.15.52:0/4267600988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ad0004d40 0x7f4ad00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.309+0000 7f4ae6ffd640 1 -- 172.21.15.52:0/4267600988 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad0003520 con 0x7f4ad0003f30 2024-04-25T13:17:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.310+0000 7f4ae6ffd640 1 --2- 172.21.15.52:0/4267600988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ad0003f30 0x7f4ad0004800 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00c210 tx=0x7f4ad0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4340d5271dd1dddb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.310+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc007d30 con 0x7f4ad0003f30 2024-04-25T13:17:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.310+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4adc0058d0 con 0x7f4ad0003f30 2024-04-25T13:17:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.310+0000 7f4ae67fc640 1 -- 172.21.15.52:0/4267600988 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc005d20 con 0x7f4ad0003f30 2024-04-25T13:17:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.311+0000 7f4aedfad640 1 -- 172.21.15.52:0/4267600988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ad0003f30 msgr2=0x7f4ad0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.311+0000 7f4aedfad640 1 --2- 172.21.15.52:0/4267600988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ad0003f30 0x7f4ad0004800 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00c210 tx=0x7f4ad0005830 comp rx=0 tx=0).stop 2024-04-25T13:17:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.311+0000 7f4ae7fff640 1 -- 172.21.15.52:0/4267600988 reap_dead start 2024-04-25T13:17:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.311+0000 7f4aedfad640 1 -- 172.21.15.52:0/4267600988 shutdown_connections 2024-04-25T13:17:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.311+0000 7f4aedfad640 1 -- 172.21.15.52:0/4267600988 >> 172.21.15.52:0/4267600988 conn(0x7f4ae8068120 msgr2=0x7f4ae8070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.311+0000 7f4aedfad640 1 -- 172.21.15.52:0/4267600988 shutdown_connections 2024-04-25T13:17:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.311+0000 7f4aedfad640 1 -- 172.21.15.52:0/4267600988 wait complete. 2024-04-25T13:17:20.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.312+0000 7f4aedfad640 1 Processor -- start 2024-04-25T13:17:20.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.312+0000 7f4aedfad640 1 -- start start 2024-04-25T13:17:20.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4aedfad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ad0003f30 0x7f4ae814ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4aedfad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ae814bfc0 0x7f4ae806c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4aedfad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae814c4b0 0x7f4ae806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4aedfad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae80c6670 con 0x7f4ad0003f30 2024-04-25T13:17:20.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4aedfad640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae80cbbb0 con 0x7f4ae814bfc0 2024-04-25T13:17:20.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4aedfad640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae8073a00 con 0x7f4ae814c4b0 2024-04-25T13:17:20.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ad0003f30 0x7f4ae814ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ad0003f30 0x7f4ae814ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39596/0 (socket says 172.21.15.52:39596) 2024-04-25T13:17:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae77fe640 1 -- 172.21.15.52:0/961851429 learned_addr learned my addr 172.21.15.52:0/961851429 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae6ffd640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ae814bfc0 0x7f4ae806c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae7fff640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae814c4b0 0x7f4ae806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae77fe640 1 -- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae814c4b0 msgr2=0x7f4ae806c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae77fe640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae814c4b0 0x7f4ae806c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae77fe640 1 -- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ae814bfc0 msgr2=0x7f4ae806c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae77fe640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ae814bfc0 0x7f4ae806c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae77fe640 1 -- 172.21.15.52:0/961851429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae814f560 con 0x7f4ad0003f30 2024-04-25T13:17:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae7fff640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ae814c4b0 0x7f4ae806c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae6ffd640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ae814bfc0 0x7f4ae806c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.313+0000 7f4ae77fe640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ad0003f30 0x7f4ae814ba80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8011d00 tx=0x7f4ad800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.314+0000 7f4acffff640 1 -- 172.21.15.52:0/961851429 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800fd20 con 0x7f4ad0003f30 2024-04-25T13:17:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.314+0000 7f4acffff640 1 -- 172.21.15.52:0/961851429 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad8004020 con 0x7f4ad0003f30 2024-04-25T13:17:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.314+0000 7f4aedfad640 1 -- 172.21.15.52:0/961851429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae80cd2f0 con 0x7f4ad0003f30 2024-04-25T13:17:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.314+0000 7f4acffff640 1 -- 172.21.15.52:0/961851429 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80043f0 con 0x7f4ad0003f30 2024-04-25T13:17:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.314+0000 7f4aedfad640 1 -- 172.21.15.52:0/961851429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae80cd8b0 con 0x7f4ad0003f30 2024-04-25T13:17:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.315+0000 7f4aedfad640 1 -- 172.21.15.52:0/961851429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ae80caef0 con 0x7f4ad0003f30 2024-04-25T13:17:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.315+0000 7f4acffff640 1 -- 172.21.15.52:0/961851429 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ad8012040 con 0x7f4ad0003f30 2024-04-25T13:17:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.316+0000 7f4acffff640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4ad406c8f0 0x7f4ad406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.316+0000 7f4acffff640 1 -- 172.21.15.52:0/961851429 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f4ad808c4d0 con 0x7f4ad0003f30 2024-04-25T13:17:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.316+0000 7f4acffff640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] conn(0x7f4ad4076380 0x7f4ad4078820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.316+0000 7f4acffff640 1 -- 172.21.15.52:0/961851429 --> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ad80067f0 con 0x7f4ad4076380 2024-04-25T13:17:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.316+0000 7f4ae6ffd640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4ad406c8f0 0x7f4ad406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.316+0000 7f4acffff640 1 -- 172.21.15.52:0/961851429 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4ad8093050 con 0x7f4ad0003f30 2024-04-25T13:17:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.316+0000 7f4ae7fff640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] conn(0x7f4ad4076380 0x7f4ad4078820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.316+0000 7f4ae6ffd640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4ad406c8f0 0x7f4ad406edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4adc033000 tx=0x7f4adc009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.316+0000 7f4ae7fff640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] conn(0x7f4ad4076380 0x7f4ad4078820 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.317+0000 7f4acffff640 1 -- 172.21.15.52:0/961851429 <== osd.5 v2:172.21.15.102:6824/82766007 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ad80067f0 con 0x7f4ad4076380 2024-04-25T13:17:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.330+0000 7f4aedfad640 1 -- 172.21.15.52:0/961851429 --> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4ae8068f50 con 0x7f4ad4076380 2024-04-25T13:17:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.331+0000 7f4acffff640 1 -- 172.21.15.52:0/961851429 <== osd.5 v2:172.21.15.102:6824/82766007 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4ae8068f50 con 0x7f4ad4076380 2024-04-25T13:17:20.331 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:20.332 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:20.332 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.331+0000 7f4aedfad640 1 -- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] conn(0x7f4ad4076380 msgr2=0x7f4ad4078820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.331+0000 7f4aedfad640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:6824/82766007,v1:172.21.15.102:6825/82766007] conn(0x7f4ad4076380 0x7f4ad4078820 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.331+0000 7f4aedfad640 1 -- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4ad406c8f0 msgr2=0x7f4ad406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.332+0000 7f4aedfad640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4ad406c8f0 0x7f4ad406edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4adc033000 tx=0x7f4adc009030 comp rx=0 tx=0).stop 2024-04-25T13:17:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.332+0000 7f4aedfad640 1 -- 172.21.15.52:0/961851429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ad0003f30 msgr2=0x7f4ae814ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.332+0000 7f4aedfad640 1 --2- 172.21.15.52:0/961851429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ad0003f30 0x7f4ae814ba80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8011d00 tx=0x7f4ad800f610 comp rx=0 tx=0).stop 2024-04-25T13:17:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.332+0000 7f4ae7fff640 1 -- 172.21.15.52:0/961851429 reap_dead start 2024-04-25T13:17:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.332+0000 7f4aedfad640 1 -- 172.21.15.52:0/961851429 shutdown_connections 2024-04-25T13:17:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.332+0000 7f4aedfad640 1 -- 172.21.15.52:0/961851429 >> 172.21.15.52:0/961851429 conn(0x7f4ae8068120 msgr2=0x7f4ae8159610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.332+0000 7f4aedfad640 1 -- 172.21.15.52:0/961851429 shutdown_connections 2024-04-25T13:17:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.332+0000 7f4aedfad640 1 -- 172.21.15.52:0/961851429 wait complete. 2024-04-25T13:17:20.342 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T13:17:20.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.447+0000 7f3b42719640 1 Processor -- start 2024-04-25T13:17:20.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.447+0000 7f3b42719640 1 -- start start 2024-04-25T13:17:20.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b42719640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b3c1554e0 0x7f3b3c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b42719640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3b3c0b3c00 0x7f3b3c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b42719640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c1558c0 con 0x7f3b3c0b5450 2024-04-25T13:17:20.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b42719640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3b3c0b4a80 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b42719640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3c15f630 con 0x7f3b3c1554e0 2024-04-25T13:17:20.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b3b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3b3c0b3c00 0x7f3b3c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b3bfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b3c1554e0 0x7f3b3c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b3b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3b3c0b3c00 0x7f3b3c0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.52:50446/0 (socket says 172.21.15.52:50446) 2024-04-25T13:17:20.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b3b7fe640 1 -- 172.21.15.52:0/3355268516 learned_addr learned my addr 172.21.15.52:0/3355268516 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:20.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b40cb6640 1 --1- 172.21.15.52:0/3355268516 >> v1:172.21.15.102:6789/0 conn(0x7f3b3c0b5450 0x7f3b3c0d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.52:55618/0 (socket says 172.21.15.52:55618) 2024-04-25T13:17:20.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b3b7fe640 1 -- 172.21.15.52:0/3355268516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b3c1554e0 msgr2=0x7f3b3c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b3b7fe640 1 --2- 172.21.15.52:0/3355268516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b3c1554e0 0x7f3b3c15f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b3b7fe640 1 -- 172.21.15.52:0/3355268516 >> v1:172.21.15.102:6789/0 conn(0x7f3b3c0b5450 legacy=0x7f3b3c0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.448+0000 7f3b3b7fe640 1 -- 172.21.15.52:0/3355268516 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c0cb8c0 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.449+0000 7f3b3b7fe640 1 --2- 172.21.15.52:0/3355268516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b3c0b3c00 0x7f3b3c0b4f10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009870 tx=0x7f3b2c02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc98d46b590fa5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.449+0000 7f3b3affd640 1 -- 172.21.15.52:0/3355268516 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c037070 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.449+0000 7f3b3affd640 1 -- 172.21.15.52:0/3355268516 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2c02ae50 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.449+0000 7f3b3affd640 1 -- 172.21.15.52:0/3355268516 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c032860 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.450+0000 7f3b42719640 1 -- 172.21.15.52:0/3355268516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b3c0b3c00 msgr2=0x7f3b3c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.450+0000 7f3b42719640 1 --2- 172.21.15.52:0/3355268516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b3c0b3c00 0x7f3b3c0b4f10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009870 tx=0x7f3b2c02a300 comp rx=0 tx=0).stop 2024-04-25T13:17:20.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.450+0000 7f3b42719640 1 -- 172.21.15.52:0/3355268516 shutdown_connections 2024-04-25T13:17:20.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.450+0000 7f3b42719640 1 --2- 172.21.15.52:0/3355268516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b3c0b3c00 0x7f3b3c0b4f10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.450+0000 7f3b42719640 1 --2- 172.21.15.52:0/3355268516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b3c1554e0 0x7f3b3c15f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.450+0000 7f3b42719640 1 -- 172.21.15.52:0/3355268516 >> 172.21.15.52:0/3355268516 conn(0x7f3b3c074d50 msgr2=0x7f3b3c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.450+0000 7f3b42719640 1 -- 172.21.15.52:0/3355268516 shutdown_connections 2024-04-25T13:17:20.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.450+0000 7f3b42719640 1 -- 172.21.15.52:0/3355268516 wait complete. 2024-04-25T13:17:20.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.451+0000 7f3b42719640 1 Processor -- start 2024-04-25T13:17:20.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.452+0000 7f3b42719640 1 -- start start 2024-04-25T13:17:20.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.452+0000 7f3b42719640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3c0b3c00 0x7f3b3c0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.452+0000 7f3b42719640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b3c0b5450 0x7f3b3c0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.452+0000 7f3b42719640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b3c1554e0 0x7f3b3c1e7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.452+0000 7f3b42719640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c0b4430 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.452+0000 7f3b42719640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c0b4150 con 0x7f3b3c0b5450 2024-04-25T13:17:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.452+0000 7f3b42719640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3c0b4710 con 0x7f3b3c1554e0 2024-04-25T13:17:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b3bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3c0b3c00 0x7f3b3c0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b3bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3c0b3c00 0x7f3b3c0c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39602/0 (socket says 172.21.15.52:39602) 2024-04-25T13:17:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b3bfff640 1 -- 172.21.15.52:0/4280677605 learned_addr learned my addr 172.21.15.52:0/4280677605 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b40cb6640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b3c1554e0 0x7f3b3c1e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b3b7fe640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b3c0b5450 0x7f3b3c0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b3bfff640 1 -- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b3c1554e0 msgr2=0x7f3b3c1e7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b3bfff640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b3c1554e0 0x7f3b3c1e7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b3bfff640 1 -- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b3c0b5450 msgr2=0x7f3b3c0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b3bfff640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b3c0b5450 0x7f3b3c0c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b3bfff640 1 -- 172.21.15.52:0/4280677605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c0cab50 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b3bfff640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3c0b3c00 0x7f3b3c0c7fc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000e9b0 tx=0x7f3b3000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b38ff9640 1 -- 172.21.15.52:0/4280677605 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30017070 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b38ff9640 1 -- 172.21.15.52:0/4280677605 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3000c9a0 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b38ff9640 1 -- 172.21.15.52:0/4280677605 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3000cd90 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b42719640 1 -- 172.21.15.52:0/4280677605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3c14ecd0 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.453+0000 7f3b42719640 1 -- 172.21.15.52:0/4280677605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b3c0ca840 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.455+0000 7f3b42719640 1 -- 172.21.15.52:0/4280677605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b3c068e40 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.455+0000 7f3b38ff9640 1 -- 172.21.15.52:0/4280677605 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b3001a070 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.455+0000 7f3b38ff9640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3b2806c8f0 0x7f3b2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.455+0000 7f3b38ff9640 1 -- 172.21.15.52:0/4280677605 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f3b3008bf70 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.456+0000 7f3b3b7fe640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3b2806c8f0 0x7f3b2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.456+0000 7f3b3b7fe640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3b2806c8f0 0x7f3b2806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c034000 tx=0x7f3b2c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.460+0000 7f3b38ff9640 1 -- 172.21.15.52:0/4280677605 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3b30059930 con 0x7f3b3c0b3c00 2024-04-25T13:17:20.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.645+0000 7f3b42719640 1 -- 172.21.15.52:0/4280677605 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f3b3c14ea80 con 0x7f3b2806c8f0 2024-04-25T13:17:20.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.646+0000 7f3b38ff9640 1 -- 172.21.15.52:0/4280677605 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3b3c14ea80 con 0x7f3b2806c8f0 2024-04-25T13:17:20.646 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T13:17:20.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.648+0000 7f3b42719640 1 -- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3b2806c8f0 msgr2=0x7f3b2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.648+0000 7f3b42719640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3b2806c8f0 0x7f3b2806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c034000 tx=0x7f3b2c02e000 comp rx=0 tx=0).stop 2024-04-25T13:17:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.648+0000 7f3b42719640 1 -- 172.21.15.52:0/4280677605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3c0b3c00 msgr2=0x7f3b3c0c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.648+0000 7f3b42719640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3c0b3c00 0x7f3b3c0c7fc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000e9b0 tx=0x7f3b3000ee70 comp rx=0 tx=0).stop 2024-04-25T13:17:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.648+0000 7f3b42719640 1 -- 172.21.15.52:0/4280677605 shutdown_connections 2024-04-25T13:17:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.648+0000 7f3b42719640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3b2806c8f0 0x7f3b2806edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.648+0000 7f3b42719640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b3c1554e0 0x7f3b3c1e7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.648+0000 7f3b42719640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b3c0b5450 0x7f3b3c0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.648+0000 7f3b42719640 1 --2- 172.21.15.52:0/4280677605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b3c0b3c00 0x7f3b3c0c7fc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.648+0000 7f3b42719640 1 -- 172.21.15.52:0/4280677605 >> 172.21.15.52:0/4280677605 conn(0x7f3b3c074d50 msgr2=0x7f3b3c151750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.648+0000 7f3b42719640 1 -- 172.21.15.52:0/4280677605 shutdown_connections 2024-04-25T13:17:20.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.648+0000 7f3b42719640 1 -- 172.21.15.52:0/4280677605 wait complete. 2024-04-25T13:17:20.659 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T13:17:20.659 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.763+0000 7ffb871d8640 1 Processor -- start 2024-04-25T13:17:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.764+0000 7ffb871d8640 1 -- start start 2024-04-25T13:17:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.764+0000 7ffb871d8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb80155120 0x7ffb800cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.764+0000 7ffb871d8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb8015e960 0x7ffb8015ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.764+0000 7ffb871d8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8015f2d0 con 0x7ffb800cccc0 2024-04-25T13:17:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.764+0000 7ffb871d8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ffb8015b130 con 0x7ffb8015e960 2024-04-25T13:17:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.764+0000 7ffb871d8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffb8015b410 con 0x7ffb80155120 2024-04-25T13:17:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.764+0000 7ffb85775640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb8015e960 0x7ffb8015ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.765+0000 7ffb85775640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb8015e960 0x7ffb8015ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39604/0 (socket says 172.21.15.52:39604) 2024-04-25T13:17:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.765+0000 7ffb85775640 1 -- 172.21.15.52:0/1242507344 learned_addr learned my addr 172.21.15.52:0/1242507344 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.765+0000 7ffb84f74640 1 --2- 172.21.15.52:0/1242507344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb80155120 0x7ffb800cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.765+0000 7ffb85775640 1 -- 172.21.15.52:0/1242507344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb80155120 msgr2=0x7ffb800cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.765+0000 7ffb85775640 1 --2- 172.21.15.52:0/1242507344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb80155120 0x7ffb800cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.765+0000 7ffb85775640 1 -- 172.21.15.52:0/1242507344 >> v1:172.21.15.102:6789/0 conn(0x7ffb800cccc0 legacy=0x7ffb800cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.765+0000 7ffb85775640 1 -- 172.21.15.52:0/1242507344 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8015b6f0 con 0x7ffb8015e960 2024-04-25T13:17:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.766+0000 7ffb85775640 1 --2- 172.21.15.52:0/1242507344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb8015e960 0x7ffb8015ed90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009e50 tx=0x7ffb7802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cdf163980e6fda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.766+0000 7ffb7f7fe640 1 -- 172.21.15.52:0/1242507344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78036070 con 0x7ffb8015e960 2024-04-25T13:17:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.766+0000 7ffb7f7fe640 1 -- 172.21.15.52:0/1242507344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb78031600 con 0x7ffb8015e960 2024-04-25T13:17:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.766+0000 7ffb7f7fe640 1 -- 172.21.15.52:0/1242507344 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb780319d0 con 0x7ffb8015e960 2024-04-25T13:17:20.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.766+0000 7ffb871d8640 1 -- 172.21.15.52:0/1242507344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb8015e960 msgr2=0x7ffb8015ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.766+0000 7ffb871d8640 1 --2- 172.21.15.52:0/1242507344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb8015e960 0x7ffb8015ed90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009e50 tx=0x7ffb7802a710 comp rx=0 tx=0).stop 2024-04-25T13:17:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.766+0000 7ffb871d8640 1 -- 172.21.15.52:0/1242507344 shutdown_connections 2024-04-25T13:17:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.766+0000 7ffb871d8640 1 --2- 172.21.15.52:0/1242507344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb8015e960 0x7ffb8015ed90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.766+0000 7ffb871d8640 1 --2- 172.21.15.52:0/1242507344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb80155120 0x7ffb800cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.766+0000 7ffb871d8640 1 -- 172.21.15.52:0/1242507344 >> 172.21.15.52:0/1242507344 conn(0x7ffb80074d50 msgr2=0x7ffb80075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.766+0000 7ffb871d8640 1 -- 172.21.15.52:0/1242507344 shutdown_connections 2024-04-25T13:17:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.766+0000 7ffb871d8640 1 -- 172.21.15.52:0/1242507344 wait complete. 2024-04-25T13:17:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.767+0000 7ffb871d8640 1 Processor -- start 2024-04-25T13:17:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.767+0000 7ffb871d8640 1 -- start start 2024-04-25T13:17:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.768+0000 7ffb871d8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb800cccc0 0x7ffb8015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.768+0000 7ffb871d8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb80155120 0x7ffb801e5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.768+0000 7ffb871d8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb8015e960 0x7ffb80141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.768+0000 7ffb871d8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffb800d1370 con 0x7ffb800cccc0 2024-04-25T13:17:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.768+0000 7ffb871d8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8015bcb0 con 0x7ffb8015e960 2024-04-25T13:17:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.768+0000 7ffb871d8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffb800cc8b0 con 0x7ffb80155120 2024-04-25T13:17:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.768+0000 7ffb84f74640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb800cccc0 0x7ffb8015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.768+0000 7ffb84f74640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb800cccc0 0x7ffb8015a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39608/0 (socket says 172.21.15.52:39608) 2024-04-25T13:17:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.768+0000 7ffb84f74640 1 -- 172.21.15.52:0/889789396 learned_addr learned my addr 172.21.15.52:0/889789396 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb85775640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb8015e960 0x7ffb80141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb7ffff640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb80155120 0x7ffb801e5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb84f74640 1 -- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb80155120 msgr2=0x7ffb801e5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb84f74640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb80155120 0x7ffb801e5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb84f74640 1 -- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb8015e960 msgr2=0x7ffb80141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb84f74640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb8015e960 0x7ffb80141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb84f74640 1 -- 172.21.15.52:0/889789396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb800b6230 con 0x7ffb800cccc0 2024-04-25T13:17:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb84f74640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb800cccc0 0x7ffb8015a660 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400d830 tx=0x7ffb7400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb7d7fa640 1 -- 172.21.15.52:0/889789396 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7400b6c0 con 0x7ffb800cccc0 2024-04-25T13:17:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb7d7fa640 1 -- 172.21.15.52:0/889789396 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb74019070 con 0x7ffb800cccc0 2024-04-25T13:17:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb871d8640 1 -- 172.21.15.52:0/889789396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb801f1d40 con 0x7ffb800cccc0 2024-04-25T13:17:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb7d7fa640 1 -- 172.21.15.52:0/889789396 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7400ba80 con 0x7ffb800cccc0 2024-04-25T13:17:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.769+0000 7ffb871d8640 1 -- 172.21.15.52:0/889789396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb801f1260 con 0x7ffb800cccc0 2024-04-25T13:17:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.770+0000 7ffb871d8640 1 -- 172.21.15.52:0/889789396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb800b64a0 con 0x7ffb800cccc0 2024-04-25T13:17:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.771+0000 7ffb7d7fa640 1 -- 172.21.15.52:0/889789396 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb7401e460 con 0x7ffb800cccc0 2024-04-25T13:17:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.771+0000 7ffb7d7fa640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ffb6406c8f0 0x7ffb6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.771+0000 7ffb7d7fa640 1 -- 172.21.15.52:0/889789396 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ffb7408c590 con 0x7ffb800cccc0 2024-04-25T13:17:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.771+0000 7ffb7d7fa640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] conn(0x7ffb64076380 0x7ffb64078820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.771+0000 7ffb7d7fa640 1 -- 172.21.15.52:0/889789396 --> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb64078ef0 con 0x7ffb64076380 2024-04-25T13:17:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.771+0000 7ffb7d7fa640 1 -- 172.21.15.52:0/889789396 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffb74093050 con 0x7ffb800cccc0 2024-04-25T13:17:20.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.771+0000 7ffb7ffff640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ffb6406c8f0 0x7ffb6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.771+0000 7ffb85775640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] conn(0x7ffb64076380 0x7ffb64078820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.772+0000 7ffb7ffff640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ffb6406c8f0 0x7ffb6406edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffb80154e10 tx=0x7ffb6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.772+0000 7ffb85775640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] conn(0x7ffb64076380 0x7ffb64078820 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.772+0000 7ffb7d7fa640 1 -- 172.21.15.52:0/889789396 <== osd.6 v2:172.21.15.102:6800/1825391266 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb64078ef0 con 0x7ffb64076380 2024-04-25T13:17:20.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.786+0000 7ffb871d8640 1 -- 172.21.15.52:0/889789396 --> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffb80068f50 con 0x7ffb64076380 2024-04-25T13:17:20.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.786+0000 7ffb7d7fa640 1 -- 172.21.15.52:0/889789396 <== osd.6 v2:172.21.15.102:6800/1825391266 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffb80068f50 con 0x7ffb64076380 2024-04-25T13:17:20.786 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:20.787 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:20.787 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.786+0000 7ffb871d8640 1 -- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] conn(0x7ffb64076380 msgr2=0x7ffb64078820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.786+0000 7ffb871d8640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:6800/1825391266,v1:172.21.15.102:6801/1825391266] conn(0x7ffb64076380 0x7ffb64078820 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.786+0000 7ffb871d8640 1 -- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ffb6406c8f0 msgr2=0x7ffb6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.786+0000 7ffb871d8640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ffb6406c8f0 0x7ffb6406edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffb80154e10 tx=0x7ffb6c009040 comp rx=0 tx=0).stop 2024-04-25T13:17:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.786+0000 7ffb871d8640 1 -- 172.21.15.52:0/889789396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb800cccc0 msgr2=0x7ffb8015a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.786+0000 7ffb871d8640 1 --2- 172.21.15.52:0/889789396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb800cccc0 0x7ffb8015a660 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400d830 tx=0x7ffb7400dcf0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.786+0000 7ffb85775640 1 -- 172.21.15.52:0/889789396 reap_dead start 2024-04-25T13:17:20.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.787+0000 7ffb871d8640 1 -- 172.21.15.52:0/889789396 shutdown_connections 2024-04-25T13:17:20.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.787+0000 7ffb871d8640 1 -- 172.21.15.52:0/889789396 >> 172.21.15.52:0/889789396 conn(0x7ffb80074d50 msgr2=0x7ffb80072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.787+0000 7ffb871d8640 1 -- 172.21.15.52:0/889789396 shutdown_connections 2024-04-25T13:17:20.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.787+0000 7ffb871d8640 1 -- 172.21.15.52:0/889789396 wait complete. 2024-04-25T13:17:20.797 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T13:17:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.899+0000 7fd7b56fd640 1 Processor -- start 2024-04-25T13:17:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.899+0000 7fd7b56fd640 1 -- start start 2024-04-25T13:17:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7b56fd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7b01553e0 0x7fd7b015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7b56fd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7b00c7660 0x7fd7b00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7b56fd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b015b600 con 0x7fd7b00c8e60 2024-04-25T13:17:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7b56fd640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b00c8070 con 0x7fd7b01553e0 2024-04-25T13:17:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7b56fd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b015f560 con 0x7fd7b00c7660 2024-04-25T13:17:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7aeffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7b01553e0 0x7fd7b015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7aeffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7b01553e0 0x7fd7b015afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39624/0 (socket says 172.21.15.52:39624) 2024-04-25T13:17:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7aeffd640 1 -- 172.21.15.52:0/4043445700 learned_addr learned my addr 172.21.15.52:0/4043445700 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7af7fe640 1 --2- 172.21.15.52:0/4043445700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7b00c7660 0x7fd7b00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7aeffd640 1 -- 172.21.15.52:0/4043445700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7b00c7660 msgr2=0x7fd7b00cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7aeffd640 1 --2- 172.21.15.52:0/4043445700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7b00c7660 0x7fd7b00cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7aeffd640 1 -- 172.21.15.52:0/4043445700 >> v1:172.21.15.102:6789/0 conn(0x7fd7b00c8e60 legacy=0x7fd7b015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.900+0000 7fd7aeffd640 1 -- 172.21.15.52:0/4043445700 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b015b8e0 con 0x7fd7b01553e0 2024-04-25T13:17:20.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.901+0000 7fd7aeffd640 1 --2- 172.21.15.52:0/4043445700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b01553e0 0x7fd7b015afc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009870 tx=0x7fd7a802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c951aaf8fc43309 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.901+0000 7fd7adffb640 1 -- 172.21.15.52:0/4043445700 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8037070 con 0x7fd7b01553e0 2024-04-25T13:17:20.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.901+0000 7fd7adffb640 1 -- 172.21.15.52:0/4043445700 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a8032440 con 0x7fd7b01553e0 2024-04-25T13:17:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.901+0000 7fd7adffb640 1 -- 172.21.15.52:0/4043445700 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8032810 con 0x7fd7b01553e0 2024-04-25T13:17:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.902+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4043445700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b01553e0 msgr2=0x7fd7b015afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.902+0000 7fd7b56fd640 1 --2- 172.21.15.52:0/4043445700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b01553e0 0x7fd7b015afc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009870 tx=0x7fd7a802a2a0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.902+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4043445700 shutdown_connections 2024-04-25T13:17:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.902+0000 7fd7b56fd640 1 --2- 172.21.15.52:0/4043445700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7b00c7660 0x7fd7b00cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.902+0000 7fd7b56fd640 1 --2- 172.21.15.52:0/4043445700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b01553e0 0x7fd7b015afc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.902+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4043445700 >> 172.21.15.52:0/4043445700 conn(0x7fd7b0074d50 msgr2=0x7fd7b0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.902+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4043445700 shutdown_connections 2024-04-25T13:17:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.902+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4043445700 wait complete. 2024-04-25T13:17:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.903+0000 7fd7b56fd640 1 Processor -- start 2024-04-25T13:17:20.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.903+0000 7fd7b56fd640 1 -- start start 2024-04-25T13:17:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7b56fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7b00c7660 0x7fd7b01558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7b56fd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7b00c8e60 0x7fd7b006f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7b56fd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b01553e0 0x7fd7b01491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7b56fd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b015e930 con 0x7fd7b01553e0 2024-04-25T13:17:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7b56fd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b015e650 con 0x7fd7b00c7660 2024-04-25T13:17:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7b56fd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b00c41e0 con 0x7fd7b00c8e60 2024-04-25T13:17:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7af7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b01553e0 0x7fd7b01491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7aeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7b00c7660 0x7fd7b01558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7af7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b01553e0 0x7fd7b01491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39628/0 (socket says 172.21.15.52:39628) 2024-04-25T13:17:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7af7fe640 1 -- 172.21.15.52:0/4089239182 learned_addr learned my addr 172.21.15.52:0/4089239182 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7ae7fc640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7b00c8e60 0x7fd7b006f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7af7fe640 1 -- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7b00c8e60 msgr2=0x7fd7b006f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7af7fe640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7b00c8e60 0x7fd7b006f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7af7fe640 1 -- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7b00c7660 msgr2=0x7fd7b01558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7af7fe640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7b00c7660 0x7fd7b01558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7af7fe640 1 -- 172.21.15.52:0/4089239182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b00c5950 con 0x7fd7b01553e0 2024-04-25T13:17:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7af7fe640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b01553e0 0x7fd7b01491b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000cc60 tx=0x7fd7a000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7a77fe640 1 -- 172.21.15.52:0/4089239182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0003990 con 0x7fd7b01553e0 2024-04-25T13:17:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7a77fe640 1 -- 172.21.15.52:0/4089239182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a0003b30 con 0x7fd7b01553e0 2024-04-25T13:17:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.904+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4089239182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b0155fa0 con 0x7fd7b01553e0 2024-04-25T13:17:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.905+0000 7fd7a77fe640 1 -- 172.21.15.52:0/4089239182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0004020 con 0x7fd7b01553e0 2024-04-25T13:17:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.905+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4089239182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b0156cd0 con 0x7fd7b01553e0 2024-04-25T13:17:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.906+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4089239182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b0068e40 con 0x7fd7b01553e0 2024-04-25T13:17:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.906+0000 7fd7a77fe640 1 -- 172.21.15.52:0/4089239182 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd7a00041c0 con 0x7fd7b01553e0 2024-04-25T13:17:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.906+0000 7fd7a77fe640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd79006c920 0x7fd79006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.906+0000 7fd7a77fe640 1 -- 172.21.15.52:0/4089239182 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fd7a008c380 con 0x7fd7b01553e0 2024-04-25T13:17:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.907+0000 7fd7aeffd640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd79006c920 0x7fd79006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.907+0000 7fd7aeffd640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd79006c920 0x7fd79006ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8034000 tx=0x7fd7a802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:20.911+0000 7fd7a77fe640 1 -- 172.21.15.52:0/4089239182 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd7a0014030 con 0x7fd7b01553e0 2024-04-25T13:17:21.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.096+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4089239182 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fd7b015be90 con 0x7fd79006c920 2024-04-25T13:17:21.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.097+0000 7fd7a77fe640 1 -- 172.21.15.52:0/4089239182 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd7b015be90 con 0x7fd79006c920 2024-04-25T13:17:21.097 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T13:17:21.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.099+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd79006c920 msgr2=0x7fd79006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.099+0000 7fd7b56fd640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd79006c920 0x7fd79006ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8034000 tx=0x7fd7a802e000 comp rx=0 tx=0).stop 2024-04-25T13:17:21.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.099+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4089239182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b01553e0 msgr2=0x7fd7b01491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.099+0000 7fd7b56fd640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b01553e0 0x7fd7b01491b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000cc60 tx=0x7fd7a000a5c0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.099+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4089239182 shutdown_connections 2024-04-25T13:17:21.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.099+0000 7fd7b56fd640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fd79006c920 0x7fd79006ede0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.099+0000 7fd7b56fd640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7b00c8e60 0x7fd7b006f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.099+0000 7fd7b56fd640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b01553e0 0x7fd7b01491b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.099+0000 7fd7b56fd640 1 --2- 172.21.15.52:0/4089239182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7b00c7660 0x7fd7b01558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.099+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4089239182 >> 172.21.15.52:0/4089239182 conn(0x7fd7b0074d50 msgr2=0x7fd7b0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.099+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4089239182 shutdown_connections 2024-04-25T13:17:21.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.099+0000 7fd7b56fd640 1 -- 172.21.15.52:0/4089239182 wait complete. 2024-04-25T13:17:21.110 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T13:17:21.110 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:21.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.215+0000 7ff8eec31640 1 Processor -- start 2024-04-25T13:17:21.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.216+0000 7ff8eec31640 1 -- start start 2024-04-25T13:17:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.216+0000 7ff8eec31640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8e81556d0 0x7ff8e815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.216+0000 7ff8eec31640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff8e80cc600 0x7ff8e80d0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.216+0000 7ff8eec31640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e80cbb60 con 0x7ff8e80d0dd0 2024-04-25T13:17:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.216+0000 7ff8eec31640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e80b35b0 con 0x7ff8e81556d0 2024-04-25T13:17:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.216+0000 7ff8eec31640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e80b3990 con 0x7ff8e80cc600 2024-04-25T13:17:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.216+0000 7ff8ec9cd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8e81556d0 0x7ff8e815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.216+0000 7ff8ec9cd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8e81556d0 0x7ff8e815bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39634/0 (socket says 172.21.15.52:39634) 2024-04-25T13:17:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.216+0000 7ff8ec9cd640 1 -- 172.21.15.52:0/481332847 learned_addr learned my addr 172.21.15.52:0/481332847 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.217+0000 7ff8e7fff640 1 --2- 172.21.15.52:0/481332847 >> v2:172.21.15.102:3300/0 conn(0x7ff8e80cc600 0x7ff8e80d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.217+0000 7ff8ec9cd640 1 -- 172.21.15.52:0/481332847 >> v2:172.21.15.102:3300/0 conn(0x7ff8e80cc600 msgr2=0x7ff8e80d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.217+0000 7ff8ec9cd640 1 --2- 172.21.15.52:0/481332847 >> v2:172.21.15.102:3300/0 conn(0x7ff8e80cc600 0x7ff8e80d0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.217+0000 7ff8ec9cd640 1 -- 172.21.15.52:0/481332847 >> v1:172.21.15.102:6789/0 conn(0x7ff8e80d0dd0 legacy=0x7ff8e80cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.217+0000 7ff8ec9cd640 1 -- 172.21.15.52:0/481332847 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e80cb5a0 con 0x7ff8e81556d0 2024-04-25T13:17:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.217+0000 7ff8ec9cd640 1 --2- 172.21.15.52:0/481332847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8e81556d0 0x7ff8e815bbf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8155ab0 tx=0x7ff8e002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da942306fcdbca9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.218+0000 7ff8e77fe640 1 -- 172.21.15.52:0/481332847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0036070 con 0x7ff8e81556d0 2024-04-25T13:17:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.218+0000 7ff8e77fe640 1 -- 172.21.15.52:0/481332847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e0031600 con 0x7ff8e81556d0 2024-04-25T13:17:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.218+0000 7ff8e77fe640 1 -- 172.21.15.52:0/481332847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00319d0 con 0x7ff8e81556d0 2024-04-25T13:17:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.218+0000 7ff8eec31640 1 -- 172.21.15.52:0/481332847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8e81556d0 msgr2=0x7ff8e815bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.218+0000 7ff8eec31640 1 --2- 172.21.15.52:0/481332847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8e81556d0 0x7ff8e815bbf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8155ab0 tx=0x7ff8e002a6f0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.218+0000 7ff8eec31640 1 -- 172.21.15.52:0/481332847 shutdown_connections 2024-04-25T13:17:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.218+0000 7ff8eec31640 1 --2- 172.21.15.52:0/481332847 >> v2:172.21.15.102:3300/0 conn(0x7ff8e80cc600 0x7ff8e80d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.218+0000 7ff8eec31640 1 --2- 172.21.15.52:0/481332847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8e81556d0 0x7ff8e815bbf0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.218+0000 7ff8eec31640 1 -- 172.21.15.52:0/481332847 >> 172.21.15.52:0/481332847 conn(0x7ff8e8068360 msgr2=0x7ff8e8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.218+0000 7ff8eec31640 1 -- 172.21.15.52:0/481332847 shutdown_connections 2024-04-25T13:17:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.218+0000 7ff8eec31640 1 -- 172.21.15.52:0/481332847 wait complete. 2024-04-25T13:17:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.219+0000 7ff8eec31640 1 Processor -- start 2024-04-25T13:17:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.219+0000 7ff8eec31640 1 -- start start 2024-04-25T13:17:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.220+0000 7ff8eec31640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8e80cc600 0x7ff8e81e4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.220+0000 7ff8eec31640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8e80d0dd0 0x7ff8e8159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.220+0000 7ff8eec31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8e81556d0 0x7ff8e80c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.220+0000 7ff8eec31640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e80cbd70 con 0x7ff8e80d0dd0 2024-04-25T13:17:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.220+0000 7ff8eec31640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e80b3c30 con 0x7ff8e81556d0 2024-04-25T13:17:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.220+0000 7ff8eec31640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e80cbef0 con 0x7ff8e80cc600 2024-04-25T13:17:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.220+0000 7ff8e7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8e80d0dd0 0x7ff8e8159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.220+0000 7ff8e7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8e80d0dd0 0x7ff8e8159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39650/0 (socket says 172.21.15.52:39650) 2024-04-25T13:17:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.220+0000 7ff8e7fff640 1 -- 172.21.15.52:0/777417269 learned_addr learned my addr 172.21.15.52:0/777417269 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.220+0000 7ff8ed1ce640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8e81556d0 0x7ff8e80c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.220+0000 7ff8ec9cd640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8e80cc600 0x7ff8e81e4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.221+0000 7ff8e7fff640 1 -- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8e80cc600 msgr2=0x7ff8e81e4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.221+0000 7ff8e7fff640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8e80cc600 0x7ff8e81e4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.221+0000 7ff8e7fff640 1 -- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8e81556d0 msgr2=0x7ff8e80c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.221+0000 7ff8e7fff640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8e81556d0 0x7ff8e80c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.221+0000 7ff8e7fff640 1 -- 172.21.15.52:0/777417269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e80c72b0 con 0x7ff8e80d0dd0 2024-04-25T13:17:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.221+0000 7ff8e7fff640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8e80d0dd0 0x7ff8e8159f40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000d620 tx=0x7ff8d000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.221+0000 7ff8e57fa640 1 -- 172.21.15.52:0/777417269 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00125f0 con 0x7ff8e80d0dd0 2024-04-25T13:17:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.221+0000 7ff8e57fa640 1 -- 172.21.15.52:0/777417269 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d0019070 con 0x7ff8e80d0dd0 2024-04-25T13:17:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.221+0000 7ff8eec31640 1 -- 172.21.15.52:0/777417269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e81f22a0 con 0x7ff8e80d0dd0 2024-04-25T13:17:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.221+0000 7ff8e57fa640 1 -- 172.21.15.52:0/777417269 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00129d0 con 0x7ff8e80d0dd0 2024-04-25T13:17:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.221+0000 7ff8eec31640 1 -- 172.21.15.52:0/777417269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e81f14e0 con 0x7ff8e80d0dd0 2024-04-25T13:17:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.222+0000 7ff8eec31640 1 -- 172.21.15.52:0/777417269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff8e8068f50 con 0x7ff8e80d0dd0 2024-04-25T13:17:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.222+0000 7ff8e57fa640 1 -- 172.21.15.52:0/777417269 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff8d0012b70 con 0x7ff8e80d0dd0 2024-04-25T13:17:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.223+0000 7ff8e57fa640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff8c806c8f0 0x7ff8c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.223+0000 7ff8e57fa640 1 -- 172.21.15.52:0/777417269 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ff8d008c290 con 0x7ff8e80d0dd0 2024-04-25T13:17:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.223+0000 7ff8ec9cd640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff8c806c8f0 0x7ff8c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.223+0000 7ff8e57fa640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] conn(0x7ff8c8076390 0x7ff8c8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.223+0000 7ff8e57fa640 1 -- 172.21.15.52:0/777417269 --> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8c8078f00 con 0x7ff8c8076390 2024-04-25T13:17:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.223+0000 7ff8e57fa640 1 -- 172.21.15.52:0/777417269 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff8d0093050 con 0x7ff8e80d0dd0 2024-04-25T13:17:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.223+0000 7ff8ed1ce640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] conn(0x7ff8c8076390 0x7ff8c8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.224+0000 7ff8ec9cd640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff8c806c8f0 0x7ff8c806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0033000 tx=0x7ff8e0009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.224+0000 7ff8ed1ce640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] conn(0x7ff8c8076390 0x7ff8c8078830 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.225+0000 7ff8e57fa640 1 -- 172.21.15.52:0/777417269 <== osd.7 v2:172.21.15.102:6816/3909993822 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff8c8078f00 con 0x7ff8c8076390 2024-04-25T13:17:21.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.238+0000 7ff8eec31640 1 -- 172.21.15.52:0/777417269 --> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff8e8074d50 con 0x7ff8c8076390 2024-04-25T13:17:21.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.238+0000 7ff8e57fa640 1 -- 172.21.15.52:0/777417269 <== osd.7 v2:172.21.15.102:6816/3909993822 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff8e8074d50 con 0x7ff8c8076390 2024-04-25T13:17:21.239 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T13:17:21.239 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:21.239 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T13:17:21.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.239+0000 7ff8eec31640 1 -- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] conn(0x7ff8c8076390 msgr2=0x7ff8c8078830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.239+0000 7ff8eec31640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:6816/3909993822,v1:172.21.15.102:6817/3909993822] conn(0x7ff8c8076390 0x7ff8c8078830 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.239+0000 7ff8eec31640 1 -- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff8c806c8f0 msgr2=0x7ff8c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.239+0000 7ff8eec31640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7ff8c806c8f0 0x7ff8c806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0033000 tx=0x7ff8e0009000 comp rx=0 tx=0).stop 2024-04-25T13:17:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.239+0000 7ff8eec31640 1 -- 172.21.15.52:0/777417269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8e80d0dd0 msgr2=0x7ff8e8159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.239+0000 7ff8eec31640 1 --2- 172.21.15.52:0/777417269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8e80d0dd0 0x7ff8e8159f40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000d620 tx=0x7ff8d000dae0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.239+0000 7ff8ed1ce640 1 -- 172.21.15.52:0/777417269 reap_dead start 2024-04-25T13:17:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.239+0000 7ff8eec31640 1 -- 172.21.15.52:0/777417269 shutdown_connections 2024-04-25T13:17:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.239+0000 7ff8eec31640 1 -- 172.21.15.52:0/777417269 >> 172.21.15.52:0/777417269 conn(0x7ff8e8068360 msgr2=0x7ff8e81535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.239+0000 7ff8eec31640 1 -- 172.21.15.52:0/777417269 shutdown_connections 2024-04-25T13:17:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.239+0000 7ff8eec31640 1 -- 172.21.15.52:0/777417269 wait complete. 2024-04-25T13:17:21.250 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T13:17:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.351+0000 7fcb2a3bf640 1 Processor -- start 2024-04-25T13:17:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.351+0000 7fcb2a3bf640 1 -- start start 2024-04-25T13:17:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.352+0000 7fcb2a3bf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240b3c00 0x7fcb240b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.352+0000 7fcb2a3bf640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb240b5450 0x7fcb240d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.352+0000 7fcb2a3bf640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb241558c0 con 0x7fcb241554e0 2024-04-25T13:17:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.352+0000 7fcb2a3bf640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fcb240b4a80 con 0x7fcb240b5450 2024-04-25T13:17:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.352+0000 7fcb2a3bf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcb240cb8c0 con 0x7fcb240b3c00 2024-04-25T13:17:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.352+0000 7fcb23fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcb241554e0 0x7fcb2415f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55214/0 (socket says 172.21.15.52:55214) 2024-04-25T13:17:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.352+0000 7fcb23fff640 1 -- 172.21.15.52:0/2827363056 learned_addr learned my addr 172.21.15.52:0/2827363056 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.352+0000 7fcb2895c640 1 --2- 172.21.15.52:0/2827363056 >> v2:172.21.15.102:3300/0 conn(0x7fcb240b5450 0x7fcb240d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb237fe640 1 --2- 172.21.15.52:0/2827363056 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240b3c00 0x7fcb240b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3098519331 0 0) 0x7fcb0c001110 con 0x7fcb241554e0 2024-04-25T13:17:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb10003520 con 0x7fcb241554e0 2024-04-25T13:17:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 697695378 0 0) 0x7fcb10003520 con 0x7fcb241554e0 2024-04-25T13:17:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240b3c00 msgr2=0x7fcb240b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 --2- 172.21.15.52:0/2827363056 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240b3c00 0x7fcb240b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 >> v2:172.21.15.102:3300/0 conn(0x7fcb240b5450 msgr2=0x7fcb240d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 --2- 172.21.15.52:0/2827363056 >> v2:172.21.15.102:3300/0 conn(0x7fcb240b5450 0x7fcb240d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb240cbba0 con 0x7fcb241554e0 2024-04-25T13:17:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3214555185 0 0) 0x7fcb0c001840 con 0x7fcb241554e0 2024-04-25T13:17:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 >> v1:172.21.15.52:6789/0 conn(0x7fcb241554e0 legacy=0x7fcb2415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 --2- 172.21.15.52:0/2827363056 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240b3c00 0x7fcb100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 --2- 172.21.15.52:0/2827363056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb10003f30 0x7fcb10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 --2- 172.21.15.52:0/2827363056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb10004d40 0x7fcb100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb240b4a80 con 0x7fcb10004d40 2024-04-25T13:17:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcb240cb8c0 con 0x7fcb10003f30 2024-04-25T13:17:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcb1000b9f0 con 0x7fcb240b3c00 2024-04-25T13:17:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb2895c640 1 --2- 172.21.15.52:0/2827363056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb10004d40 0x7fcb100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb23fff640 1 --2- 172.21.15.52:0/2827363056 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240b3c00 0x7fcb100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb237fe640 1 --2- 172.21.15.52:0/2827363056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb10003f30 0x7fcb10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb2895c640 1 -- 172.21.15.52:0/2827363056 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240b3c00 msgr2=0x7fcb100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb2895c640 1 --2- 172.21.15.52:0/2827363056 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240b3c00 0x7fcb100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb2895c640 1 -- 172.21.15.52:0/2827363056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb10003f30 msgr2=0x7fcb10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb2895c640 1 --2- 172.21.15.52:0/2827363056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb10003f30 0x7fcb10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.353+0000 7fcb2895c640 1 -- 172.21.15.52:0/2827363056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb10003520 con 0x7fcb10004d40 2024-04-25T13:17:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.354+0000 7fcb2895c640 1 --2- 172.21.15.52:0/2827363056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb10004d40 0x7fcb100051c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009f90 tx=0x7fcb10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7bec4eb1bf2911 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.354+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c009c10 con 0x7fcb10004d40 2024-04-25T13:17:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.354+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c036070 con 0x7fcb10004d40 2024-04-25T13:17:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.354+0000 7fcb22ffd640 1 -- 172.21.15.52:0/2827363056 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c031840 con 0x7fcb10004d40 2024-04-25T13:17:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.355+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/2827363056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb10004d40 msgr2=0x7fcb100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.355+0000 7fcb2a3bf640 1 --2- 172.21.15.52:0/2827363056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb10004d40 0x7fcb100051c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009f90 tx=0x7fcb10005830 comp rx=0 tx=0).stop 2024-04-25T13:17:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.355+0000 7fcb2895c640 1 -- 172.21.15.52:0/2827363056 reap_dead start 2024-04-25T13:17:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.355+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/2827363056 shutdown_connections 2024-04-25T13:17:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.355+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/2827363056 >> 172.21.15.52:0/2827363056 conn(0x7fcb24074d50 msgr2=0x7fcb24075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.355+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/2827363056 shutdown_connections 2024-04-25T13:17:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.355+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/2827363056 wait complete. 2024-04-25T13:17:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.356+0000 7fcb2a3bf640 1 Processor -- start 2024-04-25T13:17:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.356+0000 7fcb2a3bf640 1 -- start start 2024-04-25T13:17:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2a3bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb10004d40 0x7fcb241f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2a3bf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240ccab0 0x7fcb240ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2a3bf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2415e190 0x7fcb241e4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2a3bf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb240b4710 con 0x7fcb2415e190 2024-04-25T13:17:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2a3bf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcb240b4430 con 0x7fcb10004d40 2024-04-25T13:17:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2a3bf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcb240b3580 con 0x7fcb240ccab0 2024-04-25T13:17:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2895c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2415e190 0x7fcb241e4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2895c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2415e190 0x7fcb241e4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39668/0 (socket says 172.21.15.52:39668) 2024-04-25T13:17:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2895c640 1 -- 172.21.15.52:0/1105609928 learned_addr learned my addr 172.21.15.52:0/1105609928 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb23fff640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb10004d40 0x7fcb241f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb237fe640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240ccab0 0x7fcb240ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2895c640 1 -- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240ccab0 msgr2=0x7fcb240ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2895c640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240ccab0 0x7fcb240ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2895c640 1 -- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb10004d40 msgr2=0x7fcb241f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2895c640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb10004d40 0x7fcb241f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2895c640 1 -- 172.21.15.52:0/1105609928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2415ebd0 con 0x7fcb2415e190 2024-04-25T13:17:21.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.357+0000 7fcb2895c640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2415e190 0x7fcb241e4f90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00e230 tx=0x7fcb1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.358+0000 7fcb20ff9640 1 -- 172.21.15.52:0/1105609928 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c009c10 con 0x7fcb2415e190 2024-04-25T13:17:21.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.358+0000 7fcb20ff9640 1 -- 172.21.15.52:0/1105609928 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c040030 con 0x7fcb2415e190 2024-04-25T13:17:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.358+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/1105609928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2415eeb0 con 0x7fcb2415e190 2024-04-25T13:17:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.358+0000 7fcb20ff9640 1 -- 172.21.15.52:0/1105609928 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c031e60 con 0x7fcb2415e190 2024-04-25T13:17:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.358+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/1105609928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb240ca790 con 0x7fcb2415e190 2024-04-25T13:17:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.359+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/1105609928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb24075660 con 0x7fcb2415e190 2024-04-25T13:17:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.359+0000 7fcb20ff9640 1 -- 172.21.15.52:0/1105609928 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb1c005d10 con 0x7fcb2415e190 2024-04-25T13:17:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.360+0000 7fcb20ff9640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcb0406c920 0x7fcb0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.360+0000 7fcb20ff9640 1 -- 172.21.15.52:0/1105609928 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fcb1c0ad140 con 0x7fcb2415e190 2024-04-25T13:17:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.360+0000 7fcb23fff640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcb0406c920 0x7fcb0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.360+0000 7fcb23fff640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcb0406c920 0x7fcb0406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0017c0 tx=0x7fcb0c007ac0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.364+0000 7fcb20ff9640 1 -- 172.21.15.52:0/1105609928 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcb24075660 con 0x7fcb2415e190 2024-04-25T13:17:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.551+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/1105609928 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fcb24068e40 con 0x7fcb0406c920 2024-04-25T13:17:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.552+0000 7fcb20ff9640 1 -- 172.21.15.52:0/1105609928 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcb24068e40 con 0x7fcb0406c920 2024-04-25T13:17:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T13:17:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.554+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcb0406c920 msgr2=0x7fcb0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.554+0000 7fcb2a3bf640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcb0406c920 0x7fcb0406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0017c0 tx=0x7fcb0c007ac0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.554+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/1105609928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2415e190 msgr2=0x7fcb241e4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.554+0000 7fcb2a3bf640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2415e190 0x7fcb241e4f90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00e230 tx=0x7fcb1c009750 comp rx=0 tx=0).stop 2024-04-25T13:17:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.554+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/1105609928 shutdown_connections 2024-04-25T13:17:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.554+0000 7fcb2a3bf640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fcb0406c920 0x7fcb0406ede0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.554+0000 7fcb2a3bf640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb240ccab0 0x7fcb240ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.554+0000 7fcb2a3bf640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2415e190 0x7fcb241e4f90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.554+0000 7fcb2a3bf640 1 --2- 172.21.15.52:0/1105609928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb10004d40 0x7fcb241f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.554+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/1105609928 >> 172.21.15.52:0/1105609928 conn(0x7fcb24074d50 msgr2=0x7fcb240ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.554+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/1105609928 shutdown_connections 2024-04-25T13:17:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.554+0000 7fcb2a3bf640 1 -- 172.21.15.52:0/1105609928 wait complete. 2024-04-25T13:17:21.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:21.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.666+0000 7fc536cd0640 1 Processor -- start 2024-04-25T13:17:21.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.666+0000 7fc536cd0640 1 -- start start 2024-04-25T13:17:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc536cd0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5301554e0 0x7fc53015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc536cd0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5300d08a0 0x7fc5300d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc536cd0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5301558c0 con 0x7fc5300b3c00 2024-04-25T13:17:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc536cd0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc5300b4a80 con 0x7fc5301554e0 2024-04-25T13:17:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc536cd0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc53015f630 con 0x7fc5300d08a0 2024-04-25T13:17:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc534a6c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5301554e0 0x7fc53015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc534a6c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5301554e0 0x7fc53015f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39670/0 (socket says 172.21.15.52:39670) 2024-04-25T13:17:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc534a6c640 1 -- 172.21.15.52:0/3817351648 learned_addr learned my addr 172.21.15.52:0/3817351648 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc53526d640 1 --2- 172.21.15.52:0/3817351648 >> v2:172.21.15.102:3300/0 conn(0x7fc5300d08a0 0x7fc5300d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc534a6c640 1 -- 172.21.15.52:0/3817351648 >> v2:172.21.15.102:3300/0 conn(0x7fc5300d08a0 msgr2=0x7fc5300d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc534a6c640 1 --2- 172.21.15.52:0/3817351648 >> v2:172.21.15.102:3300/0 conn(0x7fc5300d08a0 0x7fc5300d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc534a6c640 1 -- 172.21.15.52:0/3817351648 >> v1:172.21.15.102:6789/0 conn(0x7fc5300b3c00 legacy=0x7fc5300b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.667+0000 7fc534a6c640 1 -- 172.21.15.52:0/3817351648 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5300cb8c0 con 0x7fc5301554e0 2024-04-25T13:17:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.668+0000 7fc534a6c640 1 --2- 172.21.15.52:0/3817351648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5301554e0 0x7fc53015f0f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc530072cf0 tx=0x7fc52402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d117fc9bb7568fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.668+0000 7fc52f7fe640 1 -- 172.21.15.52:0/3817351648 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc524037070 con 0x7fc5301554e0 2024-04-25T13:17:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.668+0000 7fc52f7fe640 1 -- 172.21.15.52:0/3817351648 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc52402ae50 con 0x7fc5301554e0 2024-04-25T13:17:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.668+0000 7fc52f7fe640 1 -- 172.21.15.52:0/3817351648 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc524032860 con 0x7fc5301554e0 2024-04-25T13:17:21.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.668+0000 7fc536cd0640 1 -- 172.21.15.52:0/3817351648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5301554e0 msgr2=0x7fc53015f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.668+0000 7fc536cd0640 1 --2- 172.21.15.52:0/3817351648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5301554e0 0x7fc53015f0f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc530072cf0 tx=0x7fc52402a300 comp rx=0 tx=0).stop 2024-04-25T13:17:21.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.669+0000 7fc536cd0640 1 -- 172.21.15.52:0/3817351648 shutdown_connections 2024-04-25T13:17:21.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.669+0000 7fc536cd0640 1 --2- 172.21.15.52:0/3817351648 >> v2:172.21.15.102:3300/0 conn(0x7fc5300d08a0 0x7fc5300d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.669+0000 7fc536cd0640 1 --2- 172.21.15.52:0/3817351648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5301554e0 0x7fc53015f0f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.669+0000 7fc536cd0640 1 -- 172.21.15.52:0/3817351648 >> 172.21.15.52:0/3817351648 conn(0x7fc530074d50 msgr2=0x7fc530075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.669+0000 7fc536cd0640 1 -- 172.21.15.52:0/3817351648 shutdown_connections 2024-04-25T13:17:21.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.669+0000 7fc536cd0640 1 -- 172.21.15.52:0/3817351648 wait complete. 2024-04-25T13:17:21.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.670+0000 7fc536cd0640 1 Processor -- start 2024-04-25T13:17:21.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.670+0000 7fc536cd0640 1 -- start start 2024-04-25T13:17:21.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.670+0000 7fc536cd0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5300b3c00 0x7fc53014e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.670+0000 7fc536cd0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5300d08a0 0x7fc5300ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.670+0000 7fc536cd0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5301554e0 0x7fc5300ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc536cd0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5300b4430 con 0x7fc5300d08a0 2024-04-25T13:17:21.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc536cd0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc5300b4150 con 0x7fc5301554e0 2024-04-25T13:17:21.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc536cd0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc5300b4710 con 0x7fc5300b3c00 2024-04-25T13:17:21.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc52ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5300d08a0 0x7fc5300ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc52ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5300d08a0 0x7fc5300ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39682/0 (socket says 172.21.15.52:39682) 2024-04-25T13:17:21.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc52ffff640 1 -- 172.21.15.52:0/3499418692 learned_addr learned my addr 172.21.15.52:0/3499418692 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:21.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc53526d640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5301554e0 0x7fc5300ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc534a6c640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5300b3c00 0x7fc53014e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc52ffff640 1 -- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5300b3c00 msgr2=0x7fc53014e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc52ffff640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5300b3c00 0x7fc53014e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc52ffff640 1 -- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5301554e0 msgr2=0x7fc5300ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc52ffff640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5301554e0 0x7fc5300ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc52ffff640 1 -- 172.21.15.52:0/3499418692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53015f220 con 0x7fc5300d08a0 2024-04-25T13:17:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc52ffff640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5300d08a0 0x7fc5300ca0b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00c430 tx=0x7fc51c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc52d7fa640 1 -- 172.21.15.52:0/3499418692 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c017070 con 0x7fc5300d08a0 2024-04-25T13:17:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc52d7fa640 1 -- 172.21.15.52:0/3499418692 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc51c0052d0 con 0x7fc5300d08a0 2024-04-25T13:17:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc536cd0640 1 -- 172.21.15.52:0/3499418692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc53014bc20 con 0x7fc5300d08a0 2024-04-25T13:17:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc52d7fa640 1 -- 172.21.15.52:0/3499418692 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c003850 con 0x7fc5300d08a0 2024-04-25T13:17:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.671+0000 7fc536cd0640 1 -- 172.21.15.52:0/3499418692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc53014c1e0 con 0x7fc5300d08a0 2024-04-25T13:17:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.672+0000 7fc536cd0640 1 -- 172.21.15.52:0/3499418692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc530068e40 con 0x7fc5300d08a0 2024-04-25T13:17:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.673+0000 7fc52d7fa640 1 -- 172.21.15.52:0/3499418692 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc51c01a070 con 0x7fc5300d08a0 2024-04-25T13:17:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.673+0000 7fc52d7fa640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc51406c8f0 0x7fc51406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.673+0000 7fc52d7fa640 1 -- 172.21.15.52:0/3499418692 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fc51c08b310 con 0x7fc5300d08a0 2024-04-25T13:17:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.674+0000 7fc534a6c640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc51406c8f0 0x7fc51406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.674+0000 7fc534a6c640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc51406c8f0 0x7fc51406edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc524034000 tx=0x7fc52402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.678+0000 7fc52d7fa640 1 -- 172.21.15.52:0/3499418692 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5301558c0 con 0x7fc5300d08a0 2024-04-25T13:17:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.857+0000 7fc536cd0640 1 -- 172.21.15.52:0/3499418692 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc53015efd0 con 0x7fc51406c8f0 2024-04-25T13:17:21.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.865+0000 7fc52d7fa640 1 -- 172.21.15.52:0/3499418692 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+330441 (secure 0 0 0) 0x7fc53015efd0 con 0x7fc51406c8f0 2024-04-25T13:17:21.868 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:17:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T13:17:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.868+0000 7fc536cd0640 1 -- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc51406c8f0 msgr2=0x7fc51406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.868+0000 7fc536cd0640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc51406c8f0 0x7fc51406edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc524034000 tx=0x7fc52402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.868+0000 7fc536cd0640 1 -- 172.21.15.52:0/3499418692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5300d08a0 msgr2=0x7fc5300ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.868+0000 7fc536cd0640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5300d08a0 0x7fc5300ca0b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00c430 tx=0x7fc51c00c8f0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.868+0000 7fc536cd0640 1 -- 172.21.15.52:0/3499418692 shutdown_connections 2024-04-25T13:17:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.868+0000 7fc536cd0640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fc51406c8f0 0x7fc51406edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.868+0000 7fc536cd0640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5301554e0 0x7fc5300ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.868+0000 7fc536cd0640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5300d08a0 0x7fc5300ca0b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.868+0000 7fc536cd0640 1 --2- 172.21.15.52:0/3499418692 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5300b3c00 0x7fc53014e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.868+0000 7fc536cd0640 1 -- 172.21.15.52:0/3499418692 >> 172.21.15.52:0/3499418692 conn(0x7fc530074d50 msgr2=0x7fc530151f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.868+0000 7fc536cd0640 1 -- 172.21.15.52:0/3499418692 shutdown_connections 2024-04-25T13:17:21.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:21.868+0000 7fc536cd0640 1 -- 172.21.15.52:0/3499418692 wait complete. 2024-04-25T13:17:21.879 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-04-25T13:17:21.837128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":328,"ondisk_log_size":328,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236456,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738264,"statfs":{"total":773094113280,"available":772851982336,"internally_reserved":0,"allocated":3776512,"data_stored":2178536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":564,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003155"},"pg_stats":[{"pgid":"2.1f","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.421059+0000","last_change":"2024-04-25T13:17:19.421088+0000","last_active":"2024-04-25T13:17:19.421059+0000","last_peered":"2024-04-25T13:17:19.421059+0000","last_clean":"2024-04-25T13:17:19.421059+0000","last_became_active":"2024-04-25T13:16:07.000746+0000","last_became_peered":"2024-04-25T13:16:07.000746+0000","last_unstale":"2024-04-25T13:17:19.421059+0000","last_undegraded":"2024-04-25T13:17:19.421059+0000","last_fullsized":"2024-04-25T13:17:19.421059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-25T13:17:19.420993+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-25T13:17:19.420993+0000","last_clean_scrub_stamp":"2024-04-25T13:17:19.420993+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:40.185836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235981+0000","last_change":"2024-04-25T13:16:08.012928+0000","last_active":"2024-04-25T13:16:49.235981+0000","last_peered":"2024-04-25T13:16:49.235981+0000","last_clean":"2024-04-25T13:16:49.235981+0000","last_became_active":"2024-04-25T13:16:08.012114+0000","last_became_peered":"2024-04-25T13:16:08.012114+0000","last_unstale":"2024-04-25T13:16:49.235981+0000","last_undegraded":"2024-04-25T13:16:49.235981+0000","last_fullsized":"2024-04-25T13:16:49.235981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235631+0000","last_change":"2024-04-25T13:16:12.734829+0000","last_active":"2024-04-25T13:16:49.235631+0000","last_peered":"2024-04-25T13:16:49.235631+0000","last_clean":"2024-04-25T13:16:49.235631+0000","last_became_active":"2024-04-25T13:16:12.734390+0000","last_became_peered":"2024-04-25T13:16:12.734390+0000","last_unstale":"2024-04-25T13:16:49.235631+0000","last_undegraded":"2024-04-25T13:16:49.235631+0000","last_fullsized":"2024-04-25T13:16:49.235631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236167+0000","last_change":"2024-04-25T13:16:06.999440+0000","last_active":"2024-04-25T13:16:49.236167+0000","last_peered":"2024-04-25T13:16:49.236167+0000","last_clean":"2024-04-25T13:16:49.236167+0000","last_became_active":"2024-04-25T13:16:06.999078+0000","last_became_peered":"2024-04-25T13:16:06.999078+0000","last_unstale":"2024-04-25T13:16:49.236167+0000","last_undegraded":"2024-04-25T13:16:49.236167+0000","last_fullsized":"2024-04-25T13:16:49.236167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133642+0000","last_change":"2024-04-25T13:16:08.012743+0000","last_active":"2024-04-25T13:16:49.133642+0000","last_peered":"2024-04-25T13:16:49.133642+0000","last_clean":"2024-04-25T13:16:49.133642+0000","last_became_active":"2024-04-25T13:16:08.012036+0000","last_became_peered":"2024-04-25T13:16:08.012036+0000","last_unstale":"2024-04-25T13:16:49.133642+0000","last_undegraded":"2024-04-25T13:16:49.133642+0000","last_fullsized":"2024-04-25T13:16:49.133642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.238290+0000","last_change":"2024-04-25T13:16:49.238290+0000","last_active":"2024-04-25T13:16:49.238290+0000","last_peered":"2024-04-25T13:16:49.238290+0000","last_clean":"2024-04-25T13:16:49.238290+0000","last_became_active":"2024-04-25T13:16:49.237674+0000","last_became_peered":"2024-04-25T13:16:49.237674+0000","last_unstale":"2024-04-25T13:16:49.238290+0000","last_undegraded":"2024-04-25T13:16:49.238290+0000","last_fullsized":"2024-04-25T13:16:49.238290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:32.550364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.149564+0000","last_change":"2024-04-25T13:16:07.001022+0000","last_active":"2024-04-25T13:16:56.149564+0000","last_peered":"2024-04-25T13:16:56.149564+0000","last_clean":"2024-04-25T13:16:56.149564+0000","last_became_active":"2024-04-25T13:16:07.000751+0000","last_became_peered":"2024-04-25T13:16:07.000751+0000","last_unstale":"2024-04-25T13:16:56.149564+0000","last_undegraded":"2024-04-25T13:16:56.149564+0000","last_fullsized":"2024-04-25T13:16:56.149564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:11.597397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131104+0000","last_change":"2024-04-25T13:16:08.011361+0000","last_active":"2024-04-25T13:16:49.131104+0000","last_peered":"2024-04-25T13:16:49.131104+0000","last_clean":"2024-04-25T13:16:49.131104+0000","last_became_active":"2024-04-25T13:16:08.011073+0000","last_became_peered":"2024-04-25T13:16:08.011073+0000","last_unstale":"2024-04-25T13:16:49.131104+0000","last_undegraded":"2024-04-25T13:16:49.131104+0000","last_fullsized":"2024-04-25T13:16:49.131104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:00.471410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.238066+0000","last_change":"2024-04-25T13:16:49.238066+0000","last_active":"2024-04-25T13:16:49.238066+0000","last_peered":"2024-04-25T13:16:49.238066+0000","last_clean":"2024-04-25T13:16:49.238066+0000","last_became_active":"2024-04-25T13:16:49.237565+0000","last_became_peered":"2024-04-25T13:16:49.237565+0000","last_unstale":"2024-04-25T13:16:49.238066+0000","last_undegraded":"2024-04-25T13:16:49.238066+0000","last_fullsized":"2024-04-25T13:16:49.238066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:15.893235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.151020+0000","last_change":"2024-04-25T13:16:07.003774+0000","last_active":"2024-04-25T13:16:56.151020+0000","last_peered":"2024-04-25T13:16:56.151020+0000","last_clean":"2024-04-25T13:16:56.151020+0000","last_became_active":"2024-04-25T13:16:07.003493+0000","last_became_peered":"2024-04-25T13:16:07.003493+0000","last_unstale":"2024-04-25T13:16:56.151020+0000","last_undegraded":"2024-04-25T13:16:56.151020+0000","last_fullsized":"2024-04-25T13:16:56.151020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:12.940812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130266+0000","last_change":"2024-04-25T13:16:08.012084+0000","last_active":"2024-04-25T13:16:49.130266+0000","last_peered":"2024-04-25T13:16:49.130266+0000","last_clean":"2024-04-25T13:16:49.130266+0000","last_became_active":"2024-04-25T13:16:08.011634+0000","last_became_peered":"2024-04-25T13:16:08.011634+0000","last_unstale":"2024-04-25T13:16:49.130266+0000","last_undegraded":"2024-04-25T13:16:49.130266+0000","last_fullsized":"2024-04-25T13:16:49.130266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:26.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132146+0000","last_change":"2024-04-25T13:16:12.039238+0000","last_active":"2024-04-25T13:16:49.132146+0000","last_peered":"2024-04-25T13:16:49.132146+0000","last_clean":"2024-04-25T13:16:49.132146+0000","last_became_active":"2024-04-25T13:16:12.038508+0000","last_became_peered":"2024-04-25T13:16:12.038508+0000","last_unstale":"2024-04-25T13:16:49.132146+0000","last_undegraded":"2024-04-25T13:16:49.132146+0000","last_fullsized":"2024-04-25T13:16:49.132146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:22.183373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235784+0000","last_change":"2024-04-25T13:16:08.007741+0000","last_active":"2024-04-25T13:16:49.235784+0000","last_peered":"2024-04-25T13:16:49.235784+0000","last_clean":"2024-04-25T13:16:49.235784+0000","last_became_active":"2024-04-25T13:16:08.007478+0000","last_became_peered":"2024-04-25T13:16:08.007478+0000","last_unstale":"2024-04-25T13:16:49.235784+0000","last_undegraded":"2024-04-25T13:16:49.235784+0000","last_fullsized":"2024-04-25T13:16:49.235784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:49.162203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131314+0000","last_change":"2024-04-25T13:16:07.001183+0000","last_active":"2024-04-25T13:16:49.131314+0000","last_peered":"2024-04-25T13:16:49.131314+0000","last_clean":"2024-04-25T13:16:49.131314+0000","last_became_active":"2024-04-25T13:16:07.000880+0000","last_became_peered":"2024-04-25T13:16:07.000880+0000","last_unstale":"2024-04-25T13:16:49.131314+0000","last_undegraded":"2024-04-25T13:16:49.131314+0000","last_fullsized":"2024-04-25T13:16:49.131314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:27.250349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132664+0000","last_change":"2024-04-25T13:16:12.037074+0000","last_active":"2024-04-25T13:16:49.132664+0000","last_peered":"2024-04-25T13:16:49.132664+0000","last_clean":"2024-04-25T13:16:49.132664+0000","last_became_active":"2024-04-25T13:16:12.036508+0000","last_became_peered":"2024-04-25T13:16:12.036508+0000","last_unstale":"2024-04-25T13:16:49.132664+0000","last_undegraded":"2024-04-25T13:16:49.132664+0000","last_fullsized":"2024-04-25T13:16:49.132664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:01.380469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235923+0000","last_change":"2024-04-25T13:16:08.013538+0000","last_active":"2024-04-25T13:16:49.235923+0000","last_peered":"2024-04-25T13:16:49.235923+0000","last_clean":"2024-04-25T13:16:49.235923+0000","last_became_active":"2024-04-25T13:16:08.013269+0000","last_became_peered":"2024-04-25T13:16:08.013269+0000","last_unstale":"2024-04-25T13:16:49.235923+0000","last_undegraded":"2024-04-25T13:16:49.235923+0000","last_fullsized":"2024-04-25T13:16:49.235923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.139961+0000","last_change":"2024-04-25T13:16:06.994106+0000","last_active":"2024-04-25T13:16:56.139961+0000","last_peered":"2024-04-25T13:16:56.139961+0000","last_clean":"2024-04-25T13:16:56.139961+0000","last_became_active":"2024-04-25T13:16:06.993807+0000","last_became_peered":"2024-04-25T13:16:06.993807+0000","last_unstale":"2024-04-25T13:16:56.139961+0000","last_undegraded":"2024-04-25T13:16:56.139961+0000","last_fullsized":"2024-04-25T13:16:56.139961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131943+0000","last_change":"2024-04-25T13:16:12.039421+0000","last_active":"2024-04-25T13:16:49.131943+0000","last_peered":"2024-04-25T13:16:49.131943+0000","last_clean":"2024-04-25T13:16:49.131943+0000","last_became_active":"2024-04-25T13:16:12.038953+0000","last_became_peered":"2024-04-25T13:16:12.038953+0000","last_unstale":"2024-04-25T13:16:49.131943+0000","last_undegraded":"2024-04-25T13:16:49.131943+0000","last_fullsized":"2024-04-25T13:16:49.131943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:26.714224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236328+0000","last_change":"2024-04-25T13:16:08.008978+0000","last_active":"2024-04-25T13:16:49.236328+0000","last_peered":"2024-04-25T13:16:49.236328+0000","last_clean":"2024-04-25T13:16:49.236328+0000","last_became_active":"2024-04-25T13:16:08.008446+0000","last_became_peered":"2024-04-25T13:16:08.008446+0000","last_unstale":"2024-04-25T13:16:49.236328+0000","last_undegraded":"2024-04-25T13:16:49.236328+0000","last_fullsized":"2024-04-25T13:16:49.236328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.148524+0000","last_change":"2024-04-25T13:16:06.992902+0000","last_active":"2024-04-25T13:16:56.148524+0000","last_peered":"2024-04-25T13:16:56.148524+0000","last_clean":"2024-04-25T13:16:56.148524+0000","last_became_active":"2024-04-25T13:16:06.992593+0000","last_became_peered":"2024-04-25T13:16:06.992593+0000","last_unstale":"2024-04-25T13:16:56.148524+0000","last_undegraded":"2024-04-25T13:16:56.148524+0000","last_fullsized":"2024-04-25T13:16:56.148524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129488+0000","last_change":"2024-04-25T13:16:12.735412+0000","last_active":"2024-04-25T13:16:49.129488+0000","last_peered":"2024-04-25T13:16:49.129488+0000","last_clean":"2024-04-25T13:16:49.129488+0000","last_became_active":"2024-04-25T13:16:12.733485+0000","last_became_peered":"2024-04-25T13:16:12.733485+0000","last_unstale":"2024-04-25T13:16:49.129488+0000","last_undegraded":"2024-04-25T13:16:49.129488+0000","last_fullsized":"2024-04-25T13:16:49.129488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132357+0000","last_change":"2024-04-25T13:16:07.998941+0000","last_active":"2024-04-25T13:16:49.132357+0000","last_peered":"2024-04-25T13:16:49.132357+0000","last_clean":"2024-04-25T13:16:49.132357+0000","last_became_active":"2024-04-25T13:16:07.998658+0000","last_became_peered":"2024-04-25T13:16:07.998658+0000","last_unstale":"2024-04-25T13:16:49.132357+0000","last_undegraded":"2024-04-25T13:16:49.132357+0000","last_fullsized":"2024-04-25T13:16:49.132357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:45.473269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129850+0000","last_change":"2024-04-25T13:16:07.001542+0000","last_active":"2024-04-25T13:16:49.129850+0000","last_peered":"2024-04-25T13:16:49.129850+0000","last_clean":"2024-04-25T13:16:49.129850+0000","last_became_active":"2024-04-25T13:16:07.000846+0000","last_became_peered":"2024-04-25T13:16:07.000846+0000","last_unstale":"2024-04-25T13:16:49.129850+0000","last_undegraded":"2024-04-25T13:16:49.129850+0000","last_fullsized":"2024-04-25T13:16:49.129850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:41.121978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132197+0000","last_change":"2024-04-25T13:16:12.038493+0000","last_active":"2024-04-25T13:16:49.132197+0000","last_peered":"2024-04-25T13:16:49.132197+0000","last_clean":"2024-04-25T13:16:49.132197+0000","last_became_active":"2024-04-25T13:16:12.038032+0000","last_became_peered":"2024-04-25T13:16:12.038032+0000","last_unstale":"2024-04-25T13:16:49.132197+0000","last_undegraded":"2024-04-25T13:16:49.132197+0000","last_fullsized":"2024-04-25T13:16:49.132197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:40.222480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134616+0000","last_change":"2024-04-25T13:16:07.998444+0000","last_active":"2024-04-25T13:16:49.134616+0000","last_peered":"2024-04-25T13:16:49.134616+0000","last_clean":"2024-04-25T13:16:49.134616+0000","last_became_active":"2024-04-25T13:16:07.998037+0000","last_became_peered":"2024-04-25T13:16:07.998037+0000","last_unstale":"2024-04-25T13:16:49.134616+0000","last_undegraded":"2024-04-25T13:16:49.134616+0000","last_fullsized":"2024-04-25T13:16:49.134616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.347192+0000","last_change":"2024-04-25T13:16:06.995706+0000","last_active":"2024-04-25T13:16:56.347192+0000","last_peered":"2024-04-25T13:16:56.347192+0000","last_clean":"2024-04-25T13:16:56.347192+0000","last_became_active":"2024-04-25T13:16:06.995420+0000","last_became_peered":"2024-04-25T13:16:06.995420+0000","last_unstale":"2024-04-25T13:16:56.347192+0000","last_undegraded":"2024-04-25T13:16:56.347192+0000","last_fullsized":"2024-04-25T13:16:56.347192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:08.672949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132741+0000","last_change":"2024-04-25T13:16:12.734165+0000","last_active":"2024-04-25T13:16:49.132741+0000","last_peered":"2024-04-25T13:16:49.132741+0000","last_clean":"2024-04-25T13:16:49.132741+0000","last_became_active":"2024-04-25T13:16:12.733772+0000","last_became_peered":"2024-04-25T13:16:12.733772+0000","last_unstale":"2024-04-25T13:16:49.132741+0000","last_undegraded":"2024-04-25T13:16:49.132741+0000","last_fullsized":"2024-04-25T13:16:49.132741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:35.716517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236336+0000","last_change":"2024-04-25T13:16:08.017429+0000","last_active":"2024-04-25T13:16:49.236336+0000","last_peered":"2024-04-25T13:16:49.236336+0000","last_clean":"2024-04-25T13:16:49.236336+0000","last_became_active":"2024-04-25T13:16:08.017205+0000","last_became_peered":"2024-04-25T13:16:08.017205+0000","last_unstale":"2024-04-25T13:16:49.236336+0000","last_undegraded":"2024-04-25T13:16:49.236336+0000","last_fullsized":"2024-04-25T13:16:49.236336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.134201+0000","last_change":"2024-04-25T13:16:06.992063+0000","last_active":"2024-04-25T13:16:51.134201+0000","last_peered":"2024-04-25T13:16:51.134201+0000","last_clean":"2024-04-25T13:16:51.134201+0000","last_became_active":"2024-04-25T13:16:06.991766+0000","last_became_peered":"2024-04-25T13:16:06.991766+0000","last_unstale":"2024-04-25T13:16:51.134201+0000","last_undegraded":"2024-04-25T13:16:51.134201+0000","last_fullsized":"2024-04-25T13:16:51.134201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235867+0000","last_change":"2024-04-25T13:16:12.734837+0000","last_active":"2024-04-25T13:16:49.235867+0000","last_peered":"2024-04-25T13:16:49.235867+0000","last_clean":"2024-04-25T13:16:49.235867+0000","last_became_active":"2024-04-25T13:16:12.734394+0000","last_became_peered":"2024-04-25T13:16:12.734394+0000","last_unstale":"2024-04-25T13:16:49.235867+0000","last_undegraded":"2024-04-25T13:16:49.235867+0000","last_fullsized":"2024-04-25T13:16:49.235867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129552+0000","last_change":"2024-04-25T13:16:08.000277+0000","last_active":"2024-04-25T13:16:49.129552+0000","last_peered":"2024-04-25T13:16:49.129552+0000","last_clean":"2024-04-25T13:16:49.129552+0000","last_became_active":"2024-04-25T13:16:07.999797+0000","last_became_peered":"2024-04-25T13:16:07.999797+0000","last_unstale":"2024-04-25T13:16:49.129552+0000","last_undegraded":"2024-04-25T13:16:49.129552+0000","last_fullsized":"2024-04-25T13:16:49.129552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.133126+0000","last_change":"2024-04-25T13:16:07.002146+0000","last_active":"2024-04-25T13:16:51.133126+0000","last_peered":"2024-04-25T13:16:51.133126+0000","last_clean":"2024-04-25T13:16:51.133126+0000","last_became_active":"2024-04-25T13:16:07.001918+0000","last_became_peered":"2024-04-25T13:16:07.001918+0000","last_unstale":"2024-04-25T13:16:51.133126+0000","last_undegraded":"2024-04-25T13:16:51.133126+0000","last_fullsized":"2024-04-25T13:16:51.133126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:38.326719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134797+0000","last_change":"2024-04-25T13:16:12.733744+0000","last_active":"2024-04-25T13:16:49.134797+0000","last_peered":"2024-04-25T13:16:49.134797+0000","last_clean":"2024-04-25T13:16:49.134797+0000","last_became_active":"2024-04-25T13:16:12.733361+0000","last_became_peered":"2024-04-25T13:16:12.733361+0000","last_unstale":"2024-04-25T13:16:49.134797+0000","last_undegraded":"2024-04-25T13:16:49.134797+0000","last_fullsized":"2024-04-25T13:16:49.134797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130376+0000","last_change":"2024-04-25T13:16:08.016667+0000","last_active":"2024-04-25T13:16:49.130376+0000","last_peered":"2024-04-25T13:16:49.130376+0000","last_clean":"2024-04-25T13:16:49.130376+0000","last_became_active":"2024-04-25T13:16:08.015172+0000","last_became_peered":"2024-04-25T13:16:08.015172+0000","last_unstale":"2024-04-25T13:16:49.130376+0000","last_undegraded":"2024-04-25T13:16:49.130376+0000","last_fullsized":"2024-04-25T13:16:49.130376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:40.786954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.130185+0000","last_change":"2024-04-25T13:16:06.996301+0000","last_active":"2024-04-25T13:16:51.130185+0000","last_peered":"2024-04-25T13:16:51.130185+0000","last_clean":"2024-04-25T13:16:51.130185+0000","last_became_active":"2024-04-25T13:16:06.995957+0000","last_became_peered":"2024-04-25T13:16:06.995957+0000","last_unstale":"2024-04-25T13:16:51.130185+0000","last_undegraded":"2024-04-25T13:16:51.130185+0000","last_fullsized":"2024-04-25T13:16:51.130185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129074+0000","last_change":"2024-04-25T13:16:12.040987+0000","last_active":"2024-04-25T13:16:49.129074+0000","last_peered":"2024-04-25T13:16:49.129074+0000","last_clean":"2024-04-25T13:16:49.129074+0000","last_became_active":"2024-04-25T13:16:12.039987+0000","last_became_peered":"2024-04-25T13:16:12.039987+0000","last_unstale":"2024-04-25T13:16:49.129074+0000","last_undegraded":"2024-04-25T13:16:49.129074+0000","last_fullsized":"2024-04-25T13:16:49.129074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133323+0000","last_change":"2024-04-25T13:16:08.002876+0000","last_active":"2024-04-25T13:16:49.133323+0000","last_peered":"2024-04-25T13:16:49.133323+0000","last_clean":"2024-04-25T13:16:49.133323+0000","last_became_active":"2024-04-25T13:16:08.002131+0000","last_became_peered":"2024-04-25T13:16:08.002131+0000","last_unstale":"2024-04-25T13:16:49.133323+0000","last_undegraded":"2024-04-25T13:16:49.133323+0000","last_fullsized":"2024-04-25T13:16:49.133323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:09.646849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.150771+0000","last_change":"2024-04-25T13:16:06.990075+0000","last_active":"2024-04-25T13:16:56.150771+0000","last_peered":"2024-04-25T13:16:56.150771+0000","last_clean":"2024-04-25T13:16:56.150771+0000","last_became_active":"2024-04-25T13:16:06.989652+0000","last_became_peered":"2024-04-25T13:16:06.989652+0000","last_unstale":"2024-04-25T13:16:56.150771+0000","last_undegraded":"2024-04-25T13:16:56.150771+0000","last_fullsized":"2024-04-25T13:16:56.150771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:29.378995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129595+0000","last_change":"2024-04-25T13:16:12.032906+0000","last_active":"2024-04-25T13:16:49.129595+0000","last_peered":"2024-04-25T13:16:49.129595+0000","last_clean":"2024-04-25T13:16:49.129595+0000","last_became_active":"2024-04-25T13:16:12.032184+0000","last_became_peered":"2024-04-25T13:16:12.032184+0000","last_unstale":"2024-04-25T13:16:49.129595+0000","last_undegraded":"2024-04-25T13:16:49.129595+0000","last_fullsized":"2024-04-25T13:16:49.129595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.128958+0000","last_change":"2024-04-25T13:16:07.997173+0000","last_active":"2024-04-25T13:16:49.128958+0000","last_peered":"2024-04-25T13:16:49.128958+0000","last_clean":"2024-04-25T13:16:49.128958+0000","last_became_active":"2024-04-25T13:16:07.996545+0000","last_became_peered":"2024-04-25T13:16:07.996545+0000","last_unstale":"2024-04-25T13:16:49.128958+0000","last_undegraded":"2024-04-25T13:16:49.128958+0000","last_fullsized":"2024-04-25T13:16:49.128958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.520035+0000","last_change":"2024-04-25T13:16:06.993674+0000","last_active":"2024-04-25T13:17:04.520035+0000","last_peered":"2024-04-25T13:17:04.520035+0000","last_clean":"2024-04-25T13:17:04.520035+0000","last_became_active":"2024-04-25T13:16:06.993387+0000","last_became_peered":"2024-04-25T13:16:06.993387+0000","last_unstale":"2024-04-25T13:17:04.520035+0000","last_undegraded":"2024-04-25T13:17:04.520035+0000","last_fullsized":"2024-04-25T13:17:04.520035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.840782+0000","last_change":"2024-04-25T13:16:49.237386+0000","last_active":"2024-04-25T13:16:49.840782+0000","last_peered":"2024-04-25T13:16:49.840782+0000","last_clean":"2024-04-25T13:16:49.840782+0000","last_became_active":"2024-04-25T13:16:49.236873+0000","last_became_peered":"2024-04-25T13:16:49.236873+0000","last_unstale":"2024-04-25T13:16:49.840782+0000","last_undegraded":"2024-04-25T13:16:49.840782+0000","last_fullsized":"2024-04-25T13:16:49.840782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133246+0000","last_change":"2024-04-25T13:16:08.004209+0000","last_active":"2024-04-25T13:16:49.133246+0000","last_peered":"2024-04-25T13:16:49.133246+0000","last_clean":"2024-04-25T13:16:49.133246+0000","last_became_active":"2024-04-25T13:16:08.003908+0000","last_became_peered":"2024-04-25T13:16:08.003908+0000","last_unstale":"2024-04-25T13:16:49.133246+0000","last_undegraded":"2024-04-25T13:16:49.133246+0000","last_fullsized":"2024-04-25T13:16:49.133246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130018+0000","last_change":"2024-04-25T13:16:06.999384+0000","last_active":"2024-04-25T13:16:49.130018+0000","last_peered":"2024-04-25T13:16:49.130018+0000","last_clean":"2024-04-25T13:16:49.130018+0000","last_became_active":"2024-04-25T13:16:06.999126+0000","last_became_peered":"2024-04-25T13:16:06.999126+0000","last_unstale":"2024-04-25T13:16:49.130018+0000","last_undegraded":"2024-04-25T13:16:49.130018+0000","last_fullsized":"2024-04-25T13:16:49.130018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:50.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134443+0000","last_change":"2024-04-25T13:16:12.733992+0000","last_active":"2024-04-25T13:16:49.134443+0000","last_peered":"2024-04-25T13:16:49.134443+0000","last_clean":"2024-04-25T13:16:49.134443+0000","last_became_active":"2024-04-25T13:16:12.733316+0000","last_became_peered":"2024-04-25T13:16:12.733316+0000","last_unstale":"2024-04-25T13:16:49.134443+0000","last_undegraded":"2024-04-25T13:16:49.134443+0000","last_fullsized":"2024-04-25T13:16:49.134443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235502+0000","last_change":"2024-04-25T13:16:08.021617+0000","last_active":"2024-04-25T13:16:49.235502+0000","last_peered":"2024-04-25T13:16:49.235502+0000","last_clean":"2024-04-25T13:16:49.235502+0000","last_became_active":"2024-04-25T13:16:08.021346+0000","last_became_peered":"2024-04-25T13:16:08.021346+0000","last_unstale":"2024-04-25T13:16:49.235502+0000","last_undegraded":"2024-04-25T13:16:49.235502+0000","last_fullsized":"2024-04-25T13:16:49.235502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.131254+0000","last_change":"2024-04-25T13:16:06.990638+0000","last_active":"2024-04-25T13:16:51.131254+0000","last_peered":"2024-04-25T13:16:51.131254+0000","last_clean":"2024-04-25T13:16:51.131254+0000","last_became_active":"2024-04-25T13:16:06.990379+0000","last_became_peered":"2024-04-25T13:16:06.990379+0000","last_unstale":"2024-04-25T13:16:51.131254+0000","last_undegraded":"2024-04-25T13:16:51.131254+0000","last_fullsized":"2024-04-25T13:16:51.131254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:39.385990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130081+0000","last_change":"2024-04-25T13:15:57.168598+0000","last_active":"2024-04-25T13:16:49.130081+0000","last_peered":"2024-04-25T13:16:49.130081+0000","last_clean":"2024-04-25T13:16:49.130081+0000","last_became_active":"2024-04-25T13:15:57.167692+0000","last_became_peered":"2024-04-25T13:15:57.167692+0000","last_unstale":"2024-04-25T13:16:49.130081+0000","last_undegraded":"2024-04-25T13:16:49.130081+0000","last_fullsized":"2024-04-25T13:16:49.130081+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:15:55.844647+0000","last_clean_scrub_stamp":"2024-04-25T13:15:55.844647+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:29.123100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235646+0000","last_change":"2024-04-25T13:16:12.734712+0000","last_active":"2024-04-25T13:16:49.235646+0000","last_peered":"2024-04-25T13:16:49.235646+0000","last_clean":"2024-04-25T13:16:49.235646+0000","last_became_active":"2024-04-25T13:16:12.734288+0000","last_became_peered":"2024-04-25T13:16:12.734288+0000","last_unstale":"2024-04-25T13:16:49.235646+0000","last_undegraded":"2024-04-25T13:16:49.235646+0000","last_fullsized":"2024-04-25T13:16:49.235646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:45.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131327+0000","last_change":"2024-04-25T13:16:08.014279+0000","last_active":"2024-04-25T13:16:49.131327+0000","last_peered":"2024-04-25T13:16:49.131327+0000","last_clean":"2024-04-25T13:16:49.131327+0000","last_became_active":"2024-04-25T13:16:08.013989+0000","last_became_peered":"2024-04-25T13:16:08.013989+0000","last_unstale":"2024-04-25T13:16:49.131327+0000","last_undegraded":"2024-04-25T13:16:49.131327+0000","last_fullsized":"2024-04-25T13:16:49.131327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:54.411981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:09.166297+0000","last_change":"2024-04-25T13:16:06.996774+0000","last_active":"2024-04-25T13:17:09.166297+0000","last_peered":"2024-04-25T13:17:09.166297+0000","last_clean":"2024-04-25T13:17:09.166297+0000","last_became_active":"2024-04-25T13:16:06.996251+0000","last_became_peered":"2024-04-25T13:16:06.996251+0000","last_unstale":"2024-04-25T13:17:09.166297+0000","last_undegraded":"2024-04-25T13:17:09.166297+0000","last_fullsized":"2024-04-25T13:17:09.166297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235463+0000","last_change":"2024-04-25T13:16:12.733562+0000","last_active":"2024-04-25T13:16:49.235463+0000","last_peered":"2024-04-25T13:16:49.235463+0000","last_clean":"2024-04-25T13:16:49.235463+0000","last_became_active":"2024-04-25T13:16:12.733114+0000","last_became_peered":"2024-04-25T13:16:12.733114+0000","last_unstale":"2024-04-25T13:16:49.235463+0000","last_undegraded":"2024-04-25T13:16:49.235463+0000","last_fullsized":"2024-04-25T13:16:49.235463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:20.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131209+0000","last_change":"2024-04-25T13:16:08.011389+0000","last_active":"2024-04-25T13:16:49.131209+0000","last_peered":"2024-04-25T13:16:49.131209+0000","last_clean":"2024-04-25T13:16:49.131209+0000","last_became_active":"2024-04-25T13:16:08.011113+0000","last_became_peered":"2024-04-25T13:16:08.011113+0000","last_unstale":"2024-04-25T13:16:49.131209+0000","last_undegraded":"2024-04-25T13:16:49.131209+0000","last_fullsized":"2024-04-25T13:16:49.131209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:12.339487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.381156+0000","last_change":"2024-04-25T13:17:19.381199+0000","last_active":"2024-04-25T13:17:19.381156+0000","last_peered":"2024-04-25T13:17:19.381156+0000","last_clean":"2024-04-25T13:17:19.381156+0000","last_became_active":"2024-04-25T13:16:06.988631+0000","last_became_peered":"2024-04-25T13:16:06.988631+0000","last_unstale":"2024-04-25T13:17:19.381156+0000","last_undegraded":"2024-04-25T13:17:19.381156+0000","last_fullsized":"2024-04-25T13:17:19.381156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:19.381072+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:19.381072+0000","last_clean_scrub_stamp":"2024-04-25T13:17:19.381072+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:02.009329+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134884+0000","last_change":"2024-04-25T13:16:12.047194+0000","last_active":"2024-04-25T13:16:49.134884+0000","last_peered":"2024-04-25T13:16:49.134884+0000","last_clean":"2024-04-25T13:16:49.134884+0000","last_became_active":"2024-04-25T13:16:12.046780+0000","last_became_peered":"2024-04-25T13:16:12.046780+0000","last_unstale":"2024-04-25T13:16:49.134884+0000","last_undegraded":"2024-04-25T13:16:49.134884+0000","last_fullsized":"2024-04-25T13:16:49.134884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131701+0000","last_change":"2024-04-25T13:16:08.007925+0000","last_active":"2024-04-25T13:16:49.131701+0000","last_peered":"2024-04-25T13:16:49.131701+0000","last_clean":"2024-04-25T13:16:49.131701+0000","last_became_active":"2024-04-25T13:16:08.007681+0000","last_became_peered":"2024-04-25T13:16:08.007681+0000","last_unstale":"2024-04-25T13:16:49.131701+0000","last_undegraded":"2024-04-25T13:16:49.131701+0000","last_fullsized":"2024-04-25T13:16:49.131701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:29.601564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.147663+0000","last_change":"2024-04-25T13:16:06.991912+0000","last_active":"2024-04-25T13:16:56.147663+0000","last_peered":"2024-04-25T13:16:56.147663+0000","last_clean":"2024-04-25T13:16:56.147663+0000","last_became_active":"2024-04-25T13:16:06.991578+0000","last_became_peered":"2024-04-25T13:16:06.991578+0000","last_unstale":"2024-04-25T13:16:56.147663+0000","last_undegraded":"2024-04-25T13:16:56.147663+0000","last_fullsized":"2024-04-25T13:16:56.147663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129381+0000","last_change":"2024-04-25T13:16:12.733567+0000","last_active":"2024-04-25T13:16:49.129381+0000","last_peered":"2024-04-25T13:16:49.129381+0000","last_clean":"2024-04-25T13:16:49.129381+0000","last_became_active":"2024-04-25T13:16:12.733136+0000","last_became_peered":"2024-04-25T13:16:12.733136+0000","last_unstale":"2024-04-25T13:16:49.129381+0000","last_undegraded":"2024-04-25T13:16:49.129381+0000","last_fullsized":"2024-04-25T13:16:49.129381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:29.125928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131176+0000","last_change":"2024-04-25T13:16:08.004897+0000","last_active":"2024-04-25T13:16:49.131176+0000","last_peered":"2024-04-25T13:16:49.131176+0000","last_clean":"2024-04-25T13:16:49.131176+0000","last_became_active":"2024-04-25T13:16:08.004180+0000","last_became_peered":"2024-04-25T13:16:08.004180+0000","last_unstale":"2024-04-25T13:16:49.131176+0000","last_undegraded":"2024-04-25T13:16:49.131176+0000","last_fullsized":"2024-04-25T13:16:49.131176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:12.011447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132694+0000","last_change":"2024-04-25T13:16:06.994487+0000","last_active":"2024-04-25T13:16:49.132694+0000","last_peered":"2024-04-25T13:16:49.132694+0000","last_clean":"2024-04-25T13:16:49.132694+0000","last_became_active":"2024-04-25T13:16:06.994235+0000","last_became_peered":"2024-04-25T13:16:06.994235+0000","last_unstale":"2024-04-25T13:16:49.132694+0000","last_undegraded":"2024-04-25T13:16:49.132694+0000","last_fullsized":"2024-04-25T13:16:49.132694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131872+0000","last_change":"2024-04-25T13:16:12.039277+0000","last_active":"2024-04-25T13:16:49.131872+0000","last_peered":"2024-04-25T13:16:49.131872+0000","last_clean":"2024-04-25T13:16:49.131872+0000","last_became_active":"2024-04-25T13:16:12.038534+0000","last_became_peered":"2024-04-25T13:16:12.038534+0000","last_unstale":"2024-04-25T13:16:49.131872+0000","last_undegraded":"2024-04-25T13:16:49.131872+0000","last_fullsized":"2024-04-25T13:16:49.131872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:59.495976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130166+0000","last_change":"2024-04-25T13:16:08.007302+0000","last_active":"2024-04-25T13:16:49.130166+0000","last_peered":"2024-04-25T13:16:49.130166+0000","last_clean":"2024-04-25T13:16:49.130166+0000","last_became_active":"2024-04-25T13:16:08.007050+0000","last_became_peered":"2024-04-25T13:16:08.007050+0000","last_unstale":"2024-04-25T13:16:49.130166+0000","last_undegraded":"2024-04-25T13:16:49.130166+0000","last_fullsized":"2024-04-25T13:16:49.130166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:35.369188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.416366+0000","last_change":"2024-04-25T13:17:19.416399+0000","last_active":"2024-04-25T13:17:19.416366+0000","last_peered":"2024-04-25T13:17:19.416366+0000","last_clean":"2024-04-25T13:17:19.416366+0000","last_became_active":"2024-04-25T13:16:06.982320+0000","last_became_peered":"2024-04-25T13:16:06.982320+0000","last_unstale":"2024-04-25T13:17:19.416366+0000","last_undegraded":"2024-04-25T13:17:19.416366+0000","last_fullsized":"2024-04-25T13:17:19.416366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-25T13:17:19.416275+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-25T13:17:19.416275+0000","last_clean_scrub_stamp":"2024-04-25T13:17:19.416275+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:40.159412+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134362+0000","last_change":"2024-04-25T13:16:12.043657+0000","last_active":"2024-04-25T13:16:49.134362+0000","last_peered":"2024-04-25T13:16:49.134362+0000","last_clean":"2024-04-25T13:16:49.134362+0000","last_became_active":"2024-04-25T13:16:12.042902+0000","last_became_peered":"2024-04-25T13:16:12.042902+0000","last_unstale":"2024-04-25T13:16:49.134362+0000","last_undegraded":"2024-04-25T13:16:49.134362+0000","last_fullsized":"2024-04-25T13:16:49.134362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236046+0000","last_change":"2024-04-25T13:16:08.008534+0000","last_active":"2024-04-25T13:16:49.236046+0000","last_peered":"2024-04-25T13:16:49.236046+0000","last_clean":"2024-04-25T13:16:49.236046+0000","last_became_active":"2024-04-25T13:16:08.008102+0000","last_became_peered":"2024-04-25T13:16:08.008102+0000","last_unstale":"2024-04-25T13:16:49.236046+0000","last_undegraded":"2024-04-25T13:16:49.236046+0000","last_fullsized":"2024-04-25T13:16:49.236046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:48.331724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.520370+0000","last_change":"2024-04-25T13:16:06.993292+0000","last_active":"2024-04-25T13:17:04.520370+0000","last_peered":"2024-04-25T13:17:04.520370+0000","last_clean":"2024-04-25T13:17:04.520370+0000","last_became_active":"2024-04-25T13:16:06.993008+0000","last_became_peered":"2024-04-25T13:16:06.993008+0000","last_unstale":"2024-04-25T13:17:04.520370+0000","last_undegraded":"2024-04-25T13:17:04.520370+0000","last_fullsized":"2024-04-25T13:17:04.520370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:22.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236238+0000","last_change":"2024-04-25T13:16:12.733945+0000","last_active":"2024-04-25T13:16:49.236238+0000","last_peered":"2024-04-25T13:16:49.236238+0000","last_clean":"2024-04-25T13:16:49.236238+0000","last_became_active":"2024-04-25T13:16:12.733359+0000","last_became_peered":"2024-04-25T13:16:12.733359+0000","last_unstale":"2024-04-25T13:16:49.236238+0000","last_undegraded":"2024-04-25T13:16:49.236238+0000","last_fullsized":"2024-04-25T13:16:49.236238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131189+0000","last_change":"2024-04-25T13:16:08.008034+0000","last_active":"2024-04-25T13:16:49.131189+0000","last_peered":"2024-04-25T13:16:49.131189+0000","last_clean":"2024-04-25T13:16:49.131189+0000","last_became_active":"2024-04-25T13:16:08.007790+0000","last_became_peered":"2024-04-25T13:16:08.007790+0000","last_unstale":"2024-04-25T13:16:49.131189+0000","last_undegraded":"2024-04-25T13:16:49.131189+0000","last_fullsized":"2024-04-25T13:16:49.131189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:35.903237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.130884+0000","last_change":"2024-04-25T13:16:06.996737+0000","last_active":"2024-04-25T13:16:51.130884+0000","last_peered":"2024-04-25T13:16:51.130884+0000","last_clean":"2024-04-25T13:16:51.130884+0000","last_became_active":"2024-04-25T13:16:06.996439+0000","last_became_peered":"2024-04-25T13:16:06.996439+0000","last_unstale":"2024-04-25T13:16:51.130884+0000","last_undegraded":"2024-04-25T13:16:51.130884+0000","last_fullsized":"2024-04-25T13:16:51.130884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:36.400030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235812+0000","last_change":"2024-04-25T13:16:12.734393+0000","last_active":"2024-04-25T13:16:49.235812+0000","last_peered":"2024-04-25T13:16:49.235812+0000","last_clean":"2024-04-25T13:16:49.235812+0000","last_became_active":"2024-04-25T13:16:12.733328+0000","last_became_peered":"2024-04-25T13:16:12.733328+0000","last_unstale":"2024-04-25T13:16:49.235812+0000","last_undegraded":"2024-04-25T13:16:49.235812+0000","last_fullsized":"2024-04-25T13:16:49.235812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.840735+0000","last_change":"2024-04-25T13:16:49.135983+0000","last_active":"2024-04-25T13:16:49.840735+0000","last_peered":"2024-04-25T13:16:49.840735+0000","last_clean":"2024-04-25T13:16:49.840735+0000","last_became_active":"2024-04-25T13:16:49.135704+0000","last_became_peered":"2024-04-25T13:16:49.135704+0000","last_unstale":"2024-04-25T13:16:49.840735+0000","last_undegraded":"2024-04-25T13:16:49.840735+0000","last_fullsized":"2024-04-25T13:16:49.840735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.13","version":"27'13","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:18.444587+0000","last_change":"2024-04-25T13:17:18.444644+0000","last_active":"2024-04-25T13:17:18.444587+0000","last_peered":"2024-04-25T13:17:18.444587+0000","last_clean":"2024-04-25T13:17:18.444587+0000","last_became_active":"2024-04-25T13:16:07.000243+0000","last_became_peered":"2024-04-25T13:16:07.000243+0000","last_unstale":"2024-04-25T13:17:18.444587+0000","last_undegraded":"2024-04-25T13:17:18.444587+0000","last_fullsized":"2024-04-25T13:17:18.444587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-04-25T13:17:18.444488+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-04-25T13:17:18.444488+0000","last_clean_scrub_stamp":"2024-04-25T13:17:18.444488+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:39:32.397333+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130148+0000","last_change":"2024-04-25T13:16:12.733681+0000","last_active":"2024-04-25T13:16:49.130148+0000","last_peered":"2024-04-25T13:16:49.130148+0000","last_clean":"2024-04-25T13:16:49.130148+0000","last_became_active":"2024-04-25T13:16:12.733245+0000","last_became_peered":"2024-04-25T13:16:12.733245+0000","last_unstale":"2024-04-25T13:16:49.130148+0000","last_undegraded":"2024-04-25T13:16:49.130148+0000","last_fullsized":"2024-04-25T13:16:49.130148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.028858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131242+0000","last_change":"2024-04-25T13:16:08.008790+0000","last_active":"2024-04-25T13:16:49.131242+0000","last_peered":"2024-04-25T13:16:49.131242+0000","last_clean":"2024-04-25T13:16:49.131242+0000","last_became_active":"2024-04-25T13:16:08.008530+0000","last_became_peered":"2024-04-25T13:16:08.008530+0000","last_unstale":"2024-04-25T13:16:49.131242+0000","last_undegraded":"2024-04-25T13:16:49.131242+0000","last_fullsized":"2024-04-25T13:16:49.131242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:44.215930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.525527+0000","last_change":"2024-04-25T13:16:06.997575+0000","last_active":"2024-04-25T13:17:04.525527+0000","last_peered":"2024-04-25T13:17:04.525527+0000","last_clean":"2024-04-25T13:17:04.525527+0000","last_became_active":"2024-04-25T13:16:06.997289+0000","last_became_peered":"2024-04-25T13:16:06.997289+0000","last_unstale":"2024-04-25T13:17:04.525527+0000","last_undegraded":"2024-04-25T13:17:04.525527+0000","last_fullsized":"2024-04-25T13:17:04.525527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:54.096662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129178+0000","last_change":"2024-04-25T13:16:12.040456+0000","last_active":"2024-04-25T13:16:49.129178+0000","last_peered":"2024-04-25T13:16:49.129178+0000","last_clean":"2024-04-25T13:16:49.129178+0000","last_became_active":"2024-04-25T13:16:12.039443+0000","last_became_peered":"2024-04-25T13:16:12.039443+0000","last_unstale":"2024-04-25T13:16:49.129178+0000","last_undegraded":"2024-04-25T13:16:49.129178+0000","last_fullsized":"2024-04-25T13:16:49.129178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132567+0000","last_change":"2024-04-25T13:16:08.004618+0000","last_active":"2024-04-25T13:16:49.132567+0000","last_peered":"2024-04-25T13:16:49.132567+0000","last_clean":"2024-04-25T13:16:49.132567+0000","last_became_active":"2024-04-25T13:16:08.002583+0000","last_became_peered":"2024-04-25T13:16:08.002583+0000","last_unstale":"2024-04-25T13:16:49.132567+0000","last_undegraded":"2024-04-25T13:16:49.132567+0000","last_fullsized":"2024-04-25T13:16:49.132567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:25.609409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.130793+0000","last_change":"2024-04-25T13:16:06.996610+0000","last_active":"2024-04-25T13:16:51.130793+0000","last_peered":"2024-04-25T13:16:51.130793+0000","last_clean":"2024-04-25T13:16:51.130793+0000","last_became_active":"2024-04-25T13:16:06.995616+0000","last_became_peered":"2024-04-25T13:16:06.995616+0000","last_unstale":"2024-04-25T13:16:51.130793+0000","last_undegraded":"2024-04-25T13:16:51.130793+0000","last_fullsized":"2024-04-25T13:16:51.130793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133232+0000","last_change":"2024-04-25T13:16:12.043744+0000","last_active":"2024-04-25T13:16:49.133232+0000","last_peered":"2024-04-25T13:16:49.133232+0000","last_clean":"2024-04-25T13:16:49.133232+0000","last_became_active":"2024-04-25T13:16:12.043267+0000","last_became_peered":"2024-04-25T13:16:12.043267+0000","last_unstale":"2024-04-25T13:16:49.133232+0000","last_undegraded":"2024-04-25T13:16:49.133232+0000","last_fullsized":"2024-04-25T13:16:49.133232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:52.316751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.137797+0000","last_change":"2024-04-25T13:16:49.137097+0000","last_active":"2024-04-25T13:16:49.137797+0000","last_peered":"2024-04-25T13:16:49.137797+0000","last_clean":"2024-04-25T13:16:49.137797+0000","last_became_active":"2024-04-25T13:16:49.136773+0000","last_became_peered":"2024-04-25T13:16:49.136773+0000","last_unstale":"2024-04-25T13:16:49.137797+0000","last_undegraded":"2024-04-25T13:16:49.137797+0000","last_fullsized":"2024-04-25T13:16:49.137797+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.148921+0000","last_change":"2024-04-25T13:16:06.997061+0000","last_active":"2024-04-25T13:16:56.148921+0000","last_peered":"2024-04-25T13:16:56.148921+0000","last_clean":"2024-04-25T13:16:56.148921+0000","last_became_active":"2024-04-25T13:16:06.996418+0000","last_became_peered":"2024-04-25T13:16:06.996418+0000","last_unstale":"2024-04-25T13:16:56.148921+0000","last_undegraded":"2024-04-25T13:16:56.148921+0000","last_fullsized":"2024-04-25T13:16:56.148921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:34.878260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236124+0000","last_change":"2024-04-25T13:16:12.042796+0000","last_active":"2024-04-25T13:16:49.236124+0000","last_peered":"2024-04-25T13:16:49.236124+0000","last_clean":"2024-04-25T13:16:49.236124+0000","last_became_active":"2024-04-25T13:16:12.042252+0000","last_became_peered":"2024-04-25T13:16:12.042252+0000","last_unstale":"2024-04-25T13:16:49.236124+0000","last_undegraded":"2024-04-25T13:16:49.236124+0000","last_fullsized":"2024-04-25T13:16:49.236124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130623+0000","last_change":"2024-04-25T13:16:08.016203+0000","last_active":"2024-04-25T13:16:49.130623+0000","last_peered":"2024-04-25T13:16:49.130623+0000","last_clean":"2024-04-25T13:16:49.130623+0000","last_became_active":"2024-04-25T13:16:08.015820+0000","last_became_peered":"2024-04-25T13:16:08.015820+0000","last_unstale":"2024-04-25T13:16:49.130623+0000","last_undegraded":"2024-04-25T13:16:49.130623+0000","last_fullsized":"2024-04-25T13:16:49.130623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.600227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.518227+0000","last_change":"2024-04-25T13:16:06.996624+0000","last_active":"2024-04-25T13:17:04.518227+0000","last_peered":"2024-04-25T13:17:04.518227+0000","last_clean":"2024-04-25T13:17:04.518227+0000","last_became_active":"2024-04-25T13:16:06.996373+0000","last_became_peered":"2024-04-25T13:16:06.996373+0000","last_unstale":"2024-04-25T13:17:04.518227+0000","last_undegraded":"2024-04-25T13:17:04.518227+0000","last_fullsized":"2024-04-25T13:17:04.518227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:29.929030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235648+0000","last_change":"2024-04-25T13:16:12.733792+0000","last_active":"2024-04-25T13:16:49.235648+0000","last_peered":"2024-04-25T13:16:49.235648+0000","last_clean":"2024-04-25T13:16:49.235648+0000","last_became_active":"2024-04-25T13:16:12.733314+0000","last_became_peered":"2024-04-25T13:16:12.733314+0000","last_unstale":"2024-04-25T13:16:49.235648+0000","last_undegraded":"2024-04-25T13:16:49.235648+0000","last_fullsized":"2024-04-25T13:16:49.235648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134265+0000","last_change":"2024-04-25T13:16:12.734573+0000","last_active":"2024-04-25T13:16:49.134265+0000","last_peered":"2024-04-25T13:16:49.134265+0000","last_clean":"2024-04-25T13:16:49.134265+0000","last_became_active":"2024-04-25T13:16:12.733908+0000","last_became_peered":"2024-04-25T13:16:12.733908+0000","last_unstale":"2024-04-25T13:16:49.134265+0000","last_undegraded":"2024-04-25T13:16:49.134265+0000","last_fullsized":"2024-04-25T13:16:49.134265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.128785+0000","last_change":"2024-04-25T13:16:08.008915+0000","last_active":"2024-04-25T13:16:49.128785+0000","last_peered":"2024-04-25T13:16:49.128785+0000","last_clean":"2024-04-25T13:16:49.128785+0000","last_became_active":"2024-04-25T13:16:08.008586+0000","last_became_peered":"2024-04-25T13:16:08.008586+0000","last_unstale":"2024-04-25T13:16:49.128785+0000","last_undegraded":"2024-04-25T13:16:49.128785+0000","last_fullsized":"2024-04-25T13:16:49.128785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.132985+0000","last_change":"2024-04-25T13:16:06.994489+0000","last_active":"2024-04-25T13:16:51.132985+0000","last_peered":"2024-04-25T13:16:51.132985+0000","last_clean":"2024-04-25T13:16:51.132985+0000","last_became_active":"2024-04-25T13:16:06.994005+0000","last_became_peered":"2024-04-25T13:16:06.994005+0000","last_unstale":"2024-04-25T13:16:51.132985+0000","last_undegraded":"2024-04-25T13:16:51.132985+0000","last_fullsized":"2024-04-25T13:16:51.132985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:43.921452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235786+0000","last_change":"2024-04-25T13:16:12.037008+0000","last_active":"2024-04-25T13:16:49.235786+0000","last_peered":"2024-04-25T13:16:49.235786+0000","last_clean":"2024-04-25T13:16:49.235786+0000","last_became_active":"2024-04-25T13:16:12.036569+0000","last_became_peered":"2024-04-25T13:16:12.036569+0000","last_unstale":"2024-04-25T13:16:49.235786+0000","last_undegraded":"2024-04-25T13:16:49.235786+0000","last_fullsized":"2024-04-25T13:16:49.235786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:48.224913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236244+0000","last_change":"2024-04-25T13:16:08.008747+0000","last_active":"2024-04-25T13:16:49.236244+0000","last_peered":"2024-04-25T13:16:49.236244+0000","last_clean":"2024-04-25T13:16:49.236244+0000","last_became_active":"2024-04-25T13:16:08.008078+0000","last_became_peered":"2024-04-25T13:16:08.008078+0000","last_unstale":"2024-04-25T13:16:49.236244+0000","last_undegraded":"2024-04-25T13:16:49.236244+0000","last_fullsized":"2024-04-25T13:16:49.236244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:56.149324+0000","last_change":"2024-04-25T13:16:06.997642+0000","last_active":"2024-04-25T13:16:56.149324+0000","last_peered":"2024-04-25T13:16:56.149324+0000","last_clean":"2024-04-25T13:16:56.149324+0000","last_became_active":"2024-04-25T13:16:06.996985+0000","last_became_peered":"2024-04-25T13:16:06.996985+0000","last_unstale":"2024-04-25T13:16:56.149324+0000","last_undegraded":"2024-04-25T13:16:56.149324+0000","last_fullsized":"2024-04-25T13:16:56.149324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:51.133935+0000","last_change":"2024-04-25T13:16:06.992687+0000","last_active":"2024-04-25T13:16:51.133935+0000","last_peered":"2024-04-25T13:16:51.133935+0000","last_clean":"2024-04-25T13:16:51.133935+0000","last_became_active":"2024-04-25T13:16:06.992407+0000","last_became_peered":"2024-04-25T13:16:06.992407+0000","last_unstale":"2024-04-25T13:16:51.133935+0000","last_undegraded":"2024-04-25T13:16:51.133935+0000","last_fullsized":"2024-04-25T13:16:51.133935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:37.658458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134961+0000","last_change":"2024-04-25T13:16:08.004510+0000","last_active":"2024-04-25T13:16:49.134961+0000","last_peered":"2024-04-25T13:16:49.134961+0000","last_clean":"2024-04-25T13:16:49.134961+0000","last_became_active":"2024-04-25T13:16:08.003959+0000","last_became_peered":"2024-04-25T13:16:08.003959+0000","last_unstale":"2024-04-25T13:16:49.134961+0000","last_undegraded":"2024-04-25T13:16:49.134961+0000","last_fullsized":"2024-04-25T13:16:49.134961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132037+0000","last_change":"2024-04-25T13:16:12.037097+0000","last_active":"2024-04-25T13:16:49.132037+0000","last_peered":"2024-04-25T13:16:49.132037+0000","last_clean":"2024-04-25T13:16:49.132037+0000","last_became_active":"2024-04-25T13:16:12.036651+0000","last_became_peered":"2024-04-25T13:16:12.036651+0000","last_unstale":"2024-04-25T13:16:49.132037+0000","last_undegraded":"2024-04-25T13:16:49.132037+0000","last_fullsized":"2024-04-25T13:16:49.132037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:09.166622+0000","last_change":"2024-04-25T13:16:06.996311+0000","last_active":"2024-04-25T13:17:09.166622+0000","last_peered":"2024-04-25T13:17:09.166622+0000","last_clean":"2024-04-25T13:17:09.166622+0000","last_became_active":"2024-04-25T13:16:06.996010+0000","last_became_peered":"2024-04-25T13:16:06.996010+0000","last_unstale":"2024-04-25T13:17:09.166622+0000","last_undegraded":"2024-04-25T13:17:09.166622+0000","last_fullsized":"2024-04-25T13:17:09.166622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:05.967137+0000","last_clean_scrub_stamp":"2024-04-25T13:16:05.967137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132357+0000","last_change":"2024-04-25T13:16:08.002159+0000","last_active":"2024-04-25T13:16:49.132357+0000","last_peered":"2024-04-25T13:16:49.132357+0000","last_clean":"2024-04-25T13:16:49.132357+0000","last_became_active":"2024-04-25T13:16:08.001833+0000","last_became_peered":"2024-04-25T13:16:08.001833+0000","last_unstale":"2024-04-25T13:16:49.132357+0000","last_undegraded":"2024-04-25T13:16:49.132357+0000","last_fullsized":"2024-04-25T13:16:49.132357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:25.490243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236317+0000","last_change":"2024-04-25T13:16:12.042721+0000","last_active":"2024-04-25T13:16:49.236317+0000","last_peered":"2024-04-25T13:16:49.236317+0000","last_clean":"2024-04-25T13:16:49.236317+0000","last_became_active":"2024-04-25T13:16:12.042000+0000","last_became_peered":"2024-04-25T13:16:12.042000+0000","last_unstale":"2024-04-25T13:16:49.236317+0000","last_undegraded":"2024-04-25T13:16:49.236317+0000","last_fullsized":"2024-04-25T13:16:49.236317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235823+0000","last_change":"2024-04-25T13:16:08.008364+0000","last_active":"2024-04-25T13:16:49.235823+0000","last_peered":"2024-04-25T13:16:49.235823+0000","last_clean":"2024-04-25T13:16:49.235823+0000","last_became_active":"2024-04-25T13:16:08.007728+0000","last_became_peered":"2024-04-25T13:16:08.007728+0000","last_unstale":"2024-04-25T13:16:49.235823+0000","last_undegraded":"2024-04-25T13:16:49.235823+0000","last_fullsized":"2024-04-25T13:16:49.235823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:08.731178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131582+0000","last_change":"2024-04-25T13:16:08.011273+0000","last_active":"2024-04-25T13:16:49.131582+0000","last_peered":"2024-04-25T13:16:49.131582+0000","last_clean":"2024-04-25T13:16:49.131582+0000","last_became_active":"2024-04-25T13:16:08.010981+0000","last_became_peered":"2024-04-25T13:16:08.010981+0000","last_unstale":"2024-04-25T13:16:49.131582+0000","last_undegraded":"2024-04-25T13:16:49.131582+0000","last_fullsized":"2024-04-25T13:16:49.131582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130170+0000","last_change":"2024-04-25T13:16:08.016413+0000","last_active":"2024-04-25T13:16:49.130170+0000","last_peered":"2024-04-25T13:16:49.130170+0000","last_clean":"2024-04-25T13:16:49.130170+0000","last_became_active":"2024-04-25T13:16:08.016084+0000","last_became_peered":"2024-04-25T13:16:08.016084+0000","last_unstale":"2024-04-25T13:16:49.130170+0000","last_undegraded":"2024-04-25T13:16:49.130170+0000","last_fullsized":"2024-04-25T13:16:49.130170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:41.014999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.138802+0000","last_change":"2024-04-25T13:16:49.138094+0000","last_active":"2024-04-25T13:16:49.138802+0000","last_peered":"2024-04-25T13:16:49.138802+0000","last_clean":"2024-04-25T13:16:49.138802+0000","last_became_active":"2024-04-25T13:16:49.137825+0000","last_became_peered":"2024-04-25T13:16:49.137825+0000","last_unstale":"2024-04-25T13:16:49.138802+0000","last_undegraded":"2024-04-25T13:16:49.138802+0000","last_fullsized":"2024-04-25T13:16:49.138802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236090+0000","last_change":"2024-04-25T13:16:08.012814+0000","last_active":"2024-04-25T13:16:49.236090+0000","last_peered":"2024-04-25T13:16:49.236090+0000","last_clean":"2024-04-25T13:16:49.236090+0000","last_became_active":"2024-04-25T13:16:08.012481+0000","last_became_peered":"2024-04-25T13:16:08.012481+0000","last_unstale":"2024-04-25T13:16:49.236090+0000","last_undegraded":"2024-04-25T13:16:49.236090+0000","last_fullsized":"2024-04-25T13:16:49.236090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129241+0000","last_change":"2024-04-25T13:16:08.008843+0000","last_active":"2024-04-25T13:16:49.129241+0000","last_peered":"2024-04-25T13:16:49.129241+0000","last_clean":"2024-04-25T13:16:49.129241+0000","last_became_active":"2024-04-25T13:16:08.008489+0000","last_became_peered":"2024-04-25T13:16:08.008489+0000","last_unstale":"2024-04-25T13:16:49.129241+0000","last_undegraded":"2024-04-25T13:16:49.129241+0000","last_fullsized":"2024-04-25T13:16:49.129241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236176+0000","last_change":"2024-04-25T13:16:08.008121+0000","last_active":"2024-04-25T13:16:49.236176+0000","last_peered":"2024-04-25T13:16:49.236176+0000","last_clean":"2024-04-25T13:16:49.236176+0000","last_became_active":"2024-04-25T13:16:08.007727+0000","last_became_peered":"2024-04-25T13:16:08.007727+0000","last_unstale":"2024-04-25T13:16:49.236176+0000","last_undegraded":"2024-04-25T13:16:49.236176+0000","last_fullsized":"2024-04-25T13:16:49.236176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:11.193610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236268+0000","last_change":"2024-04-25T13:16:08.014997+0000","last_active":"2024-04-25T13:16:49.236268+0000","last_peered":"2024-04-25T13:16:49.236268+0000","last_clean":"2024-04-25T13:16:49.236268+0000","last_became_active":"2024-04-25T13:16:08.014579+0000","last_became_peered":"2024-04-25T13:16:08.014579+0000","last_unstale":"2024-04-25T13:16:49.236268+0000","last_undegraded":"2024-04-25T13:16:49.236268+0000","last_fullsized":"2024-04-25T13:16:49.236268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129692+0000","last_change":"2024-04-25T13:16:08.015379+0000","last_active":"2024-04-25T13:16:49.129692+0000","last_peered":"2024-04-25T13:16:49.129692+0000","last_clean":"2024-04-25T13:16:49.129692+0000","last_became_active":"2024-04-25T13:16:08.014693+0000","last_became_peered":"2024-04-25T13:16:08.014693+0000","last_unstale":"2024-04-25T13:16:49.129692+0000","last_undegraded":"2024-04-25T13:16:49.129692+0000","last_fullsized":"2024-04-25T13:16:49.129692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:41.305358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235754+0000","last_change":"2024-04-25T13:16:08.014873+0000","last_active":"2024-04-25T13:16:49.235754+0000","last_peered":"2024-04-25T13:16:49.235754+0000","last_clean":"2024-04-25T13:16:49.235754+0000","last_became_active":"2024-04-25T13:16:08.014575+0000","last_became_peered":"2024-04-25T13:16:08.014575+0000","last_unstale":"2024-04-25T13:16:49.235754+0000","last_undegraded":"2024-04-25T13:16:49.235754+0000","last_fullsized":"2024-04-25T13:16:49.235754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.840714+0000","last_change":"2024-04-25T13:16:49.133825+0000","last_active":"2024-04-25T13:16:49.840714+0000","last_peered":"2024-04-25T13:16:49.840714+0000","last_clean":"2024-04-25T13:16:49.840714+0000","last_became_active":"2024-04-25T13:16:49.133449+0000","last_became_peered":"2024-04-25T13:16:49.133449+0000","last_unstale":"2024-04-25T13:16:49.840714+0000","last_undegraded":"2024-04-25T13:16:49.840714+0000","last_fullsized":"2024-04-25T13:16:49.840714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134848+0000","last_change":"2024-04-25T13:16:08.000447+0000","last_active":"2024-04-25T13:16:49.134848+0000","last_peered":"2024-04-25T13:16:49.134848+0000","last_clean":"2024-04-25T13:16:49.134848+0000","last_became_active":"2024-04-25T13:16:08.000102+0000","last_became_peered":"2024-04-25T13:16:08.000102+0000","last_unstale":"2024-04-25T13:16:49.134848+0000","last_undegraded":"2024-04-25T13:16:49.134848+0000","last_fullsized":"2024-04-25T13:16:49.134848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235889+0000","last_change":"2024-04-25T13:16:08.008437+0000","last_active":"2024-04-25T13:16:49.235889+0000","last_peered":"2024-04-25T13:16:49.235889+0000","last_clean":"2024-04-25T13:16:49.235889+0000","last_became_active":"2024-04-25T13:16:08.008173+0000","last_became_peered":"2024-04-25T13:16:08.008173+0000","last_unstale":"2024-04-25T13:16:49.235889+0000","last_undegraded":"2024-04-25T13:16:49.235889+0000","last_fullsized":"2024-04-25T13:16:49.235889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:54.362757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131654+0000","last_change":"2024-04-25T13:16:08.004689+0000","last_active":"2024-04-25T13:16:49.131654+0000","last_peered":"2024-04-25T13:16:49.131654+0000","last_clean":"2024-04-25T13:16:49.131654+0000","last_became_active":"2024-04-25T13:16:08.004340+0000","last_became_peered":"2024-04-25T13:16:08.004340+0000","last_unstale":"2024-04-25T13:16:49.131654+0000","last_undegraded":"2024-04-25T13:16:49.131654+0000","last_fullsized":"2024-04-25T13:16:49.131654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:18.870731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132296+0000","last_change":"2024-04-25T13:16:08.005344+0000","last_active":"2024-04-25T13:16:49.132296+0000","last_peered":"2024-04-25T13:16:49.132296+0000","last_clean":"2024-04-25T13:16:49.132296+0000","last_became_active":"2024-04-25T13:16:08.005041+0000","last_became_peered":"2024-04-25T13:16:08.005041+0000","last_unstale":"2024-04-25T13:16:49.132296+0000","last_undegraded":"2024-04-25T13:16:49.132296+0000","last_fullsized":"2024-04-25T13:16:49.132296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.840768+0000","last_change":"2024-04-25T13:16:49.135779+0000","last_active":"2024-04-25T13:16:49.840768+0000","last_peered":"2024-04-25T13:16:49.840768+0000","last_clean":"2024-04-25T13:16:49.840768+0000","last_became_active":"2024-04-25T13:16:49.135476+0000","last_became_peered":"2024-04-25T13:16:49.135476+0000","last_unstale":"2024-04-25T13:16:49.840768+0000","last_undegraded":"2024-04-25T13:16:49.840768+0000","last_fullsized":"2024-04-25T13:16:49.840768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129582+0000","last_change":"2024-04-25T13:16:08.012737+0000","last_active":"2024-04-25T13:16:49.129582+0000","last_peered":"2024-04-25T13:16:49.129582+0000","last_clean":"2024-04-25T13:16:49.129582+0000","last_became_active":"2024-04-25T13:16:08.012472+0000","last_became_peered":"2024-04-25T13:16:08.012472+0000","last_unstale":"2024-04-25T13:16:49.129582+0000","last_undegraded":"2024-04-25T13:16:49.129582+0000","last_fullsized":"2024-04-25T13:16:49.129582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:36.880757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.128946+0000","last_change":"2024-04-25T13:16:08.007177+0000","last_active":"2024-04-25T13:16:49.128946+0000","last_peered":"2024-04-25T13:16:49.128946+0000","last_clean":"2024-04-25T13:16:49.128946+0000","last_became_active":"2024-04-25T13:16:08.006866+0000","last_became_peered":"2024-04-25T13:16:08.006866+0000","last_unstale":"2024-04-25T13:16:49.128946+0000","last_undegraded":"2024-04-25T13:16:49.128946+0000","last_fullsized":"2024-04-25T13:16:49.128946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.133763+0000","last_change":"2024-04-25T13:16:07.999761+0000","last_active":"2024-04-25T13:16:49.133763+0000","last_peered":"2024-04-25T13:16:49.133763+0000","last_clean":"2024-04-25T13:16:49.133763+0000","last_became_active":"2024-04-25T13:16:07.999033+0000","last_became_peered":"2024-04-25T13:16:07.999033+0000","last_unstale":"2024-04-25T13:16:49.133763+0000","last_undegraded":"2024-04-25T13:16:49.133763+0000","last_fullsized":"2024-04-25T13:16:49.133763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235714+0000","last_change":"2024-04-25T13:16:08.016370+0000","last_active":"2024-04-25T13:16:49.235714+0000","last_peered":"2024-04-25T13:16:49.235714+0000","last_clean":"2024-04-25T13:16:49.235714+0000","last_became_active":"2024-04-25T13:16:08.016068+0000","last_became_peered":"2024-04-25T13:16:08.016068+0000","last_unstale":"2024-04-25T13:16:49.235714+0000","last_undegraded":"2024-04-25T13:16:49.235714+0000","last_fullsized":"2024-04-25T13:16:49.235714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.132457+0000","last_change":"2024-04-25T13:16:08.005195+0000","last_active":"2024-04-25T13:16:49.132457+0000","last_peered":"2024-04-25T13:16:49.132457+0000","last_clean":"2024-04-25T13:16:49.132457+0000","last_became_active":"2024-04-25T13:16:08.004655+0000","last_became_peered":"2024-04-25T13:16:08.004655+0000","last_unstale":"2024-04-25T13:16:49.132457+0000","last_undegraded":"2024-04-25T13:16:49.132457+0000","last_fullsized":"2024-04-25T13:16:49.132457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:28.249616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235787+0000","last_change":"2024-04-25T13:16:08.011310+0000","last_active":"2024-04-25T13:16:49.235787+0000","last_peered":"2024-04-25T13:16:49.235787+0000","last_clean":"2024-04-25T13:16:49.235787+0000","last_became_active":"2024-04-25T13:16:08.011047+0000","last_became_peered":"2024-04-25T13:16:08.011047+0000","last_unstale":"2024-04-25T13:16:49.235787+0000","last_undegraded":"2024-04-25T13:16:49.235787+0000","last_fullsized":"2024-04-25T13:16:49.235787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:55.447995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236059+0000","last_change":"2024-04-25T13:16:08.012191+0000","last_active":"2024-04-25T13:16:49.236059+0000","last_peered":"2024-04-25T13:16:49.236059+0000","last_clean":"2024-04-25T13:16:49.236059+0000","last_became_active":"2024-04-25T13:16:08.011916+0000","last_became_peered":"2024-04-25T13:16:08.011916+0000","last_unstale":"2024-04-25T13:16:49.236059+0000","last_undegraded":"2024-04-25T13:16:49.236059+0000","last_fullsized":"2024-04-25T13:16:49.236059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:33.520554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131648+0000","last_change":"2024-04-25T13:16:08.012349+0000","last_active":"2024-04-25T13:16:49.131648+0000","last_peered":"2024-04-25T13:16:49.131648+0000","last_clean":"2024-04-25T13:16:49.131648+0000","last_became_active":"2024-04-25T13:16:08.011893+0000","last_became_peered":"2024-04-25T13:16:08.011893+0000","last_unstale":"2024-04-25T13:16:49.131648+0000","last_undegraded":"2024-04-25T13:16:49.131648+0000","last_fullsized":"2024-04-25T13:16:49.131648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:11.901170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.236024+0000","last_change":"2024-04-25T13:16:08.015681+0000","last_active":"2024-04-25T13:16:49.236024+0000","last_peered":"2024-04-25T13:16:49.236024+0000","last_clean":"2024-04-25T13:16:49.236024+0000","last_became_active":"2024-04-25T13:16:08.015405+0000","last_became_peered":"2024-04-25T13:16:08.015405+0000","last_unstale":"2024-04-25T13:16:49.236024+0000","last_undegraded":"2024-04-25T13:16:49.236024+0000","last_fullsized":"2024-04-25T13:16:49.236024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130058+0000","last_change":"2024-04-25T13:16:08.000456+0000","last_active":"2024-04-25T13:16:49.130058+0000","last_peered":"2024-04-25T13:16:49.130058+0000","last_clean":"2024-04-25T13:16:49.130058+0000","last_became_active":"2024-04-25T13:16:08.000193+0000","last_became_peered":"2024-04-25T13:16:08.000193+0000","last_unstale":"2024-04-25T13:16:49.130058+0000","last_undegraded":"2024-04-25T13:16:49.130058+0000","last_fullsized":"2024-04-25T13:16:49.130058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:15.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129924+0000","last_change":"2024-04-25T13:16:08.016060+0000","last_active":"2024-04-25T13:16:49.129924+0000","last_peered":"2024-04-25T13:16:49.129924+0000","last_clean":"2024-04-25T13:16:49.129924+0000","last_became_active":"2024-04-25T13:16:08.014300+0000","last_became_peered":"2024-04-25T13:16:08.014300+0000","last_unstale":"2024-04-25T13:16:49.129924+0000","last_undegraded":"2024-04-25T13:16:49.129924+0000","last_fullsized":"2024-04-25T13:16:49.129924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:37.644887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.130981+0000","last_change":"2024-04-25T13:16:08.004946+0000","last_active":"2024-04-25T13:16:49.130981+0000","last_peered":"2024-04-25T13:16:49.130981+0000","last_clean":"2024-04-25T13:16:49.130981+0000","last_became_active":"2024-04-25T13:16:08.004673+0000","last_became_peered":"2024-04-25T13:16:08.004673+0000","last_unstale":"2024-04-25T13:16:49.130981+0000","last_undegraded":"2024-04-25T13:16:49.130981+0000","last_fullsized":"2024-04-25T13:16:49.130981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:18.616424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131000+0000","last_change":"2024-04-25T13:16:08.015676+0000","last_active":"2024-04-25T13:16:49.131000+0000","last_peered":"2024-04-25T13:16:49.131000+0000","last_clean":"2024-04-25T13:16:49.131000+0000","last_became_active":"2024-04-25T13:16:08.014719+0000","last_became_peered":"2024-04-25T13:16:08.014719+0000","last_unstale":"2024-04-25T13:16:49.131000+0000","last_undegraded":"2024-04-25T13:16:49.131000+0000","last_fullsized":"2024-04-25T13:16:49.131000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:04.274611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.134154+0000","last_change":"2024-04-25T13:16:07.997665+0000","last_active":"2024-04-25T13:16:49.134154+0000","last_peered":"2024-04-25T13:16:49.134154+0000","last_clean":"2024-04-25T13:16:49.134154+0000","last_became_active":"2024-04-25T13:16:07.996792+0000","last_became_peered":"2024-04-25T13:16:07.996792+0000","last_unstale":"2024-04-25T13:16:49.134154+0000","last_undegraded":"2024-04-25T13:16:49.134154+0000","last_fullsized":"2024-04-25T13:16:49.134154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.129796+0000","last_change":"2024-04-25T13:16:08.001495+0000","last_active":"2024-04-25T13:16:49.129796+0000","last_peered":"2024-04-25T13:16:49.129796+0000","last_clean":"2024-04-25T13:16:49.129796+0000","last_became_active":"2024-04-25T13:16:08.001182+0000","last_became_peered":"2024-04-25T13:16:08.001182+0000","last_unstale":"2024-04-25T13:16:49.129796+0000","last_undegraded":"2024-04-25T13:16:49.129796+0000","last_fullsized":"2024-04-25T13:16:49.129796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.131530+0000","last_change":"2024-04-25T13:16:08.006262+0000","last_active":"2024-04-25T13:16:49.131530+0000","last_peered":"2024-04-25T13:16:49.131530+0000","last_clean":"2024-04-25T13:16:49.131530+0000","last_became_active":"2024-04-25T13:16:08.005976+0000","last_became_peered":"2024-04-25T13:16:08.005976+0000","last_unstale":"2024-04-25T13:16:49.131530+0000","last_undegraded":"2024-04-25T13:16:49.131530+0000","last_fullsized":"2024-04-25T13:16:49.131530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:06.970947+0000","last_clean_scrub_stamp":"2024-04-25T13:16:06.970947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:22.965387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":714627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":127373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":126091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":123489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":127407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":123621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":123109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":913408,"data_stored":712819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:21.887 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.887 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.887 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.888 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.888 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.888 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.888 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.888 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.888 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.889 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.889 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.889 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.889 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.889 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.889 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.889 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.890 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.890 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.890 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.890 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.890 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.890 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.891 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.891 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.891 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.891 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.891 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.891 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.892 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.892 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.892 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.892 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.892 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.892 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.892 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.892 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.893 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.893 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.893 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.893 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.893 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.893 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.894 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.894 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.894 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.894 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.894 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T13:15:55.844647+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.894 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.894 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.895 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.895 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.895 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.895 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.895 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.895 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.896 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.896 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.896 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.896 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.896 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.896 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.896 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.897 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.897 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.897 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.897 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.897 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.897 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.898 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.898 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.898 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.898 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.898 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.898 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.899 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.899 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.899 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.899 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.899 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.899 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.899 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.899 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.900 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.900 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.900 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.900 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.900 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.900 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.900 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.901 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.901 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T13:16:05.967137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.901 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.901 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.901 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.901 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.901 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.902 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.902 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.902 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.902 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.902 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.902 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.903 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.903 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.903 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.903 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.903 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.903 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.903 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.904 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.904 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.904 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.904 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.904 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.904 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.904 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.905 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.905 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.905 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.905 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.905 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.905 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.906 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.906 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.906 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T13:16:06.970947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:21.906 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T13:17:40.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:17:40.004 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:17:41.907 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:42.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.010+0000 7f52e0010640 1 Processor -- start 2024-04-25T13:17:42.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.010+0000 7f52e0010640 1 -- start start 2024-04-25T13:17:42.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.011+0000 7f52e0010640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52d80b3c00 0x7f52d80b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:42.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.011+0000 7f52e0010640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f52d80b5450 0x7f52d80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:42.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.011+0000 7f52e0010640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d81558c0 con 0x7f52d81554e0 2024-04-25T13:17:42.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.011+0000 7f52e0010640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f52d80b4a80 con 0x7f52d80b5450 2024-04-25T13:17:42.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.011+0000 7f52e0010640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f52d80cb8c0 con 0x7f52d80b3c00 2024-04-25T13:17:42.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.011+0000 7f52dddac640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f52d81554e0 0x7f52d815f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33360/0 (socket says 172.21.15.52:33360) 2024-04-25T13:17:42.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.011+0000 7f52dddac640 1 -- 172.21.15.52:0/4141068354 learned_addr learned my addr 172.21.15.52:0/4141068354 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:17:42.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.012+0000 7f52de5ad640 1 --2- 172.21.15.52:0/4141068354 >> v2:172.21.15.102:3300/0 conn(0x7f52d80b5450 0x7f52d80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:42.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.012+0000 7f52dd5ab640 1 --2- 172.21.15.52:0/4141068354 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52d80b3c00 0x7f52d80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:42.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.012+0000 7f52dcdaa640 1 -- 172.21.15.52:0/4141068354 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2547226366 0 0) 0x7f52c8001110 con 0x7f52d81554e0 2024-04-25T13:17:42.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.012+0000 7f52dcdaa640 1 -- 172.21.15.52:0/4141068354 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52c4003520 con 0x7f52d81554e0 2024-04-25T13:17:42.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.012+0000 7f52dcdaa640 1 -- 172.21.15.52:0/4141068354 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3189561740 0 0) 0x7f52c4003520 con 0x7f52d81554e0 2024-04-25T13:17:42.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.012+0000 7f52de5ad640 1 -- 172.21.15.52:0/4141068354 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52d80b3c00 msgr2=0x7f52d80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:42.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.012+0000 7f52de5ad640 1 --2- 172.21.15.52:0/4141068354 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52d80b3c00 0x7f52d80b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:42.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.012+0000 7f52de5ad640 1 -- 172.21.15.52:0/4141068354 >> v1:172.21.15.52:6789/0 conn(0x7f52d81554e0 legacy=0x7f52d815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:42.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.012+0000 7f52de5ad640 1 -- 172.21.15.52:0/4141068354 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d80cbba0 con 0x7f52d80b5450 2024-04-25T13:17:42.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.012+0000 7f52dd5ab640 1 --2- 172.21.15.52:0/4141068354 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52d80b3c00 0x7f52d80b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:42.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.013+0000 7f52de5ad640 1 --2- 172.21.15.52:0/4141068354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52d80b5450 0x7f52d80d08a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009d90 tx=0x7f52d002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=956017a359e267e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:42.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.013+0000 7f52dcdaa640 1 -- 172.21.15.52:0/4141068354 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c8001840 con 0x7f52d80b5450 2024-04-25T13:17:42.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.013+0000 7f52dcdaa640 1 -- 172.21.15.52:0/4141068354 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d0007540 con 0x7f52d80b5450 2024-04-25T13:17:42.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.013+0000 7f52dcdaa640 1 -- 172.21.15.52:0/4141068354 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0007910 con 0x7f52d80b5450 2024-04-25T13:17:42.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.014+0000 7f52e0010640 1 -- 172.21.15.52:0/4141068354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52d80b5450 msgr2=0x7f52d80d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:42.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.014+0000 7f52e0010640 1 --2- 172.21.15.52:0/4141068354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52d80b5450 0x7f52d80d08a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009d90 tx=0x7f52d002a680 comp rx=0 tx=0).stop 2024-04-25T13:17:42.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.014+0000 7f52e0010640 1 -- 172.21.15.52:0/4141068354 shutdown_connections 2024-04-25T13:17:42.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.014+0000 7f52e0010640 1 --2- 172.21.15.52:0/4141068354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52d80b5450 0x7f52d80d08a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:42.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.014+0000 7f52e0010640 1 --2- 172.21.15.52:0/4141068354 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52d80b3c00 0x7f52d80b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:42.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.014+0000 7f52e0010640 1 -- 172.21.15.52:0/4141068354 >> 172.21.15.52:0/4141068354 conn(0x7f52d8074d50 msgr2=0x7f52d8075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:42.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.014+0000 7f52e0010640 1 -- 172.21.15.52:0/4141068354 shutdown_connections 2024-04-25T13:17:42.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.014+0000 7f52e0010640 1 -- 172.21.15.52:0/4141068354 wait complete. 2024-04-25T13:17:42.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.015+0000 7f52e0010640 1 Processor -- start 2024-04-25T13:17:42.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.015+0000 7f52e0010640 1 -- start start 2024-04-25T13:17:42.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.015+0000 7f52e0010640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d80b3c00 0x7f52d80c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:42.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.015+0000 7f52e0010640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52d80b5450 0x7f52d80c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:42.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.015+0000 7f52e0010640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52d81554e0 0x7f52d80ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:42.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.015+0000 7f52e0010640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f52d80b4710 con 0x7f52d80b3c00 2024-04-25T13:17:42.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.015+0000 7f52e0010640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f52d80b4430 con 0x7f52d81554e0 2024-04-25T13:17:42.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52e0010640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f52d80b3580 con 0x7f52d80b5450 2024-04-25T13:17:42.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52dddac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d80b3c00 0x7f52d80c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52dddac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d80b3c00 0x7f52d80c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43070/0 (socket says 172.21.15.52:43070) 2024-04-25T13:17:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52dddac640 1 -- 172.21.15.52:0/1789722809 learned_addr learned my addr 172.21.15.52:0/1789722809 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:17:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52de5ad640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52d81554e0 0x7f52d80ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52dd5ab640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52d80b5450 0x7f52d80c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52dddac640 1 -- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52d80b5450 msgr2=0x7f52d80c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52dddac640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52d80b5450 0x7f52d80c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52dddac640 1 -- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52d81554e0 msgr2=0x7f52d80ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52dddac640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52d81554e0 0x7f52d80ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52dddac640 1 -- 172.21.15.52:0/1789722809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d81f4720 con 0x7f52d80b3c00 2024-04-25T13:17:42.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52dddac640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d80b3c00 0x7f52d80c8150 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f52c800c750 tx=0x7f52c800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:42.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52ce7fc640 1 -- 172.21.15.52:0/1789722809 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c8017070 con 0x7f52d80b3c00 2024-04-25T13:17:42.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52ce7fc640 1 -- 172.21.15.52:0/1789722809 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c8005af0 con 0x7f52d80b3c00 2024-04-25T13:17:42.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52ce7fc640 1 -- 172.21.15.52:0/1789722809 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c8007070 con 0x7f52d80b3c00 2024-04-25T13:17:42.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52e0010640 1 -- 172.21.15.52:0/1789722809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d81f0ff0 con 0x7f52d80b3c00 2024-04-25T13:17:42.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.016+0000 7f52e0010640 1 -- 172.21.15.52:0/1789722809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d81f15b0 con 0x7f52d80b3c00 2024-04-25T13:17:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.017+0000 7f52e0010640 1 -- 172.21.15.52:0/1789722809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d8068e40 con 0x7f52d80b3c00 2024-04-25T13:17:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.018+0000 7f52ce7fc640 1 -- 172.21.15.52:0/1789722809 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52c801a070 con 0x7f52d80b3c00 2024-04-25T13:17:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.018+0000 7f52ce7fc640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f52bc06c8f0 0x7f52bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.018+0000 7f52ce7fc640 1 -- 172.21.15.52:0/1789722809 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f52c808b410 con 0x7f52d80b3c00 2024-04-25T13:17:42.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.019+0000 7f52dd5ab640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f52bc06c8f0 0x7f52bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:42.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.019+0000 7f52dd5ab640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f52bc06c8f0 0x7f52bc06edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009560 tx=0x7f52d4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:42.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.023+0000 7f52ce7fc640 1 -- 172.21.15.52:0/1789722809 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f52d81558c0 con 0x7f52d80b3c00 2024-04-25T13:17:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.207+0000 7f52e0010640 1 -- 172.21.15.52:0/1789722809 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52d8069440 con 0x7f52bc06c8f0 2024-04-25T13:17:42.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.215+0000 7f52ce7fc640 1 -- 172.21.15.52:0/1789722809 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332727 (secure 0 0 0) 0x7f52d8069440 con 0x7f52bc06c8f0 2024-04-25T13:17:42.218 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:17:42.220 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T13:17:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.219+0000 7f52e0010640 1 -- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f52bc06c8f0 msgr2=0x7f52bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.219+0000 7f52e0010640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f52bc06c8f0 0x7f52bc06edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009560 tx=0x7f52d4009190 comp rx=0 tx=0).stop 2024-04-25T13:17:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.219+0000 7f52e0010640 1 -- 172.21.15.52:0/1789722809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d80b3c00 msgr2=0x7f52d80c8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.219+0000 7f52e0010640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d80b3c00 0x7f52d80c8150 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f52c800c750 tx=0x7f52c800cc10 comp rx=0 tx=0).stop 2024-04-25T13:17:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.219+0000 7f52e0010640 1 -- 172.21.15.52:0/1789722809 shutdown_connections 2024-04-25T13:17:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.219+0000 7f52e0010640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f52bc06c8f0 0x7f52bc06edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.219+0000 7f52e0010640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52d80b5450 0x7f52d80c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.219+0000 7f52e0010640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52d81554e0 0x7f52d80ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.219+0000 7f52e0010640 1 --2- 172.21.15.52:0/1789722809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d80b3c00 0x7f52d80c8150 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.219+0000 7f52e0010640 1 -- 172.21.15.52:0/1789722809 >> 172.21.15.52:0/1789722809 conn(0x7f52d8074d50 msgr2=0x7f52d80cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.219+0000 7f52e0010640 1 -- 172.21.15.52:0/1789722809 shutdown_connections 2024-04-25T13:17:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:17:42.219+0000 7f52e0010640 1 -- 172.21.15.52:0/1789722809 wait complete. 2024-04-25T13:17:42.229 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-04-25T13:17:41.842861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":383,"ondisk_log_size":383,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236456,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738264,"statfs":{"total":773094113280,"available":772851982336,"internally_reserved":0,"allocated":3776512,"data_stored":2178536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003092"},"pg_stats":[{"pgid":"2.1f","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.421059+0000","last_change":"2024-04-25T13:17:19.421088+0000","last_active":"2024-04-25T13:17:19.421059+0000","last_peered":"2024-04-25T13:17:19.421059+0000","last_clean":"2024-04-25T13:17:19.421059+0000","last_became_active":"2024-04-25T13:16:07.000746+0000","last_became_peered":"2024-04-25T13:16:07.000746+0000","last_unstale":"2024-04-25T13:17:19.421059+0000","last_undegraded":"2024-04-25T13:17:19.421059+0000","last_fullsized":"2024-04-25T13:17:19.421059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-25T13:17:19.420993+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-25T13:17:19.420993+0000","last_clean_scrub_stamp":"2024-04-25T13:17:19.420993+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:40.185836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.125984+0000","last_change":"2024-04-25T13:17:31.126009+0000","last_active":"2024-04-25T13:17:31.125984+0000","last_peered":"2024-04-25T13:17:31.125984+0000","last_clean":"2024-04-25T13:17:31.125984+0000","last_became_active":"2024-04-25T13:16:08.012114+0000","last_became_peered":"2024-04-25T13:16:08.012114+0000","last_unstale":"2024-04-25T13:17:31.125984+0000","last_undegraded":"2024-04-25T13:17:31.125984+0000","last_fullsized":"2024-04-25T13:17:31.125984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.125895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.125895+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.125895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:35.008365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.118763+0000","last_change":"2024-04-25T13:17:39.118790+0000","last_active":"2024-04-25T13:17:39.118763+0000","last_peered":"2024-04-25T13:17:39.118763+0000","last_clean":"2024-04-25T13:17:39.118763+0000","last_became_active":"2024-04-25T13:16:12.734390+0000","last_became_peered":"2024-04-25T13:16:12.734390+0000","last_unstale":"2024-04-25T13:17:39.118763+0000","last_undegraded":"2024-04-25T13:17:39.118763+0000","last_fullsized":"2024-04-25T13:17:39.118763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.118660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.118660+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.118660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:00.237527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.071288+0000","last_change":"2024-04-25T13:17:27.071319+0000","last_active":"2024-04-25T13:17:27.071288+0000","last_peered":"2024-04-25T13:17:27.071288+0000","last_clean":"2024-04-25T13:17:27.071288+0000","last_became_active":"2024-04-25T13:16:06.999078+0000","last_became_peered":"2024-04-25T13:16:06.999078+0000","last_unstale":"2024-04-25T13:17:27.071288+0000","last_undegraded":"2024-04-25T13:17:27.071288+0000","last_fullsized":"2024-04-25T13:17:27.071288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-25T13:17:27.071197+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-25T13:17:27.071197+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.071197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:04.786584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.286809+0000","last_change":"2024-04-25T13:17:26.286838+0000","last_active":"2024-04-25T13:17:26.286809+0000","last_peered":"2024-04-25T13:17:26.286809+0000","last_clean":"2024-04-25T13:17:26.286809+0000","last_became_active":"2024-04-25T13:16:08.012036+0000","last_became_peered":"2024-04-25T13:16:08.012036+0000","last_unstale":"2024-04-25T13:17:26.286809+0000","last_undegraded":"2024-04-25T13:17:26.286809+0000","last_fullsized":"2024-04-25T13:17:26.286809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.286707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.286707+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.286707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:45.909474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.648824+0000","last_change":"2024-04-25T13:17:34.648850+0000","last_active":"2024-04-25T13:17:34.648824+0000","last_peered":"2024-04-25T13:17:34.648824+0000","last_clean":"2024-04-25T13:17:34.648824+0000","last_became_active":"2024-04-25T13:16:49.237674+0000","last_became_peered":"2024-04-25T13:16:49.237674+0000","last_unstale":"2024-04-25T13:17:34.648824+0000","last_undegraded":"2024-04-25T13:17:34.648824+0000","last_fullsized":"2024-04-25T13:17:34.648824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.648742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.648742+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.648742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:08.873397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.356012+0000","last_change":"2024-04-25T13:17:26.356068+0000","last_active":"2024-04-25T13:17:26.356012+0000","last_peered":"2024-04-25T13:17:26.356012+0000","last_clean":"2024-04-25T13:17:26.356012+0000","last_became_active":"2024-04-25T13:16:07.000751+0000","last_became_peered":"2024-04-25T13:16:07.000751+0000","last_unstale":"2024-04-25T13:17:26.356012+0000","last_undegraded":"2024-04-25T13:17:26.356012+0000","last_fullsized":"2024-04-25T13:17:26.356012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-04-25T13:17:26.355927+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-04-25T13:17:26.355927+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.355927+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:13.142648+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.962147+0000","last_change":"2024-04-25T13:17:26.962184+0000","last_active":"2024-04-25T13:17:26.962147+0000","last_peered":"2024-04-25T13:17:26.962147+0000","last_clean":"2024-04-25T13:17:26.962147+0000","last_became_active":"2024-04-25T13:16:08.011073+0000","last_became_peered":"2024-04-25T13:16:08.011073+0000","last_unstale":"2024-04-25T13:17:26.962147+0000","last_undegraded":"2024-04-25T13:17:26.962147+0000","last_fullsized":"2024-04-25T13:17:26.962147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.962058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.962058+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.962058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:29.040176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.664977+0000","last_change":"2024-04-25T13:17:33.665002+0000","last_active":"2024-04-25T13:17:33.664977+0000","last_peered":"2024-04-25T13:17:33.664977+0000","last_clean":"2024-04-25T13:17:33.664977+0000","last_became_active":"2024-04-25T13:16:49.237565+0000","last_became_peered":"2024-04-25T13:16:49.237565+0000","last_unstale":"2024-04-25T13:17:33.664977+0000","last_undegraded":"2024-04-25T13:17:33.664977+0000","last_fullsized":"2024-04-25T13:17:33.664977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.664881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.664881+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.664881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:08.371630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.284122+0000","last_change":"2024-04-25T13:17:30.284169+0000","last_active":"2024-04-25T13:17:30.284122+0000","last_peered":"2024-04-25T13:17:30.284122+0000","last_clean":"2024-04-25T13:17:30.284122+0000","last_became_active":"2024-04-25T13:16:07.003493+0000","last_became_peered":"2024-04-25T13:16:07.003493+0000","last_unstale":"2024-04-25T13:17:30.284122+0000","last_undegraded":"2024-04-25T13:17:30.284122+0000","last_fullsized":"2024-04-25T13:17:30.284122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T13:17:30.284026+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T13:17:30.284026+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.284026+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:32.779415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.955639+0000","last_change":"2024-04-25T13:17:28.955683+0000","last_active":"2024-04-25T13:17:28.955639+0000","last_peered":"2024-04-25T13:17:28.955639+0000","last_clean":"2024-04-25T13:17:28.955639+0000","last_became_active":"2024-04-25T13:16:08.011634+0000","last_became_peered":"2024-04-25T13:16:08.011634+0000","last_unstale":"2024-04-25T13:17:28.955639+0000","last_undegraded":"2024-04-25T13:17:28.955639+0000","last_fullsized":"2024-04-25T13:17:28.955639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.955531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.955531+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.955531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:15.786602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.550701+0000","last_change":"2024-04-25T13:17:28.550744+0000","last_active":"2024-04-25T13:17:28.550701+0000","last_peered":"2024-04-25T13:17:28.550701+0000","last_clean":"2024-04-25T13:17:28.550701+0000","last_became_active":"2024-04-25T13:16:12.038508+0000","last_became_peered":"2024-04-25T13:16:12.038508+0000","last_unstale":"2024-04-25T13:17:28.550701+0000","last_undegraded":"2024-04-25T13:17:28.550701+0000","last_fullsized":"2024-04-25T13:17:28.550701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.550609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.550609+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.550609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:45.101424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.244791+0000","last_change":"2024-04-25T13:17:26.244816+0000","last_active":"2024-04-25T13:17:26.244791+0000","last_peered":"2024-04-25T13:17:26.244791+0000","last_clean":"2024-04-25T13:17:26.244791+0000","last_became_active":"2024-04-25T13:16:08.007478+0000","last_became_peered":"2024-04-25T13:16:08.007478+0000","last_unstale":"2024-04-25T13:17:26.244791+0000","last_undegraded":"2024-04-25T13:17:26.244791+0000","last_fullsized":"2024-04-25T13:17:26.244791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.244708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.244708+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.244708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:18.767617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'6","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.355127+0000","last_change":"2024-04-25T13:17:27.355156+0000","last_active":"2024-04-25T13:17:27.355127+0000","last_peered":"2024-04-25T13:17:27.355127+0000","last_clean":"2024-04-25T13:17:27.355127+0000","last_became_active":"2024-04-25T13:16:07.000880+0000","last_became_peered":"2024-04-25T13:16:07.000880+0000","last_unstale":"2024-04-25T13:17:27.355127+0000","last_undegraded":"2024-04-25T13:17:27.355127+0000","last_fullsized":"2024-04-25T13:17:27.355127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T13:17:27.355046+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T13:17:27.355046+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.355046+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:01:35.725928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.528951+0000","last_change":"2024-04-25T13:17:26.528975+0000","last_active":"2024-04-25T13:17:26.528951+0000","last_peered":"2024-04-25T13:17:26.528951+0000","last_clean":"2024-04-25T13:17:26.528951+0000","last_became_active":"2024-04-25T13:16:12.036508+0000","last_became_peered":"2024-04-25T13:16:12.036508+0000","last_unstale":"2024-04-25T13:17:26.528951+0000","last_undegraded":"2024-04-25T13:17:26.528951+0000","last_fullsized":"2024-04-25T13:17:26.528951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.528865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.528865+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.528865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:37.524800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.155799+0000","last_change":"2024-04-25T13:17:32.155824+0000","last_active":"2024-04-25T13:17:32.155799+0000","last_peered":"2024-04-25T13:17:32.155799+0000","last_clean":"2024-04-25T13:17:32.155799+0000","last_became_active":"2024-04-25T13:16:08.013269+0000","last_became_peered":"2024-04-25T13:16:08.013269+0000","last_unstale":"2024-04-25T13:17:32.155799+0000","last_undegraded":"2024-04-25T13:17:32.155799+0000","last_fullsized":"2024-04-25T13:17:32.155799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.155711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.155711+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.155711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:18.189169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.438521+0000","last_change":"2024-04-25T13:17:22.438554+0000","last_active":"2024-04-25T13:17:22.438521+0000","last_peered":"2024-04-25T13:17:22.438521+0000","last_clean":"2024-04-25T13:17:22.438521+0000","last_became_active":"2024-04-25T13:16:06.993807+0000","last_became_peered":"2024-04-25T13:16:06.993807+0000","last_unstale":"2024-04-25T13:17:22.438521+0000","last_undegraded":"2024-04-25T13:17:22.438521+0000","last_fullsized":"2024-04-25T13:17:22.438521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:22.438431+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:22.438431+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.438431+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:25.580446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.604577+0000","last_change":"2024-04-25T13:17:30.604622+0000","last_active":"2024-04-25T13:17:30.604577+0000","last_peered":"2024-04-25T13:17:30.604577+0000","last_clean":"2024-04-25T13:17:30.604577+0000","last_became_active":"2024-04-25T13:16:12.038953+0000","last_became_peered":"2024-04-25T13:16:12.038953+0000","last_unstale":"2024-04-25T13:17:30.604577+0000","last_undegraded":"2024-04-25T13:17:30.604577+0000","last_fullsized":"2024-04-25T13:17:30.604577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.604481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.604481+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.604481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:04.473846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.092635+0000","last_change":"2024-04-25T13:17:29.092662+0000","last_active":"2024-04-25T13:17:29.092635+0000","last_peered":"2024-04-25T13:17:29.092635+0000","last_clean":"2024-04-25T13:17:29.092635+0000","last_became_active":"2024-04-25T13:16:08.008446+0000","last_became_peered":"2024-04-25T13:16:08.008446+0000","last_unstale":"2024-04-25T13:17:29.092635+0000","last_undegraded":"2024-04-25T13:17:29.092635+0000","last_fullsized":"2024-04-25T13:17:29.092635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.092541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.092541+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.092541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:04.543558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.424407+0000","last_change":"2024-04-25T13:17:21.424457+0000","last_active":"2024-04-25T13:17:21.424407+0000","last_peered":"2024-04-25T13:17:21.424407+0000","last_clean":"2024-04-25T13:17:21.424407+0000","last_became_active":"2024-04-25T13:16:06.992593+0000","last_became_peered":"2024-04-25T13:16:06.992593+0000","last_unstale":"2024-04-25T13:17:21.424407+0000","last_undegraded":"2024-04-25T13:17:21.424407+0000","last_fullsized":"2024-04-25T13:17:21.424407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T13:17:21.424304+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T13:17:21.424304+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.424304+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:47.921821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.365705+0000","last_change":"2024-04-25T13:17:34.365761+0000","last_active":"2024-04-25T13:17:34.365705+0000","last_peered":"2024-04-25T13:17:34.365705+0000","last_clean":"2024-04-25T13:17:34.365705+0000","last_became_active":"2024-04-25T13:16:12.733485+0000","last_became_peered":"2024-04-25T13:16:12.733485+0000","last_unstale":"2024-04-25T13:17:34.365705+0000","last_undegraded":"2024-04-25T13:17:34.365705+0000","last_fullsized":"2024-04-25T13:17:34.365705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.365603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.365603+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.365603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:25.113539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.541807+0000","last_change":"2024-04-25T13:17:21.541830+0000","last_active":"2024-04-25T13:17:21.541807+0000","last_peered":"2024-04-25T13:17:21.541807+0000","last_clean":"2024-04-25T13:17:21.541807+0000","last_became_active":"2024-04-25T13:16:07.998658+0000","last_became_peered":"2024-04-25T13:16:07.998658+0000","last_unstale":"2024-04-25T13:17:21.541807+0000","last_undegraded":"2024-04-25T13:17:21.541807+0000","last_fullsized":"2024-04-25T13:17:21.541807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:21.541723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:21.541723+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.541723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:20.645921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.347541+0000","last_change":"2024-04-25T13:17:28.347584+0000","last_active":"2024-04-25T13:17:28.347541+0000","last_peered":"2024-04-25T13:17:28.347541+0000","last_clean":"2024-04-25T13:17:28.347541+0000","last_became_active":"2024-04-25T13:16:07.000846+0000","last_became_peered":"2024-04-25T13:16:07.000846+0000","last_unstale":"2024-04-25T13:17:28.347541+0000","last_undegraded":"2024-04-25T13:17:28.347541+0000","last_fullsized":"2024-04-25T13:17:28.347541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T13:17:28.347428+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T13:17:28.347428+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.347428+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:26.579172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.571960+0000","last_change":"2024-04-25T13:17:27.571988+0000","last_active":"2024-04-25T13:17:27.571960+0000","last_peered":"2024-04-25T13:17:27.571960+0000","last_clean":"2024-04-25T13:17:27.571960+0000","last_became_active":"2024-04-25T13:16:12.038032+0000","last_became_peered":"2024-04-25T13:16:12.038032+0000","last_unstale":"2024-04-25T13:17:27.571960+0000","last_undegraded":"2024-04-25T13:17:27.571960+0000","last_fullsized":"2024-04-25T13:17:27.571960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.571876+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:08:57.006010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.423292+0000","last_change":"2024-04-25T13:17:21.423326+0000","last_active":"2024-04-25T13:17:21.423292+0000","last_peered":"2024-04-25T13:17:21.423292+0000","last_clean":"2024-04-25T13:17:21.423292+0000","last_became_active":"2024-04-25T13:16:07.998037+0000","last_became_peered":"2024-04-25T13:16:07.998037+0000","last_unstale":"2024-04-25T13:17:21.423292+0000","last_undegraded":"2024-04-25T13:17:21.423292+0000","last_fullsized":"2024-04-25T13:17:21.423292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:21.423203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:21.423203+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.423203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:52.331705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.214577+0000","last_change":"2024-04-25T13:17:23.214617+0000","last_active":"2024-04-25T13:17:23.214577+0000","last_peered":"2024-04-25T13:17:23.214577+0000","last_clean":"2024-04-25T13:17:23.214577+0000","last_became_active":"2024-04-25T13:16:06.995420+0000","last_became_peered":"2024-04-25T13:16:06.995420+0000","last_unstale":"2024-04-25T13:17:23.214577+0000","last_undegraded":"2024-04-25T13:17:23.214577+0000","last_fullsized":"2024-04-25T13:17:23.214577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T13:17:23.214497+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T13:17:23.214497+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.214497+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:40.554665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.669761+0000","last_change":"2024-04-25T13:17:32.669786+0000","last_active":"2024-04-25T13:17:32.669761+0000","last_peered":"2024-04-25T13:17:32.669761+0000","last_clean":"2024-04-25T13:17:32.669761+0000","last_became_active":"2024-04-25T13:16:12.733772+0000","last_became_peered":"2024-04-25T13:16:12.733772+0000","last_unstale":"2024-04-25T13:17:32.669761+0000","last_undegraded":"2024-04-25T13:17:32.669761+0000","last_fullsized":"2024-04-25T13:17:32.669761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.669678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.669678+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.669678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:58.871214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.986324+0000","last_change":"2024-04-25T13:17:22.986367+0000","last_active":"2024-04-25T13:17:22.986324+0000","last_peered":"2024-04-25T13:17:22.986324+0000","last_clean":"2024-04-25T13:17:22.986324+0000","last_became_active":"2024-04-25T13:16:08.017205+0000","last_became_peered":"2024-04-25T13:16:08.017205+0000","last_unstale":"2024-04-25T13:17:22.986324+0000","last_undegraded":"2024-04-25T13:17:22.986324+0000","last_fullsized":"2024-04-25T13:17:22.986324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:22.986222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:22.986222+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.986222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:03.690370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:20.412064+0000","last_change":"2024-04-25T13:17:20.412113+0000","last_active":"2024-04-25T13:17:20.412064+0000","last_peered":"2024-04-25T13:17:20.412064+0000","last_clean":"2024-04-25T13:17:20.412064+0000","last_became_active":"2024-04-25T13:16:06.991766+0000","last_became_peered":"2024-04-25T13:16:06.991766+0000","last_unstale":"2024-04-25T13:17:20.412064+0000","last_undegraded":"2024-04-25T13:17:20.412064+0000","last_fullsized":"2024-04-25T13:17:20.412064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T13:17:20.411986+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T13:17:20.411986+0000","last_clean_scrub_stamp":"2024-04-25T13:17:20.411986+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:10.695576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:16:49.235867+0000","last_change":"2024-04-25T13:16:12.734837+0000","last_active":"2024-04-25T13:16:49.235867+0000","last_peered":"2024-04-25T13:16:49.235867+0000","last_clean":"2024-04-25T13:16:49.235867+0000","last_became_active":"2024-04-25T13:16:12.734394+0000","last_became_peered":"2024-04-25T13:16:12.734394+0000","last_unstale":"2024-04-25T13:16:49.235867+0000","last_undegraded":"2024-04-25T13:16:49.235867+0000","last_fullsized":"2024-04-25T13:16:49.235867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:11.011040+0000","last_clean_scrub_stamp":"2024-04-25T13:16:11.011040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.341083+0000","last_change":"2024-04-25T13:17:26.341109+0000","last_active":"2024-04-25T13:17:26.341083+0000","last_peered":"2024-04-25T13:17:26.341083+0000","last_clean":"2024-04-25T13:17:26.341083+0000","last_became_active":"2024-04-25T13:16:07.999797+0000","last_became_peered":"2024-04-25T13:16:07.999797+0000","last_unstale":"2024-04-25T13:17:26.341083+0000","last_undegraded":"2024-04-25T13:17:26.341083+0000","last_fullsized":"2024-04-25T13:17:26.341083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.340964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.340964+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.340964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:24.427743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.311138+0000","last_change":"2024-04-25T13:17:29.311175+0000","last_active":"2024-04-25T13:17:29.311138+0000","last_peered":"2024-04-25T13:17:29.311138+0000","last_clean":"2024-04-25T13:17:29.311138+0000","last_became_active":"2024-04-25T13:16:07.001918+0000","last_became_peered":"2024-04-25T13:16:07.001918+0000","last_unstale":"2024-04-25T13:17:29.311138+0000","last_undegraded":"2024-04-25T13:17:29.311138+0000","last_fullsized":"2024-04-25T13:17:29.311138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T13:17:29.311056+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T13:17:29.311056+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.311056+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:54.153559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.200204+0000","last_change":"2024-04-25T13:17:29.200228+0000","last_active":"2024-04-25T13:17:29.200204+0000","last_peered":"2024-04-25T13:17:29.200204+0000","last_clean":"2024-04-25T13:17:29.200204+0000","last_became_active":"2024-04-25T13:16:12.733361+0000","last_became_peered":"2024-04-25T13:16:12.733361+0000","last_unstale":"2024-04-25T13:17:29.200204+0000","last_undegraded":"2024-04-25T13:17:29.200204+0000","last_fullsized":"2024-04-25T13:17:29.200204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.200106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.200106+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.200106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:17.928205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.021481+0000","last_change":"2024-04-25T13:17:35.021505+0000","last_active":"2024-04-25T13:17:35.021481+0000","last_peered":"2024-04-25T13:17:35.021481+0000","last_clean":"2024-04-25T13:17:35.021481+0000","last_became_active":"2024-04-25T13:16:08.015172+0000","last_became_peered":"2024-04-25T13:16:08.015172+0000","last_unstale":"2024-04-25T13:17:35.021481+0000","last_undegraded":"2024-04-25T13:17:35.021481+0000","last_fullsized":"2024-04-25T13:17:35.021481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.021398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.021398+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.021398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:27.216804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.452612+0000","last_change":"2024-04-25T13:17:23.452637+0000","last_active":"2024-04-25T13:17:23.452612+0000","last_peered":"2024-04-25T13:17:23.452612+0000","last_clean":"2024-04-25T13:17:23.452612+0000","last_became_active":"2024-04-25T13:16:06.995957+0000","last_became_peered":"2024-04-25T13:16:06.995957+0000","last_unstale":"2024-04-25T13:17:23.452612+0000","last_undegraded":"2024-04-25T13:17:23.452612+0000","last_fullsized":"2024-04-25T13:17:23.452612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-25T13:17:23.452531+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-25T13:17:23.452531+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.452531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:12.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.371301+0000","last_change":"2024-04-25T13:17:33.371332+0000","last_active":"2024-04-25T13:17:33.371301+0000","last_peered":"2024-04-25T13:17:33.371301+0000","last_clean":"2024-04-25T13:17:33.371301+0000","last_became_active":"2024-04-25T13:16:12.039987+0000","last_became_peered":"2024-04-25T13:16:12.039987+0000","last_unstale":"2024-04-25T13:17:33.371301+0000","last_undegraded":"2024-04-25T13:17:33.371301+0000","last_fullsized":"2024-04-25T13:17:33.371301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.371211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.371211+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.371211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:19.354130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.504622+0000","last_change":"2024-04-25T13:17:23.504643+0000","last_active":"2024-04-25T13:17:23.504622+0000","last_peered":"2024-04-25T13:17:23.504622+0000","last_clean":"2024-04-25T13:17:23.504622+0000","last_became_active":"2024-04-25T13:16:08.002131+0000","last_became_peered":"2024-04-25T13:16:08.002131+0000","last_unstale":"2024-04-25T13:17:23.504622+0000","last_undegraded":"2024-04-25T13:17:23.504622+0000","last_fullsized":"2024-04-25T13:17:23.504622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:23.504499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:23.504499+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.504499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:37.686374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.033733+0000","last_change":"2024-04-25T13:17:22.033779+0000","last_active":"2024-04-25T13:17:22.033733+0000","last_peered":"2024-04-25T13:17:22.033733+0000","last_clean":"2024-04-25T13:17:22.033733+0000","last_became_active":"2024-04-25T13:16:06.989652+0000","last_became_peered":"2024-04-25T13:16:06.989652+0000","last_unstale":"2024-04-25T13:17:22.033733+0000","last_undegraded":"2024-04-25T13:17:22.033733+0000","last_fullsized":"2024-04-25T13:17:22.033733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T13:17:22.033627+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T13:17:22.033627+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.033627+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:55.148753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.293911+0000","last_change":"2024-04-25T13:17:31.293934+0000","last_active":"2024-04-25T13:17:31.293911+0000","last_peered":"2024-04-25T13:17:31.293911+0000","last_clean":"2024-04-25T13:17:31.293911+0000","last_became_active":"2024-04-25T13:16:12.032184+0000","last_became_peered":"2024-04-25T13:16:12.032184+0000","last_unstale":"2024-04-25T13:17:31.293911+0000","last_undegraded":"2024-04-25T13:17:31.293911+0000","last_fullsized":"2024-04-25T13:17:31.293911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.293830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.293830+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.293830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:03.792249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.376393+0000","last_change":"2024-04-25T13:17:25.376443+0000","last_active":"2024-04-25T13:17:25.376393+0000","last_peered":"2024-04-25T13:17:25.376393+0000","last_clean":"2024-04-25T13:17:25.376393+0000","last_became_active":"2024-04-25T13:16:07.996545+0000","last_became_peered":"2024-04-25T13:16:07.996545+0000","last_unstale":"2024-04-25T13:17:25.376393+0000","last_undegraded":"2024-04-25T13:17:25.376393+0000","last_fullsized":"2024-04-25T13:17:25.376393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:25.376308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:25.376308+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.376308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:05.970732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.453630+0000","last_change":"2024-04-25T13:17:21.453654+0000","last_active":"2024-04-25T13:17:21.453630+0000","last_peered":"2024-04-25T13:17:21.453630+0000","last_clean":"2024-04-25T13:17:21.453630+0000","last_became_active":"2024-04-25T13:16:06.993387+0000","last_became_peered":"2024-04-25T13:16:06.993387+0000","last_unstale":"2024-04-25T13:17:21.453630+0000","last_undegraded":"2024-04-25T13:17:21.453630+0000","last_fullsized":"2024-04-25T13:17:21.453630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T13:17:21.453571+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T13:17:21.453571+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.453571+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:32.228548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.452973+0000","last_change":"2024-04-25T13:17:29.453003+0000","last_active":"2024-04-25T13:17:29.452973+0000","last_peered":"2024-04-25T13:17:29.452973+0000","last_clean":"2024-04-25T13:17:29.452973+0000","last_became_active":"2024-04-25T13:16:49.236873+0000","last_became_peered":"2024-04-25T13:16:49.236873+0000","last_unstale":"2024-04-25T13:17:29.452973+0000","last_undegraded":"2024-04-25T13:17:29.452973+0000","last_fullsized":"2024-04-25T13:17:29.452973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.452883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.452883+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.452883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:24.898285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.380160+0000","last_change":"2024-04-25T13:17:24.380184+0000","last_active":"2024-04-25T13:17:24.380160+0000","last_peered":"2024-04-25T13:17:24.380160+0000","last_clean":"2024-04-25T13:17:24.380160+0000","last_became_active":"2024-04-25T13:16:08.003908+0000","last_became_peered":"2024-04-25T13:16:08.003908+0000","last_unstale":"2024-04-25T13:17:24.380160+0000","last_undegraded":"2024-04-25T13:17:24.380160+0000","last_fullsized":"2024-04-25T13:17:24.380160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:24.380064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:24.380064+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.380064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:12.320176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.356284+0000","last_change":"2024-04-25T13:17:25.356313+0000","last_active":"2024-04-25T13:17:25.356284+0000","last_peered":"2024-04-25T13:17:25.356284+0000","last_clean":"2024-04-25T13:17:25.356284+0000","last_became_active":"2024-04-25T13:16:06.999126+0000","last_became_peered":"2024-04-25T13:16:06.999126+0000","last_unstale":"2024-04-25T13:17:25.356284+0000","last_undegraded":"2024-04-25T13:17:25.356284+0000","last_fullsized":"2024-04-25T13:17:25.356284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T13:17:25.356205+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T13:17:25.356205+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.356205+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:16.883930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.249363+0000","last_change":"2024-04-25T13:17:30.249390+0000","last_active":"2024-04-25T13:17:30.249363+0000","last_peered":"2024-04-25T13:17:30.249363+0000","last_clean":"2024-04-25T13:17:30.249363+0000","last_became_active":"2024-04-25T13:16:12.733316+0000","last_became_peered":"2024-04-25T13:16:12.733316+0000","last_unstale":"2024-04-25T13:17:30.249363+0000","last_undegraded":"2024-04-25T13:17:30.249363+0000","last_fullsized":"2024-04-25T13:17:30.249363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.249245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.249245+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.249245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:24.939225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.109091+0000","last_change":"2024-04-25T13:17:33.109160+0000","last_active":"2024-04-25T13:17:33.109091+0000","last_peered":"2024-04-25T13:17:33.109091+0000","last_clean":"2024-04-25T13:17:33.109091+0000","last_became_active":"2024-04-25T13:16:08.021346+0000","last_became_peered":"2024-04-25T13:16:08.021346+0000","last_unstale":"2024-04-25T13:17:33.109091+0000","last_undegraded":"2024-04-25T13:17:33.109091+0000","last_fullsized":"2024-04-25T13:17:33.109091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.108975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.108975+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.108975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:14.609712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.047886+0000","last_change":"2024-04-25T13:17:23.047949+0000","last_active":"2024-04-25T13:17:23.047886+0000","last_peered":"2024-04-25T13:17:23.047886+0000","last_clean":"2024-04-25T13:17:23.047886+0000","last_became_active":"2024-04-25T13:16:06.990379+0000","last_became_peered":"2024-04-25T13:16:06.990379+0000","last_unstale":"2024-04-25T13:17:23.047886+0000","last_undegraded":"2024-04-25T13:17:23.047886+0000","last_fullsized":"2024-04-25T13:17:23.047886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T13:17:23.047783+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T13:17:23.047783+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.047783+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:34.901040+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.398692+0000","last_change":"2024-04-25T13:17:24.398731+0000","last_active":"2024-04-25T13:17:24.398692+0000","last_peered":"2024-04-25T13:17:24.398692+0000","last_clean":"2024-04-25T13:17:24.398692+0000","last_became_active":"2024-04-25T13:15:57.167692+0000","last_became_peered":"2024-04-25T13:15:57.167692+0000","last_unstale":"2024-04-25T13:17:24.398692+0000","last_undegraded":"2024-04-25T13:17:24.398692+0000","last_fullsized":"2024-04-25T13:17:24.398692+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-25T13:17:24.398601+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-25T13:17:24.398601+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.398601+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:55.011248+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.201591+0000","last_change":"2024-04-25T13:17:35.201614+0000","last_active":"2024-04-25T13:17:35.201591+0000","last_peered":"2024-04-25T13:17:35.201591+0000","last_clean":"2024-04-25T13:17:35.201591+0000","last_became_active":"2024-04-25T13:16:12.734288+0000","last_became_peered":"2024-04-25T13:16:12.734288+0000","last_unstale":"2024-04-25T13:17:35.201591+0000","last_undegraded":"2024-04-25T13:17:35.201591+0000","last_fullsized":"2024-04-25T13:17:35.201591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.201512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.201512+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.201512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:47.236662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.363537+0000","last_change":"2024-04-25T13:17:39.363562+0000","last_active":"2024-04-25T13:17:39.363537+0000","last_peered":"2024-04-25T13:17:39.363537+0000","last_clean":"2024-04-25T13:17:39.363537+0000","last_became_active":"2024-04-25T13:16:08.013989+0000","last_became_peered":"2024-04-25T13:16:08.013989+0000","last_unstale":"2024-04-25T13:17:39.363537+0000","last_undegraded":"2024-04-25T13:17:39.363537+0000","last_fullsized":"2024-04-25T13:17:39.363537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.363454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.363454+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.363454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:24.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.489784+0000","last_change":"2024-04-25T13:17:22.489821+0000","last_active":"2024-04-25T13:17:22.489784+0000","last_peered":"2024-04-25T13:17:22.489784+0000","last_clean":"2024-04-25T13:17:22.489784+0000","last_became_active":"2024-04-25T13:16:06.996251+0000","last_became_peered":"2024-04-25T13:16:06.996251+0000","last_unstale":"2024-04-25T13:17:22.489784+0000","last_undegraded":"2024-04-25T13:17:22.489784+0000","last_fullsized":"2024-04-25T13:17:22.489784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T13:17:22.489690+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T13:17:22.489690+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.489690+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:56.624913+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.164342+0000","last_change":"2024-04-25T13:17:34.164369+0000","last_active":"2024-04-25T13:17:34.164342+0000","last_peered":"2024-04-25T13:17:34.164342+0000","last_clean":"2024-04-25T13:17:34.164342+0000","last_became_active":"2024-04-25T13:16:12.733114+0000","last_became_peered":"2024-04-25T13:16:12.733114+0000","last_unstale":"2024-04-25T13:17:34.164342+0000","last_undegraded":"2024-04-25T13:17:34.164342+0000","last_fullsized":"2024-04-25T13:17:34.164342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.164252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.164252+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.164252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:38.529575+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.925221+0000","last_change":"2024-04-25T13:17:27.925250+0000","last_active":"2024-04-25T13:17:27.925221+0000","last_peered":"2024-04-25T13:17:27.925221+0000","last_clean":"2024-04-25T13:17:27.925221+0000","last_became_active":"2024-04-25T13:16:08.011113+0000","last_became_peered":"2024-04-25T13:16:08.011113+0000","last_unstale":"2024-04-25T13:17:27.925221+0000","last_undegraded":"2024-04-25T13:17:27.925221+0000","last_fullsized":"2024-04-25T13:17:27.925221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.925106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.925106+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.925106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:19.036376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.381156+0000","last_change":"2024-04-25T13:17:19.381199+0000","last_active":"2024-04-25T13:17:19.381156+0000","last_peered":"2024-04-25T13:17:19.381156+0000","last_clean":"2024-04-25T13:17:19.381156+0000","last_became_active":"2024-04-25T13:16:06.988631+0000","last_became_peered":"2024-04-25T13:16:06.988631+0000","last_unstale":"2024-04-25T13:17:19.381156+0000","last_undegraded":"2024-04-25T13:17:19.381156+0000","last_fullsized":"2024-04-25T13:17:19.381156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:19.381072+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:19.381072+0000","last_clean_scrub_stamp":"2024-04-25T13:17:19.381072+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:02.009329+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.247148+0000","last_change":"2024-04-25T13:17:28.247176+0000","last_active":"2024-04-25T13:17:28.247148+0000","last_peered":"2024-04-25T13:17:28.247148+0000","last_clean":"2024-04-25T13:17:28.247148+0000","last_became_active":"2024-04-25T13:16:12.046780+0000","last_became_peered":"2024-04-25T13:16:12.046780+0000","last_unstale":"2024-04-25T13:17:28.247148+0000","last_undegraded":"2024-04-25T13:17:28.247148+0000","last_fullsized":"2024-04-25T13:17:28.247148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.247052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.247052+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.247052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:20.082472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.334439+0000","last_change":"2024-04-25T13:17:35.334463+0000","last_active":"2024-04-25T13:17:35.334439+0000","last_peered":"2024-04-25T13:17:35.334439+0000","last_clean":"2024-04-25T13:17:35.334439+0000","last_became_active":"2024-04-25T13:16:08.007681+0000","last_became_peered":"2024-04-25T13:16:08.007681+0000","last_unstale":"2024-04-25T13:17:35.334439+0000","last_undegraded":"2024-04-25T13:17:35.334439+0000","last_fullsized":"2024-04-25T13:17:35.334439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.334349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.334349+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.334349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:44.840474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:20.452162+0000","last_change":"2024-04-25T13:17:20.452188+0000","last_active":"2024-04-25T13:17:20.452162+0000","last_peered":"2024-04-25T13:17:20.452162+0000","last_clean":"2024-04-25T13:17:20.452162+0000","last_became_active":"2024-04-25T13:16:06.991578+0000","last_became_peered":"2024-04-25T13:16:06.991578+0000","last_unstale":"2024-04-25T13:17:20.452162+0000","last_undegraded":"2024-04-25T13:17:20.452162+0000","last_fullsized":"2024-04-25T13:17:20.452162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T13:17:20.452098+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T13:17:20.452098+0000","last_clean_scrub_stamp":"2024-04-25T13:17:20.452098+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:21.791926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.989581+0000","last_change":"2024-04-25T13:17:35.989610+0000","last_active":"2024-04-25T13:17:35.989581+0000","last_peered":"2024-04-25T13:17:35.989581+0000","last_clean":"2024-04-25T13:17:35.989581+0000","last_became_active":"2024-04-25T13:16:12.733136+0000","last_became_peered":"2024-04-25T13:16:12.733136+0000","last_unstale":"2024-04-25T13:17:35.989581+0000","last_undegraded":"2024-04-25T13:17:35.989581+0000","last_fullsized":"2024-04-25T13:17:35.989581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.989488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.989488+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.989488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:28.003597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.401571+0000","last_change":"2024-04-25T13:17:22.401601+0000","last_active":"2024-04-25T13:17:22.401571+0000","last_peered":"2024-04-25T13:17:22.401571+0000","last_clean":"2024-04-25T13:17:22.401571+0000","last_became_active":"2024-04-25T13:16:08.004180+0000","last_became_peered":"2024-04-25T13:16:08.004180+0000","last_unstale":"2024-04-25T13:17:22.401571+0000","last_undegraded":"2024-04-25T13:17:22.401571+0000","last_fullsized":"2024-04-25T13:17:22.401571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:22.401483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:22.401483+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.401483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.078452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:20.573428+0000","last_change":"2024-04-25T13:17:20.573456+0000","last_active":"2024-04-25T13:17:20.573428+0000","last_peered":"2024-04-25T13:17:20.573428+0000","last_clean":"2024-04-25T13:17:20.573428+0000","last_became_active":"2024-04-25T13:16:06.994235+0000","last_became_peered":"2024-04-25T13:16:06.994235+0000","last_unstale":"2024-04-25T13:17:20.573428+0000","last_undegraded":"2024-04-25T13:17:20.573428+0000","last_fullsized":"2024-04-25T13:17:20.573428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T13:17:20.573306+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T13:17:20.573306+0000","last_clean_scrub_stamp":"2024-04-25T13:17:20.573306+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:44.308553+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.577947+0000","last_change":"2024-04-25T13:17:29.577973+0000","last_active":"2024-04-25T13:17:29.577947+0000","last_peered":"2024-04-25T13:17:29.577947+0000","last_clean":"2024-04-25T13:17:29.577947+0000","last_became_active":"2024-04-25T13:16:12.038534+0000","last_became_peered":"2024-04-25T13:16:12.038534+0000","last_unstale":"2024-04-25T13:17:29.577947+0000","last_undegraded":"2024-04-25T13:17:29.577947+0000","last_fullsized":"2024-04-25T13:17:29.577947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.577856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.577856+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.577856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:25.559854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.321611+0000","last_change":"2024-04-25T13:17:34.321662+0000","last_active":"2024-04-25T13:17:34.321611+0000","last_peered":"2024-04-25T13:17:34.321611+0000","last_clean":"2024-04-25T13:17:34.321611+0000","last_became_active":"2024-04-25T13:16:08.007050+0000","last_became_peered":"2024-04-25T13:16:08.007050+0000","last_unstale":"2024-04-25T13:17:34.321611+0000","last_undegraded":"2024-04-25T13:17:34.321611+0000","last_fullsized":"2024-04-25T13:17:34.321611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.321509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.321509+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.321509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:49.436811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.416366+0000","last_change":"2024-04-25T13:17:19.416399+0000","last_active":"2024-04-25T13:17:19.416366+0000","last_peered":"2024-04-25T13:17:19.416366+0000","last_clean":"2024-04-25T13:17:19.416366+0000","last_became_active":"2024-04-25T13:16:06.982320+0000","last_became_peered":"2024-04-25T13:16:06.982320+0000","last_unstale":"2024-04-25T13:17:19.416366+0000","last_undegraded":"2024-04-25T13:17:19.416366+0000","last_fullsized":"2024-04-25T13:17:19.416366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-25T13:17:19.416275+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-25T13:17:19.416275+0000","last_clean_scrub_stamp":"2024-04-25T13:17:19.416275+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:40.159412+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.256342+0000","last_change":"2024-04-25T13:17:27.256368+0000","last_active":"2024-04-25T13:17:27.256342+0000","last_peered":"2024-04-25T13:17:27.256342+0000","last_clean":"2024-04-25T13:17:27.256342+0000","last_became_active":"2024-04-25T13:16:12.042902+0000","last_became_peered":"2024-04-25T13:16:12.042902+0000","last_unstale":"2024-04-25T13:17:27.256342+0000","last_undegraded":"2024-04-25T13:17:27.256342+0000","last_fullsized":"2024-04-25T13:17:27.256342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.256250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.256250+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.256250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:00.532550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.209142+0000","last_change":"2024-04-25T13:17:30.209165+0000","last_active":"2024-04-25T13:17:30.209142+0000","last_peered":"2024-04-25T13:17:30.209142+0000","last_clean":"2024-04-25T13:17:30.209142+0000","last_became_active":"2024-04-25T13:16:08.008102+0000","last_became_peered":"2024-04-25T13:16:08.008102+0000","last_unstale":"2024-04-25T13:17:30.209142+0000","last_undegraded":"2024-04-25T13:17:30.209142+0000","last_fullsized":"2024-04-25T13:17:30.209142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.209058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.209058+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.209058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:25.554448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.194410+0000","last_change":"2024-04-25T13:17:22.194441+0000","last_active":"2024-04-25T13:17:22.194410+0000","last_peered":"2024-04-25T13:17:22.194410+0000","last_clean":"2024-04-25T13:17:22.194410+0000","last_became_active":"2024-04-25T13:16:06.993008+0000","last_became_peered":"2024-04-25T13:16:06.993008+0000","last_unstale":"2024-04-25T13:17:22.194410+0000","last_undegraded":"2024-04-25T13:17:22.194410+0000","last_fullsized":"2024-04-25T13:17:22.194410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T13:17:22.194329+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T13:17:22.194329+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.194329+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:16.911178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.136695+0000","last_change":"2024-04-25T13:17:37.136722+0000","last_active":"2024-04-25T13:17:37.136695+0000","last_peered":"2024-04-25T13:17:37.136695+0000","last_clean":"2024-04-25T13:17:37.136695+0000","last_became_active":"2024-04-25T13:16:12.733359+0000","last_became_peered":"2024-04-25T13:16:12.733359+0000","last_unstale":"2024-04-25T13:17:37.136695+0000","last_undegraded":"2024-04-25T13:17:37.136695+0000","last_fullsized":"2024-04-25T13:17:37.136695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.136603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.136603+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.136603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:12.254489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.309852+0000","last_change":"2024-04-25T13:17:36.309888+0000","last_active":"2024-04-25T13:17:36.309852+0000","last_peered":"2024-04-25T13:17:36.309852+0000","last_clean":"2024-04-25T13:17:36.309852+0000","last_became_active":"2024-04-25T13:16:08.007790+0000","last_became_peered":"2024-04-25T13:16:08.007790+0000","last_unstale":"2024-04-25T13:17:36.309852+0000","last_undegraded":"2024-04-25T13:17:36.309852+0000","last_fullsized":"2024-04-25T13:17:36.309852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.309757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.309757+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.309757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:49.326246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.986564+0000","last_change":"2024-04-25T13:17:24.986625+0000","last_active":"2024-04-25T13:17:24.986564+0000","last_peered":"2024-04-25T13:17:24.986564+0000","last_clean":"2024-04-25T13:17:24.986564+0000","last_became_active":"2024-04-25T13:16:06.996439+0000","last_became_peered":"2024-04-25T13:16:06.996439+0000","last_unstale":"2024-04-25T13:17:24.986564+0000","last_undegraded":"2024-04-25T13:17:24.986564+0000","last_fullsized":"2024-04-25T13:17:24.986564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T13:17:24.986459+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T13:17:24.986459+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.986459+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:30.744200+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.136664+0000","last_change":"2024-04-25T13:17:38.136692+0000","last_active":"2024-04-25T13:17:38.136664+0000","last_peered":"2024-04-25T13:17:38.136664+0000","last_clean":"2024-04-25T13:17:38.136664+0000","last_became_active":"2024-04-25T13:16:12.733328+0000","last_became_peered":"2024-04-25T13:16:12.733328+0000","last_unstale":"2024-04-25T13:17:38.136664+0000","last_undegraded":"2024-04-25T13:17:38.136664+0000","last_fullsized":"2024-04-25T13:17:38.136664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.136570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.136570+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.136570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:52.154678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.453543+0000","last_change":"2024-04-25T13:17:28.453567+0000","last_active":"2024-04-25T13:17:28.453543+0000","last_peered":"2024-04-25T13:17:28.453543+0000","last_clean":"2024-04-25T13:17:28.453543+0000","last_became_active":"2024-04-25T13:16:49.135704+0000","last_became_peered":"2024-04-25T13:16:49.135704+0000","last_unstale":"2024-04-25T13:17:28.453543+0000","last_undegraded":"2024-04-25T13:17:28.453543+0000","last_fullsized":"2024-04-25T13:17:28.453543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.453462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.453462+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.453462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:30.347089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.13","version":"27'13","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:18.444587+0000","last_change":"2024-04-25T13:17:18.444644+0000","last_active":"2024-04-25T13:17:18.444587+0000","last_peered":"2024-04-25T13:17:18.444587+0000","last_clean":"2024-04-25T13:17:18.444587+0000","last_became_active":"2024-04-25T13:16:07.000243+0000","last_became_peered":"2024-04-25T13:16:07.000243+0000","last_unstale":"2024-04-25T13:17:18.444587+0000","last_undegraded":"2024-04-25T13:17:18.444587+0000","last_fullsized":"2024-04-25T13:17:18.444587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-04-25T13:17:18.444488+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-04-25T13:17:18.444488+0000","last_clean_scrub_stamp":"2024-04-25T13:17:18.444488+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:39:32.397333+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.973060+0000","last_change":"2024-04-25T13:17:36.973088+0000","last_active":"2024-04-25T13:17:36.973060+0000","last_peered":"2024-04-25T13:17:36.973060+0000","last_clean":"2024-04-25T13:17:36.973060+0000","last_became_active":"2024-04-25T13:16:12.733245+0000","last_became_peered":"2024-04-25T13:16:12.733245+0000","last_unstale":"2024-04-25T13:17:36.973060+0000","last_undegraded":"2024-04-25T13:17:36.973060+0000","last_fullsized":"2024-04-25T13:17:36.973060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.972919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.972919+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.972919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:24.100521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.354983+0000","last_change":"2024-04-25T13:17:37.355028+0000","last_active":"2024-04-25T13:17:37.354983+0000","last_peered":"2024-04-25T13:17:37.354983+0000","last_clean":"2024-04-25T13:17:37.354983+0000","last_became_active":"2024-04-25T13:16:08.008530+0000","last_became_peered":"2024-04-25T13:16:08.008530+0000","last_unstale":"2024-04-25T13:17:37.354983+0000","last_undegraded":"2024-04-25T13:17:37.354983+0000","last_fullsized":"2024-04-25T13:17:37.354983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.354902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.354902+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.354902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:27.028424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'19","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.221812+0000","last_change":"2024-04-25T13:17:25.221854+0000","last_active":"2024-04-25T13:17:25.221812+0000","last_peered":"2024-04-25T13:17:25.221812+0000","last_clean":"2024-04-25T13:17:25.221812+0000","last_became_active":"2024-04-25T13:16:06.997289+0000","last_became_peered":"2024-04-25T13:16:06.997289+0000","last_unstale":"2024-04-25T13:17:25.221812+0000","last_undegraded":"2024-04-25T13:17:25.221812+0000","last_fullsized":"2024-04-25T13:17:25.221812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-04-25T13:17:25.221727+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-04-25T13:17:25.221727+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.221727+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:18.743557+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.334636+0000","last_change":"2024-04-25T13:17:32.334661+0000","last_active":"2024-04-25T13:17:32.334636+0000","last_peered":"2024-04-25T13:17:32.334636+0000","last_clean":"2024-04-25T13:17:32.334636+0000","last_became_active":"2024-04-25T13:16:12.039443+0000","last_became_peered":"2024-04-25T13:16:12.039443+0000","last_unstale":"2024-04-25T13:17:32.334636+0000","last_undegraded":"2024-04-25T13:17:32.334636+0000","last_fullsized":"2024-04-25T13:17:32.334636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.334540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.334540+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.334540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:25.198912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.517981+0000","last_change":"2024-04-25T13:17:24.518011+0000","last_active":"2024-04-25T13:17:24.517981+0000","last_peered":"2024-04-25T13:17:24.517981+0000","last_clean":"2024-04-25T13:17:24.517981+0000","last_became_active":"2024-04-25T13:16:08.002583+0000","last_became_peered":"2024-04-25T13:16:08.002583+0000","last_unstale":"2024-04-25T13:17:24.517981+0000","last_undegraded":"2024-04-25T13:17:24.517981+0000","last_fullsized":"2024-04-25T13:17:24.517981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:24.517894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:24.517894+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.517894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:09.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.423380+0000","last_change":"2024-04-25T13:17:24.423413+0000","last_active":"2024-04-25T13:17:24.423380+0000","last_peered":"2024-04-25T13:17:24.423380+0000","last_clean":"2024-04-25T13:17:24.423380+0000","last_became_active":"2024-04-25T13:16:06.995616+0000","last_became_peered":"2024-04-25T13:16:06.995616+0000","last_unstale":"2024-04-25T13:17:24.423380+0000","last_undegraded":"2024-04-25T13:17:24.423380+0000","last_fullsized":"2024-04-25T13:17:24.423380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T13:17:24.423302+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T13:17:24.423302+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.423302+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:23.006424+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.631803+0000","last_change":"2024-04-25T13:17:31.631857+0000","last_active":"2024-04-25T13:17:31.631803+0000","last_peered":"2024-04-25T13:17:31.631803+0000","last_clean":"2024-04-25T13:17:31.631803+0000","last_became_active":"2024-04-25T13:16:12.043267+0000","last_became_peered":"2024-04-25T13:16:12.043267+0000","last_unstale":"2024-04-25T13:17:31.631803+0000","last_undegraded":"2024-04-25T13:17:31.631803+0000","last_fullsized":"2024-04-25T13:17:31.631803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.631707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.631707+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.631707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:46.469784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.220450+0000","last_change":"2024-04-25T13:17:32.220502+0000","last_active":"2024-04-25T13:17:32.220450+0000","last_peered":"2024-04-25T13:17:32.220450+0000","last_clean":"2024-04-25T13:17:32.220450+0000","last_became_active":"2024-04-25T13:16:49.136773+0000","last_became_peered":"2024-04-25T13:16:49.136773+0000","last_unstale":"2024-04-25T13:17:32.220450+0000","last_undegraded":"2024-04-25T13:17:32.220450+0000","last_fullsized":"2024-04-25T13:17:32.220450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.220358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.220358+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.220358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:18.538683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.954733+0000","last_change":"2024-04-25T13:17:25.954787+0000","last_active":"2024-04-25T13:17:25.954733+0000","last_peered":"2024-04-25T13:17:25.954733+0000","last_clean":"2024-04-25T13:17:25.954733+0000","last_became_active":"2024-04-25T13:16:06.996418+0000","last_became_peered":"2024-04-25T13:16:06.996418+0000","last_unstale":"2024-04-25T13:17:25.954733+0000","last_undegraded":"2024-04-25T13:17:25.954733+0000","last_fullsized":"2024-04-25T13:17:25.954733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T13:17:25.954648+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T13:17:25.954648+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.954648+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:23.229488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.090870+0000","last_change":"2024-04-25T13:17:35.090897+0000","last_active":"2024-04-25T13:17:35.090870+0000","last_peered":"2024-04-25T13:17:35.090870+0000","last_clean":"2024-04-25T13:17:35.090870+0000","last_became_active":"2024-04-25T13:16:12.042252+0000","last_became_peered":"2024-04-25T13:16:12.042252+0000","last_unstale":"2024-04-25T13:17:35.090870+0000","last_undegraded":"2024-04-25T13:17:35.090870+0000","last_fullsized":"2024-04-25T13:17:35.090870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.090769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.090769+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.090769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:08.391115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.019888+0000","last_change":"2024-04-25T13:17:33.019919+0000","last_active":"2024-04-25T13:17:33.019888+0000","last_peered":"2024-04-25T13:17:33.019888+0000","last_clean":"2024-04-25T13:17:33.019888+0000","last_became_active":"2024-04-25T13:16:08.015820+0000","last_became_peered":"2024-04-25T13:16:08.015820+0000","last_unstale":"2024-04-25T13:17:33.019888+0000","last_undegraded":"2024-04-25T13:17:33.019888+0000","last_fullsized":"2024-04-25T13:17:33.019888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.019786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.019786+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.019786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:22.853110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.175591+0000","last_change":"2024-04-25T13:17:24.175628+0000","last_active":"2024-04-25T13:17:24.175591+0000","last_peered":"2024-04-25T13:17:24.175591+0000","last_clean":"2024-04-25T13:17:24.175591+0000","last_became_active":"2024-04-25T13:16:06.996373+0000","last_became_peered":"2024-04-25T13:16:06.996373+0000","last_unstale":"2024-04-25T13:17:24.175591+0000","last_undegraded":"2024-04-25T13:17:24.175591+0000","last_fullsized":"2024-04-25T13:17:24.175591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T13:17:24.175503+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T13:17:24.175503+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.175503+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:44.379433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.110506+0000","last_change":"2024-04-25T13:17:36.110536+0000","last_active":"2024-04-25T13:17:36.110506+0000","last_peered":"2024-04-25T13:17:36.110506+0000","last_clean":"2024-04-25T13:17:36.110506+0000","last_became_active":"2024-04-25T13:16:12.733314+0000","last_became_peered":"2024-04-25T13:16:12.733314+0000","last_unstale":"2024-04-25T13:17:36.110506+0000","last_undegraded":"2024-04-25T13:17:36.110506+0000","last_fullsized":"2024-04-25T13:17:36.110506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.110405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.110405+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.110405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:38.559653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.256633+0000","last_change":"2024-04-25T13:17:31.256680+0000","last_active":"2024-04-25T13:17:31.256633+0000","last_peered":"2024-04-25T13:17:31.256633+0000","last_clean":"2024-04-25T13:17:31.256633+0000","last_became_active":"2024-04-25T13:16:12.733908+0000","last_became_peered":"2024-04-25T13:16:12.733908+0000","last_unstale":"2024-04-25T13:17:31.256633+0000","last_undegraded":"2024-04-25T13:17:31.256633+0000","last_fullsized":"2024-04-25T13:17:31.256633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.256540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.256540+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.256540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:43.843772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.281216+0000","last_change":"2024-04-25T13:17:30.281242+0000","last_active":"2024-04-25T13:17:30.281216+0000","last_peered":"2024-04-25T13:17:30.281216+0000","last_clean":"2024-04-25T13:17:30.281216+0000","last_became_active":"2024-04-25T13:16:08.008586+0000","last_became_peered":"2024-04-25T13:16:08.008586+0000","last_unstale":"2024-04-25T13:17:30.281216+0000","last_undegraded":"2024-04-25T13:17:30.281216+0000","last_fullsized":"2024-04-25T13:17:30.281216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.281130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.281130+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.281130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:16:50.209045+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.024557+0000","last_change":"2024-04-25T13:17:24.024590+0000","last_active":"2024-04-25T13:17:24.024557+0000","last_peered":"2024-04-25T13:17:24.024557+0000","last_clean":"2024-04-25T13:17:24.024557+0000","last_became_active":"2024-04-25T13:16:06.994005+0000","last_became_peered":"2024-04-25T13:16:06.994005+0000","last_unstale":"2024-04-25T13:17:24.024557+0000","last_undegraded":"2024-04-25T13:17:24.024557+0000","last_fullsized":"2024-04-25T13:17:24.024557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:24.024471+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:24.024471+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.024471+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:13.422592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.174940+0000","last_change":"2024-04-25T13:17:33.174965+0000","last_active":"2024-04-25T13:17:33.174940+0000","last_peered":"2024-04-25T13:17:33.174940+0000","last_clean":"2024-04-25T13:17:33.174940+0000","last_became_active":"2024-04-25T13:16:12.036569+0000","last_became_peered":"2024-04-25T13:16:12.036569+0000","last_unstale":"2024-04-25T13:17:33.174940+0000","last_undegraded":"2024-04-25T13:17:33.174940+0000","last_fullsized":"2024-04-25T13:17:33.174940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.174861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.174861+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.174861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:22.868372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.045257+0000","last_change":"2024-04-25T13:17:28.045296+0000","last_active":"2024-04-25T13:17:28.045257+0000","last_peered":"2024-04-25T13:17:28.045257+0000","last_clean":"2024-04-25T13:17:28.045257+0000","last_became_active":"2024-04-25T13:16:08.008078+0000","last_became_peered":"2024-04-25T13:16:08.008078+0000","last_unstale":"2024-04-25T13:17:28.045257+0000","last_undegraded":"2024-04-25T13:17:28.045257+0000","last_fullsized":"2024-04-25T13:17:28.045257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.045170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.045170+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.045170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:15.593975+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.057987+0000","last_change":"2024-04-25T13:17:26.058019+0000","last_active":"2024-04-25T13:17:26.057987+0000","last_peered":"2024-04-25T13:17:26.057987+0000","last_clean":"2024-04-25T13:17:26.057987+0000","last_became_active":"2024-04-25T13:16:06.996985+0000","last_became_peered":"2024-04-25T13:16:06.996985+0000","last_unstale":"2024-04-25T13:17:26.057987+0000","last_undegraded":"2024-04-25T13:17:26.057987+0000","last_fullsized":"2024-04-25T13:17:26.057987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:26.057902+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:26.057902+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.057902+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:00.699389+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.162900+0000","last_change":"2024-04-25T13:17:21.162952+0000","last_active":"2024-04-25T13:17:21.162900+0000","last_peered":"2024-04-25T13:17:21.162900+0000","last_clean":"2024-04-25T13:17:21.162900+0000","last_became_active":"2024-04-25T13:16:06.992407+0000","last_became_peered":"2024-04-25T13:16:06.992407+0000","last_unstale":"2024-04-25T13:17:21.162900+0000","last_undegraded":"2024-04-25T13:17:21.162900+0000","last_fullsized":"2024-04-25T13:17:21.162900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T13:17:21.162784+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T13:17:21.162784+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.162784+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:47.666696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.335642+0000","last_change":"2024-04-25T13:17:25.335670+0000","last_active":"2024-04-25T13:17:25.335642+0000","last_peered":"2024-04-25T13:17:25.335642+0000","last_clean":"2024-04-25T13:17:25.335642+0000","last_became_active":"2024-04-25T13:16:08.003959+0000","last_became_peered":"2024-04-25T13:16:08.003959+0000","last_unstale":"2024-04-25T13:17:25.335642+0000","last_undegraded":"2024-04-25T13:17:25.335642+0000","last_fullsized":"2024-04-25T13:17:25.335642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:25.335552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:25.335552+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.335552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:36.584211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.449092+0000","last_change":"2024-04-25T13:17:25.449121+0000","last_active":"2024-04-25T13:17:25.449092+0000","last_peered":"2024-04-25T13:17:25.449092+0000","last_clean":"2024-04-25T13:17:25.449092+0000","last_became_active":"2024-04-25T13:16:12.036651+0000","last_became_peered":"2024-04-25T13:16:12.036651+0000","last_unstale":"2024-04-25T13:17:25.449092+0000","last_undegraded":"2024-04-25T13:17:25.449092+0000","last_fullsized":"2024-04-25T13:17:25.449092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:25.448992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:25.448992+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.448992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:49.007955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.039507+0000","last_change":"2024-04-25T13:17:25.039538+0000","last_active":"2024-04-25T13:17:25.039507+0000","last_peered":"2024-04-25T13:17:25.039507+0000","last_clean":"2024-04-25T13:17:25.039507+0000","last_became_active":"2024-04-25T13:16:06.996010+0000","last_became_peered":"2024-04-25T13:16:06.996010+0000","last_unstale":"2024-04-25T13:17:25.039507+0000","last_undegraded":"2024-04-25T13:17:25.039507+0000","last_fullsized":"2024-04-25T13:17:25.039507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T13:17:25.039429+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T13:17:25.039429+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.039429+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:55.868188+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.502519+0000","last_change":"2024-04-25T13:17:22.502541+0000","last_active":"2024-04-25T13:17:22.502519+0000","last_peered":"2024-04-25T13:17:22.502519+0000","last_clean":"2024-04-25T13:17:22.502519+0000","last_became_active":"2024-04-25T13:16:08.001833+0000","last_became_peered":"2024-04-25T13:16:08.001833+0000","last_unstale":"2024-04-25T13:17:22.502519+0000","last_undegraded":"2024-04-25T13:17:22.502519+0000","last_fullsized":"2024-04-25T13:17:22.502519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:22.502444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:22.502444+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.502444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:13.756726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.116970+0000","last_change":"2024-04-25T13:17:34.116997+0000","last_active":"2024-04-25T13:17:34.116970+0000","last_peered":"2024-04-25T13:17:34.116970+0000","last_clean":"2024-04-25T13:17:34.116970+0000","last_became_active":"2024-04-25T13:16:12.042000+0000","last_became_peered":"2024-04-25T13:16:12.042000+0000","last_unstale":"2024-04-25T13:17:34.116970+0000","last_undegraded":"2024-04-25T13:17:34.116970+0000","last_fullsized":"2024-04-25T13:17:34.116970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.116877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.116877+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.116877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:16:48.434664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.255373+0000","last_change":"2024-04-25T13:17:28.255396+0000","last_active":"2024-04-25T13:17:28.255373+0000","last_peered":"2024-04-25T13:17:28.255373+0000","last_clean":"2024-04-25T13:17:28.255373+0000","last_became_active":"2024-04-25T13:16:08.007728+0000","last_became_peered":"2024-04-25T13:16:08.007728+0000","last_unstale":"2024-04-25T13:17:28.255373+0000","last_undegraded":"2024-04-25T13:17:28.255373+0000","last_fullsized":"2024-04-25T13:17:28.255373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.255292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.255292+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.255292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:01.389332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.435514+0000","last_change":"2024-04-25T13:17:24.435538+0000","last_active":"2024-04-25T13:17:24.435514+0000","last_peered":"2024-04-25T13:17:24.435514+0000","last_clean":"2024-04-25T13:17:24.435514+0000","last_became_active":"2024-04-25T13:16:08.010981+0000","last_became_peered":"2024-04-25T13:16:08.010981+0000","last_unstale":"2024-04-25T13:17:24.435514+0000","last_undegraded":"2024-04-25T13:17:24.435514+0000","last_fullsized":"2024-04-25T13:17:24.435514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:24.435431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:24.435431+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.435431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:50.837464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.998903+0000","last_change":"2024-04-25T13:17:33.998923+0000","last_active":"2024-04-25T13:17:33.998903+0000","last_peered":"2024-04-25T13:17:33.998903+0000","last_clean":"2024-04-25T13:17:33.998903+0000","last_became_active":"2024-04-25T13:16:08.016084+0000","last_became_peered":"2024-04-25T13:16:08.016084+0000","last_unstale":"2024-04-25T13:17:33.998903+0000","last_undegraded":"2024-04-25T13:17:33.998903+0000","last_fullsized":"2024-04-25T13:17:33.998903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.998800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.998800+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.998800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:24.211041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.209615+0000","last_change":"2024-04-25T13:17:33.209640+0000","last_active":"2024-04-25T13:17:33.209615+0000","last_peered":"2024-04-25T13:17:33.209615+0000","last_clean":"2024-04-25T13:17:33.209615+0000","last_became_active":"2024-04-25T13:16:49.137825+0000","last_became_peered":"2024-04-25T13:16:49.137825+0000","last_unstale":"2024-04-25T13:17:33.209615+0000","last_undegraded":"2024-04-25T13:17:33.209615+0000","last_fullsized":"2024-04-25T13:17:33.209615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.209532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.209532+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.209532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:12.857719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.127057+0000","last_change":"2024-04-25T13:17:30.127081+0000","last_active":"2024-04-25T13:17:30.127057+0000","last_peered":"2024-04-25T13:17:30.127057+0000","last_clean":"2024-04-25T13:17:30.127057+0000","last_became_active":"2024-04-25T13:16:08.012481+0000","last_became_peered":"2024-04-25T13:16:08.012481+0000","last_unstale":"2024-04-25T13:17:30.127057+0000","last_undegraded":"2024-04-25T13:17:30.127057+0000","last_fullsized":"2024-04-25T13:17:30.127057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.126957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.126957+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.126957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:44.965035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.305189+0000","last_change":"2024-04-25T13:17:29.305214+0000","last_active":"2024-04-25T13:17:29.305189+0000","last_peered":"2024-04-25T13:17:29.305189+0000","last_clean":"2024-04-25T13:17:29.305189+0000","last_became_active":"2024-04-25T13:16:08.008489+0000","last_became_peered":"2024-04-25T13:16:08.008489+0000","last_unstale":"2024-04-25T13:17:29.305189+0000","last_undegraded":"2024-04-25T13:17:29.305189+0000","last_fullsized":"2024-04-25T13:17:29.305189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.305102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.305102+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.305102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:49.057062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.258251+0000","last_change":"2024-04-25T13:17:27.258301+0000","last_active":"2024-04-25T13:17:27.258251+0000","last_peered":"2024-04-25T13:17:27.258251+0000","last_clean":"2024-04-25T13:17:27.258251+0000","last_became_active":"2024-04-25T13:16:08.007727+0000","last_became_peered":"2024-04-25T13:16:08.007727+0000","last_unstale":"2024-04-25T13:17:27.258251+0000","last_undegraded":"2024-04-25T13:17:27.258251+0000","last_fullsized":"2024-04-25T13:17:27.258251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.258154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.258154+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.258154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:18.512436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.940233+0000","last_change":"2024-04-25T13:17:21.940259+0000","last_active":"2024-04-25T13:17:21.940233+0000","last_peered":"2024-04-25T13:17:21.940233+0000","last_clean":"2024-04-25T13:17:21.940233+0000","last_became_active":"2024-04-25T13:16:08.014579+0000","last_became_peered":"2024-04-25T13:16:08.014579+0000","last_unstale":"2024-04-25T13:17:21.940233+0000","last_undegraded":"2024-04-25T13:17:21.940233+0000","last_fullsized":"2024-04-25T13:17:21.940233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:21.940159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:21.940159+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.940159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:47.447961+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.983513+0000","last_change":"2024-04-25T13:17:29.983535+0000","last_active":"2024-04-25T13:17:29.983513+0000","last_peered":"2024-04-25T13:17:29.983513+0000","last_clean":"2024-04-25T13:17:29.983513+0000","last_became_active":"2024-04-25T13:16:08.014693+0000","last_became_peered":"2024-04-25T13:16:08.014693+0000","last_unstale":"2024-04-25T13:17:29.983513+0000","last_undegraded":"2024-04-25T13:17:29.983513+0000","last_fullsized":"2024-04-25T13:17:29.983513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.983403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.983403+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.983403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:45.588387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.032539+0000","last_change":"2024-04-25T13:17:24.032567+0000","last_active":"2024-04-25T13:17:24.032539+0000","last_peered":"2024-04-25T13:17:24.032539+0000","last_clean":"2024-04-25T13:17:24.032539+0000","last_became_active":"2024-04-25T13:16:08.014575+0000","last_became_peered":"2024-04-25T13:16:08.014575+0000","last_unstale":"2024-04-25T13:17:24.032539+0000","last_undegraded":"2024-04-25T13:17:24.032539+0000","last_fullsized":"2024-04-25T13:17:24.032539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:24.032452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:24.032452+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.032452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:59.051739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.444664+0000","last_change":"2024-04-25T13:17:26.444686+0000","last_active":"2024-04-25T13:17:26.444664+0000","last_peered":"2024-04-25T13:17:26.444664+0000","last_clean":"2024-04-25T13:17:26.444664+0000","last_became_active":"2024-04-25T13:16:49.133449+0000","last_became_peered":"2024-04-25T13:16:49.133449+0000","last_unstale":"2024-04-25T13:17:26.444664+0000","last_undegraded":"2024-04-25T13:17:26.444664+0000","last_fullsized":"2024-04-25T13:17:26.444664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.444568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.444568+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.444568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:10.506124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.425700+0000","last_change":"2024-04-25T13:17:23.425741+0000","last_active":"2024-04-25T13:17:23.425700+0000","last_peered":"2024-04-25T13:17:23.425700+0000","last_clean":"2024-04-25T13:17:23.425700+0000","last_became_active":"2024-04-25T13:16:08.000102+0000","last_became_peered":"2024-04-25T13:16:08.000102+0000","last_unstale":"2024-04-25T13:17:23.425700+0000","last_undegraded":"2024-04-25T13:17:23.425700+0000","last_fullsized":"2024-04-25T13:17:23.425700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:23.425599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:23.425599+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.425599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:26.901720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.255829+0000","last_change":"2024-04-25T13:17:29.255851+0000","last_active":"2024-04-25T13:17:29.255829+0000","last_peered":"2024-04-25T13:17:29.255829+0000","last_clean":"2024-04-25T13:17:29.255829+0000","last_became_active":"2024-04-25T13:16:08.008173+0000","last_became_peered":"2024-04-25T13:16:08.008173+0000","last_unstale":"2024-04-25T13:17:29.255829+0000","last_undegraded":"2024-04-25T13:17:29.255829+0000","last_fullsized":"2024-04-25T13:17:29.255829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.255745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.255745+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.255745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:43.639435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.426502+0000","last_change":"2024-04-25T13:17:23.426525+0000","last_active":"2024-04-25T13:17:23.426502+0000","last_peered":"2024-04-25T13:17:23.426502+0000","last_clean":"2024-04-25T13:17:23.426502+0000","last_became_active":"2024-04-25T13:16:08.004340+0000","last_became_peered":"2024-04-25T13:16:08.004340+0000","last_unstale":"2024-04-25T13:17:23.426502+0000","last_undegraded":"2024-04-25T13:17:23.426502+0000","last_fullsized":"2024-04-25T13:17:23.426502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:23.426430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:23.426430+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.426430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:40.584178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.440592+0000","last_change":"2024-04-25T13:17:23.440621+0000","last_active":"2024-04-25T13:17:23.440592+0000","last_peered":"2024-04-25T13:17:23.440592+0000","last_clean":"2024-04-25T13:17:23.440592+0000","last_became_active":"2024-04-25T13:16:08.005041+0000","last_became_peered":"2024-04-25T13:16:08.005041+0000","last_unstale":"2024-04-25T13:17:23.440592+0000","last_undegraded":"2024-04-25T13:17:23.440592+0000","last_fullsized":"2024-04-25T13:17:23.440592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:23.440506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:23.440506+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.440506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:24.582404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.467846+0000","last_change":"2024-04-25T13:17:27.467873+0000","last_active":"2024-04-25T13:17:27.467846+0000","last_peered":"2024-04-25T13:17:27.467846+0000","last_clean":"2024-04-25T13:17:27.467846+0000","last_became_active":"2024-04-25T13:16:49.135476+0000","last_became_peered":"2024-04-25T13:16:49.135476+0000","last_unstale":"2024-04-25T13:17:27.467846+0000","last_undegraded":"2024-04-25T13:17:27.467846+0000","last_fullsized":"2024-04-25T13:17:27.467846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.467765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.467765+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.467765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:44:19.718055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.064912+0000","last_change":"2024-04-25T13:17:21.064934+0000","last_active":"2024-04-25T13:17:21.064912+0000","last_peered":"2024-04-25T13:17:21.064912+0000","last_clean":"2024-04-25T13:17:21.064912+0000","last_became_active":"2024-04-25T13:16:08.012472+0000","last_became_peered":"2024-04-25T13:16:08.012472+0000","last_unstale":"2024-04-25T13:17:21.064912+0000","last_undegraded":"2024-04-25T13:17:21.064912+0000","last_fullsized":"2024-04-25T13:17:21.064912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:21.064834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:21.064834+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.064834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:38.103238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.289212+0000","last_change":"2024-04-25T13:17:28.289254+0000","last_active":"2024-04-25T13:17:28.289212+0000","last_peered":"2024-04-25T13:17:28.289212+0000","last_clean":"2024-04-25T13:17:28.289212+0000","last_became_active":"2024-04-25T13:16:08.006866+0000","last_became_peered":"2024-04-25T13:16:08.006866+0000","last_unstale":"2024-04-25T13:17:28.289212+0000","last_undegraded":"2024-04-25T13:17:28.289212+0000","last_fullsized":"2024-04-25T13:17:28.289212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.289113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.289113+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.289113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:25.533017+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.425541+0000","last_change":"2024-04-25T13:17:22.425562+0000","last_active":"2024-04-25T13:17:22.425541+0000","last_peered":"2024-04-25T13:17:22.425541+0000","last_clean":"2024-04-25T13:17:22.425541+0000","last_became_active":"2024-04-25T13:16:07.999033+0000","last_became_peered":"2024-04-25T13:16:07.999033+0000","last_unstale":"2024-04-25T13:17:22.425541+0000","last_undegraded":"2024-04-25T13:17:22.425541+0000","last_fullsized":"2024-04-25T13:17:22.425541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:22.425457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:22.425457+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.425457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:26.351777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:20.941532+0000","last_change":"2024-04-25T13:17:20.941551+0000","last_active":"2024-04-25T13:17:20.941532+0000","last_peered":"2024-04-25T13:17:20.941532+0000","last_clean":"2024-04-25T13:17:20.941532+0000","last_became_active":"2024-04-25T13:16:08.016068+0000","last_became_peered":"2024-04-25T13:16:08.016068+0000","last_unstale":"2024-04-25T13:17:20.941532+0000","last_undegraded":"2024-04-25T13:17:20.941532+0000","last_fullsized":"2024-04-25T13:17:20.941532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:20.941452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:20.941452+0000","last_clean_scrub_stamp":"2024-04-25T13:17:20.941452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:50.538881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.553155+0000","last_change":"2024-04-25T13:17:25.553179+0000","last_active":"2024-04-25T13:17:25.553155+0000","last_peered":"2024-04-25T13:17:25.553155+0000","last_clean":"2024-04-25T13:17:25.553155+0000","last_became_active":"2024-04-25T13:16:08.004655+0000","last_became_peered":"2024-04-25T13:16:08.004655+0000","last_unstale":"2024-04-25T13:17:25.553155+0000","last_undegraded":"2024-04-25T13:17:25.553155+0000","last_fullsized":"2024-04-25T13:17:25.553155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:25.553071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:25.553071+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.553071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:06.122559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.184852+0000","last_change":"2024-04-25T13:17:31.184880+0000","last_active":"2024-04-25T13:17:31.184852+0000","last_peered":"2024-04-25T13:17:31.184852+0000","last_clean":"2024-04-25T13:17:31.184852+0000","last_became_active":"2024-04-25T13:16:08.011047+0000","last_became_peered":"2024-04-25T13:16:08.011047+0000","last_unstale":"2024-04-25T13:17:31.184852+0000","last_undegraded":"2024-04-25T13:17:31.184852+0000","last_fullsized":"2024-04-25T13:17:31.184852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.184751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.184751+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.184751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:13.841074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.171907+0000","last_change":"2024-04-25T13:17:32.171950+0000","last_active":"2024-04-25T13:17:32.171907+0000","last_peered":"2024-04-25T13:17:32.171907+0000","last_clean":"2024-04-25T13:17:32.171907+0000","last_became_active":"2024-04-25T13:16:08.011916+0000","last_became_peered":"2024-04-25T13:16:08.011916+0000","last_unstale":"2024-04-25T13:17:32.171907+0000","last_undegraded":"2024-04-25T13:17:32.171907+0000","last_fullsized":"2024-04-25T13:17:32.171907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.171807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.171807+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.171807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:24.167938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.335761+0000","last_change":"2024-04-25T13:17:38.335808+0000","last_active":"2024-04-25T13:17:38.335761+0000","last_peered":"2024-04-25T13:17:38.335761+0000","last_clean":"2024-04-25T13:17:38.335761+0000","last_became_active":"2024-04-25T13:16:08.011893+0000","last_became_peered":"2024-04-25T13:16:08.011893+0000","last_unstale":"2024-04-25T13:17:38.335761+0000","last_undegraded":"2024-04-25T13:17:38.335761+0000","last_fullsized":"2024-04-25T13:17:38.335761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.335656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.335656+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.335656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:27.573724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.900941+0000","last_change":"2024-04-25T13:17:19.900960+0000","last_active":"2024-04-25T13:17:19.900941+0000","last_peered":"2024-04-25T13:17:19.900941+0000","last_clean":"2024-04-25T13:17:19.900941+0000","last_became_active":"2024-04-25T13:16:08.015405+0000","last_became_peered":"2024-04-25T13:16:08.015405+0000","last_unstale":"2024-04-25T13:17:19.900941+0000","last_undegraded":"2024-04-25T13:17:19.900941+0000","last_fullsized":"2024-04-25T13:17:19.900941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:19.900871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:19.900871+0000","last_clean_scrub_stamp":"2024-04-25T13:17:19.900871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:49.982701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.308910+0000","last_change":"2024-04-25T13:17:31.308930+0000","last_active":"2024-04-25T13:17:31.308910+0000","last_peered":"2024-04-25T13:17:31.308910+0000","last_clean":"2024-04-25T13:17:31.308910+0000","last_became_active":"2024-04-25T13:16:08.000193+0000","last_became_peered":"2024-04-25T13:16:08.000193+0000","last_unstale":"2024-04-25T13:17:31.308910+0000","last_undegraded":"2024-04-25T13:17:31.308910+0000","last_fullsized":"2024-04-25T13:17:31.308910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.308791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.308791+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.308791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:10.935456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.045209+0000","last_change":"2024-04-25T13:17:32.045247+0000","last_active":"2024-04-25T13:17:32.045209+0000","last_peered":"2024-04-25T13:17:32.045209+0000","last_clean":"2024-04-25T13:17:32.045209+0000","last_became_active":"2024-04-25T13:16:08.014300+0000","last_became_peered":"2024-04-25T13:16:08.014300+0000","last_unstale":"2024-04-25T13:17:32.045209+0000","last_undegraded":"2024-04-25T13:17:32.045209+0000","last_fullsized":"2024-04-25T13:17:32.045209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.045105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.045105+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.045105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:22.912515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.299824+0000","last_change":"2024-04-25T13:17:32.299848+0000","last_active":"2024-04-25T13:17:32.299824+0000","last_peered":"2024-04-25T13:17:32.299824+0000","last_clean":"2024-04-25T13:17:32.299824+0000","last_became_active":"2024-04-25T13:16:08.004673+0000","last_became_peered":"2024-04-25T13:16:08.004673+0000","last_unstale":"2024-04-25T13:17:32.299824+0000","last_undegraded":"2024-04-25T13:17:32.299824+0000","last_fullsized":"2024-04-25T13:17:32.299824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.299686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.299686+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.299686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:37.562504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.025020+0000","last_change":"2024-04-25T13:17:31.025068+0000","last_active":"2024-04-25T13:17:31.025020+0000","last_peered":"2024-04-25T13:17:31.025020+0000","last_clean":"2024-04-25T13:17:31.025020+0000","last_became_active":"2024-04-25T13:16:08.014719+0000","last_became_peered":"2024-04-25T13:16:08.014719+0000","last_unstale":"2024-04-25T13:17:31.025020+0000","last_undegraded":"2024-04-25T13:17:31.025020+0000","last_fullsized":"2024-04-25T13:17:31.025020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.024919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.024919+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.024919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:59.040925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:20.375729+0000","last_change":"2024-04-25T13:17:20.375753+0000","last_active":"2024-04-25T13:17:20.375729+0000","last_peered":"2024-04-25T13:17:20.375729+0000","last_clean":"2024-04-25T13:17:20.375729+0000","last_became_active":"2024-04-25T13:16:07.996792+0000","last_became_peered":"2024-04-25T13:16:07.996792+0000","last_unstale":"2024-04-25T13:17:20.375729+0000","last_undegraded":"2024-04-25T13:17:20.375729+0000","last_fullsized":"2024-04-25T13:17:20.375729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:20.375658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:20.375658+0000","last_clean_scrub_stamp":"2024-04-25T13:17:20.375658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:23.334624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.305551+0000","last_change":"2024-04-25T13:17:27.305595+0000","last_active":"2024-04-25T13:17:27.305551+0000","last_peered":"2024-04-25T13:17:27.305551+0000","last_clean":"2024-04-25T13:17:27.305551+0000","last_became_active":"2024-04-25T13:16:08.001182+0000","last_became_peered":"2024-04-25T13:16:08.001182+0000","last_unstale":"2024-04-25T13:17:27.305551+0000","last_undegraded":"2024-04-25T13:17:27.305551+0000","last_fullsized":"2024-04-25T13:17:27.305551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.305449+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:46.735547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.274246+0000","last_change":"2024-04-25T13:17:33.274287+0000","last_active":"2024-04-25T13:17:33.274246+0000","last_peered":"2024-04-25T13:17:33.274246+0000","last_clean":"2024-04-25T13:17:33.274246+0000","last_became_active":"2024-04-25T13:16:08.005976+0000","last_became_peered":"2024-04-25T13:16:08.005976+0000","last_unstale":"2024-04-25T13:17:33.274246+0000","last_undegraded":"2024-04-25T13:17:33.274246+0000","last_fullsized":"2024-04-25T13:17:33.274246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.274153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.274153+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.274153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:48.395775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":264,"ondisk_log_size":264,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":714627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":127373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":126091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":123489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":127407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":123621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":123109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":913408,"data_stored":712819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:42.234 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T13:16:11.011040+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:42.236 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T13:18:02.238 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:18:02.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.351+0000 7fa79a16f640 1 Processor -- start 2024-04-25T13:18:02.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.351+0000 7fa79a16f640 1 -- start start 2024-04-25T13:18:02.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.352+0000 7fa79a16f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa79415efa0 0x7fa794074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.352+0000 7fa79a16f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa794144650 con 0x7fa794075290 2024-04-25T13:18:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.352+0000 7fa79a16f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa79415b0b0 con 0x7fa794144270 2024-04-25T13:18:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.352+0000 7fa79a16f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa7940c9580 con 0x7fa79415efa0 2024-04-25T13:18:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.352+0000 7fa792ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa79415efa0 0x7fa794074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.352+0000 7fa793fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa794075290 0x7fa794165920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48296/0 (socket says 172.21.15.52:48296) 2024-04-25T13:18:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.352+0000 7fa792ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa79415efa0 0x7fa794074d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46690/0 (socket says 172.21.15.52:46690) 2024-04-25T13:18:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.352+0000 7fa793fff640 1 -- 172.21.15.52:0/206111965 learned_addr learned my addr 172.21.15.52:0/206111965 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:18:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.353+0000 7fa792ffd640 1 -- 172.21.15.52:0/206111965 >> v1:172.21.15.102:6789/0 conn(0x7fa794144270 legacy=0x7fa7940c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:02.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.353+0000 7fa792ffd640 1 -- 172.21.15.52:0/206111965 >> v1:172.21.15.52:6789/0 conn(0x7fa794075290 legacy=0x7fa794165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.353+0000 7fa7927fc640 1 -- 172.21.15.52:0/206111965 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1142445780 0 0) 0x7fa794144650 con 0x7fa794075290 2024-04-25T13:18:02.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.353+0000 7fa792ffd640 1 -- 172.21.15.52:0/206111965 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7940ce080 con 0x7fa79415efa0 2024-04-25T13:18:02.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.354+0000 7fa792ffd640 1 --2- 172.21.15.52:0/206111965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa79415efa0 0x7fa794074d50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa7880097a0 tx=0x7fa78802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d402f09acdb42f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:02.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.354+0000 7fa7927fc640 1 -- 172.21.15.52:0/206111965 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788037070 con 0x7fa79415efa0 2024-04-25T13:18:02.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.354+0000 7fa7927fc640 1 -- 172.21.15.52:0/206111965 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa788032640 con 0x7fa79415efa0 2024-04-25T13:18:02.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.354+0000 7fa7927fc640 1 -- 172.21.15.52:0/206111965 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788032a10 con 0x7fa79415efa0 2024-04-25T13:18:02.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.354+0000 7fa79a16f640 1 -- 172.21.15.52:0/206111965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa79415efa0 msgr2=0x7fa794074d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.354+0000 7fa79a16f640 1 --2- 172.21.15.52:0/206111965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa79415efa0 0x7fa794074d50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa7880097a0 tx=0x7fa78802a2c0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.354+0000 7fa79a16f640 1 -- 172.21.15.52:0/206111965 shutdown_connections 2024-04-25T13:18:02.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.354+0000 7fa79a16f640 1 --2- 172.21.15.52:0/206111965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa79415efa0 0x7fa794074d50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.354+0000 7fa79a16f640 1 -- 172.21.15.52:0/206111965 >> 172.21.15.52:0/206111965 conn(0x7fa79406b920 msgr2=0x7fa79406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:02.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.354+0000 7fa79a16f640 1 -- 172.21.15.52:0/206111965 shutdown_connections 2024-04-25T13:18:02.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.354+0000 7fa79a16f640 1 -- 172.21.15.52:0/206111965 wait complete. 2024-04-25T13:18:02.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.355+0000 7fa79a16f640 1 Processor -- start 2024-04-25T13:18:02.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.356+0000 7fa79a16f640 1 -- start start 2024-04-25T13:18:02.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.356+0000 7fa79a16f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa794075290 0x7fa794141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:02.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.356+0000 7fa79a16f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa794144270 0x7fa7941f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:02.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.356+0000 7fa79a16f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa79415efa0 0x7fa7941f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:02.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.356+0000 7fa79a16f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa79415b8e0 con 0x7fa794144270 2024-04-25T13:18:02.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.356+0000 7fa79a16f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa79415b600 con 0x7fa79415efa0 2024-04-25T13:18:02.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.356+0000 7fa79a16f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa7940ce360 con 0x7fa794075290 2024-04-25T13:18:02.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa792ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa794144270 0x7fa7941f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:02.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa792ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa794144270 0x7fa7941f4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46702/0 (socket says 172.21.15.52:46702) 2024-04-25T13:18:02.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa792ffd640 1 -- 172.21.15.52:0/404681438 learned_addr learned my addr 172.21.15.52:0/404681438 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:02.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa793fff640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa79415efa0 0x7fa7941f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:02.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa7937fe640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa794075290 0x7fa794141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:02.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa792ffd640 1 -- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa794075290 msgr2=0x7fa794141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa792ffd640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa794075290 0x7fa794141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa792ffd640 1 -- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa79415efa0 msgr2=0x7fa7941f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa792ffd640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa79415efa0 0x7fa7941f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa792ffd640 1 -- 172.21.15.52:0/404681438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa794155ab0 con 0x7fa794144270 2024-04-25T13:18:02.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa792ffd640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa794144270 0x7fa7941f4200 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa788035040 tx=0x7fa7880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:02.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa77bfff640 1 -- 172.21.15.52:0/404681438 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788037050 con 0x7fa794144270 2024-04-25T13:18:02.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa77bfff640 1 -- 172.21.15.52:0/404681438 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa788043070 con 0x7fa794144270 2024-04-25T13:18:02.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa77bfff640 1 -- 172.21.15.52:0/404681438 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788030dc0 con 0x7fa794144270 2024-04-25T13:18:02.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa79a16f640 1 -- 172.21.15.52:0/404681438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa794155d90 con 0x7fa794144270 2024-04-25T13:18:02.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.357+0000 7fa79a16f640 1 -- 172.21.15.52:0/404681438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7941582d0 con 0x7fa794144270 2024-04-25T13:18:02.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.358+0000 7fa79a16f640 1 -- 172.21.15.52:0/404681438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa794068e40 con 0x7fa794144270 2024-04-25T13:18:02.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.359+0000 7fa77bfff640 1 -- 172.21.15.52:0/404681438 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa788032460 con 0x7fa794144270 2024-04-25T13:18:02.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.359+0000 7fa77bfff640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa78006c8f0 0x7fa78006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:02.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.359+0000 7fa77bfff640 1 -- 172.21.15.52:0/404681438 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fa7880ace60 con 0x7fa794144270 2024-04-25T13:18:02.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.360+0000 7fa7937fe640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa78006c8f0 0x7fa78006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:02.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.360+0000 7fa7937fe640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa78006c8f0 0x7fa78006edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa784000f60 tx=0x7fa784009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:02.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.364+0000 7fa77bfff640 1 -- 172.21.15.52:0/404681438 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa78807ae70 con 0x7fa794144270 2024-04-25T13:18:02.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.544+0000 7fa79a16f640 1 -- 172.21.15.52:0/404681438 --> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7940c8110 con 0x7fa78006c8f0 2024-04-25T13:18:02.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.552+0000 7fa77bfff640 1 -- 172.21.15.52:0/404681438 <== mgr.4110 v2:172.21.15.102:6832/44610470 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332759 (secure 0 0 0) 0x7fa7940c8110 con 0x7fa78006c8f0 2024-04-25T13:18:02.556 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:18:02.558 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T13:18:02.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.555+0000 7fa79a16f640 1 -- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa78006c8f0 msgr2=0x7fa78006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.555+0000 7fa79a16f640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa78006c8f0 0x7fa78006edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa784000f60 tx=0x7fa784009040 comp rx=0 tx=0).stop 2024-04-25T13:18:02.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.555+0000 7fa79a16f640 1 -- 172.21.15.52:0/404681438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa794144270 msgr2=0x7fa7941f4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.555+0000 7fa79a16f640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa794144270 0x7fa7941f4200 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa788035040 tx=0x7fa7880046c0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.556+0000 7fa79a16f640 1 -- 172.21.15.52:0/404681438 shutdown_connections 2024-04-25T13:18:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.556+0000 7fa79a16f640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fa78006c8f0 0x7fa78006edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.556+0000 7fa79a16f640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa79415efa0 0x7fa7941f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.556+0000 7fa79a16f640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa794144270 0x7fa7941f4200 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.556+0000 7fa79a16f640 1 --2- 172.21.15.52:0/404681438 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa794075290 0x7fa794141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.556+0000 7fa79a16f640 1 -- 172.21.15.52:0/404681438 >> 172.21.15.52:0/404681438 conn(0x7fa79406b920 msgr2=0x7fa794142e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.556+0000 7fa79a16f640 1 -- 172.21.15.52:0/404681438 shutdown_connections 2024-04-25T13:18:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.556+0000 7fa79a16f640 1 -- 172.21.15.52:0/404681438 wait complete. 2024-04-25T13:18:02.567 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-04-25T13:18:01.848170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":383,"ondisk_log_size":383,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236456,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738264,"statfs":{"total":773094113280,"available":772851982336,"internally_reserved":0,"allocated":3776512,"data_stored":2178536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003211"},"pg_stats":[{"pgid":"2.1f","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.421059+0000","last_change":"2024-04-25T13:17:19.421088+0000","last_active":"2024-04-25T13:17:19.421059+0000","last_peered":"2024-04-25T13:17:19.421059+0000","last_clean":"2024-04-25T13:17:19.421059+0000","last_became_active":"2024-04-25T13:16:07.000746+0000","last_became_peered":"2024-04-25T13:16:07.000746+0000","last_unstale":"2024-04-25T13:17:19.421059+0000","last_undegraded":"2024-04-25T13:17:19.421059+0000","last_fullsized":"2024-04-25T13:17:19.421059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-25T13:17:19.420993+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-25T13:17:19.420993+0000","last_clean_scrub_stamp":"2024-04-25T13:17:19.420993+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:40.185836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.125984+0000","last_change":"2024-04-25T13:17:31.126009+0000","last_active":"2024-04-25T13:17:31.125984+0000","last_peered":"2024-04-25T13:17:31.125984+0000","last_clean":"2024-04-25T13:17:31.125984+0000","last_became_active":"2024-04-25T13:16:08.012114+0000","last_became_peered":"2024-04-25T13:16:08.012114+0000","last_unstale":"2024-04-25T13:17:31.125984+0000","last_undegraded":"2024-04-25T13:17:31.125984+0000","last_fullsized":"2024-04-25T13:17:31.125984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.125895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.125895+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.125895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:35.008365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.118763+0000","last_change":"2024-04-25T13:17:39.118790+0000","last_active":"2024-04-25T13:17:39.118763+0000","last_peered":"2024-04-25T13:17:39.118763+0000","last_clean":"2024-04-25T13:17:39.118763+0000","last_became_active":"2024-04-25T13:16:12.734390+0000","last_became_peered":"2024-04-25T13:16:12.734390+0000","last_unstale":"2024-04-25T13:17:39.118763+0000","last_undegraded":"2024-04-25T13:17:39.118763+0000","last_fullsized":"2024-04-25T13:17:39.118763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.118660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.118660+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.118660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:00.237527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.071288+0000","last_change":"2024-04-25T13:17:27.071319+0000","last_active":"2024-04-25T13:17:27.071288+0000","last_peered":"2024-04-25T13:17:27.071288+0000","last_clean":"2024-04-25T13:17:27.071288+0000","last_became_active":"2024-04-25T13:16:06.999078+0000","last_became_peered":"2024-04-25T13:16:06.999078+0000","last_unstale":"2024-04-25T13:17:27.071288+0000","last_undegraded":"2024-04-25T13:17:27.071288+0000","last_fullsized":"2024-04-25T13:17:27.071288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-25T13:17:27.071197+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-25T13:17:27.071197+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.071197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:04.786584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.286809+0000","last_change":"2024-04-25T13:17:26.286838+0000","last_active":"2024-04-25T13:17:26.286809+0000","last_peered":"2024-04-25T13:17:26.286809+0000","last_clean":"2024-04-25T13:17:26.286809+0000","last_became_active":"2024-04-25T13:16:08.012036+0000","last_became_peered":"2024-04-25T13:16:08.012036+0000","last_unstale":"2024-04-25T13:17:26.286809+0000","last_undegraded":"2024-04-25T13:17:26.286809+0000","last_fullsized":"2024-04-25T13:17:26.286809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.286707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.286707+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.286707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:45.909474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.648824+0000","last_change":"2024-04-25T13:17:34.648850+0000","last_active":"2024-04-25T13:17:34.648824+0000","last_peered":"2024-04-25T13:17:34.648824+0000","last_clean":"2024-04-25T13:17:34.648824+0000","last_became_active":"2024-04-25T13:16:49.237674+0000","last_became_peered":"2024-04-25T13:16:49.237674+0000","last_unstale":"2024-04-25T13:17:34.648824+0000","last_undegraded":"2024-04-25T13:17:34.648824+0000","last_fullsized":"2024-04-25T13:17:34.648824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.648742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.648742+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.648742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:08.873397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.356012+0000","last_change":"2024-04-25T13:17:26.356068+0000","last_active":"2024-04-25T13:17:26.356012+0000","last_peered":"2024-04-25T13:17:26.356012+0000","last_clean":"2024-04-25T13:17:26.356012+0000","last_became_active":"2024-04-25T13:16:07.000751+0000","last_became_peered":"2024-04-25T13:16:07.000751+0000","last_unstale":"2024-04-25T13:17:26.356012+0000","last_undegraded":"2024-04-25T13:17:26.356012+0000","last_fullsized":"2024-04-25T13:17:26.356012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-04-25T13:17:26.355927+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-04-25T13:17:26.355927+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.355927+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:13.142648+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.962147+0000","last_change":"2024-04-25T13:17:26.962184+0000","last_active":"2024-04-25T13:17:26.962147+0000","last_peered":"2024-04-25T13:17:26.962147+0000","last_clean":"2024-04-25T13:17:26.962147+0000","last_became_active":"2024-04-25T13:16:08.011073+0000","last_became_peered":"2024-04-25T13:16:08.011073+0000","last_unstale":"2024-04-25T13:17:26.962147+0000","last_undegraded":"2024-04-25T13:17:26.962147+0000","last_fullsized":"2024-04-25T13:17:26.962147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.962058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.962058+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.962058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:29.040176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.664977+0000","last_change":"2024-04-25T13:17:33.665002+0000","last_active":"2024-04-25T13:17:33.664977+0000","last_peered":"2024-04-25T13:17:33.664977+0000","last_clean":"2024-04-25T13:17:33.664977+0000","last_became_active":"2024-04-25T13:16:49.237565+0000","last_became_peered":"2024-04-25T13:16:49.237565+0000","last_unstale":"2024-04-25T13:17:33.664977+0000","last_undegraded":"2024-04-25T13:17:33.664977+0000","last_fullsized":"2024-04-25T13:17:33.664977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.664881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.664881+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.664881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:08.371630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.284122+0000","last_change":"2024-04-25T13:17:30.284169+0000","last_active":"2024-04-25T13:17:30.284122+0000","last_peered":"2024-04-25T13:17:30.284122+0000","last_clean":"2024-04-25T13:17:30.284122+0000","last_became_active":"2024-04-25T13:16:07.003493+0000","last_became_peered":"2024-04-25T13:16:07.003493+0000","last_unstale":"2024-04-25T13:17:30.284122+0000","last_undegraded":"2024-04-25T13:17:30.284122+0000","last_fullsized":"2024-04-25T13:17:30.284122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T13:17:30.284026+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T13:17:30.284026+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.284026+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:32.779415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.955639+0000","last_change":"2024-04-25T13:17:28.955683+0000","last_active":"2024-04-25T13:17:28.955639+0000","last_peered":"2024-04-25T13:17:28.955639+0000","last_clean":"2024-04-25T13:17:28.955639+0000","last_became_active":"2024-04-25T13:16:08.011634+0000","last_became_peered":"2024-04-25T13:16:08.011634+0000","last_unstale":"2024-04-25T13:17:28.955639+0000","last_undegraded":"2024-04-25T13:17:28.955639+0000","last_fullsized":"2024-04-25T13:17:28.955639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.955531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.955531+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.955531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:15.786602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.550701+0000","last_change":"2024-04-25T13:17:28.550744+0000","last_active":"2024-04-25T13:17:28.550701+0000","last_peered":"2024-04-25T13:17:28.550701+0000","last_clean":"2024-04-25T13:17:28.550701+0000","last_became_active":"2024-04-25T13:16:12.038508+0000","last_became_peered":"2024-04-25T13:16:12.038508+0000","last_unstale":"2024-04-25T13:17:28.550701+0000","last_undegraded":"2024-04-25T13:17:28.550701+0000","last_fullsized":"2024-04-25T13:17:28.550701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.550609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.550609+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.550609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:45.101424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.244791+0000","last_change":"2024-04-25T13:17:26.244816+0000","last_active":"2024-04-25T13:17:26.244791+0000","last_peered":"2024-04-25T13:17:26.244791+0000","last_clean":"2024-04-25T13:17:26.244791+0000","last_became_active":"2024-04-25T13:16:08.007478+0000","last_became_peered":"2024-04-25T13:16:08.007478+0000","last_unstale":"2024-04-25T13:17:26.244791+0000","last_undegraded":"2024-04-25T13:17:26.244791+0000","last_fullsized":"2024-04-25T13:17:26.244791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.244708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.244708+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.244708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:18.767617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'6","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.355127+0000","last_change":"2024-04-25T13:17:27.355156+0000","last_active":"2024-04-25T13:17:27.355127+0000","last_peered":"2024-04-25T13:17:27.355127+0000","last_clean":"2024-04-25T13:17:27.355127+0000","last_became_active":"2024-04-25T13:16:07.000880+0000","last_became_peered":"2024-04-25T13:16:07.000880+0000","last_unstale":"2024-04-25T13:17:27.355127+0000","last_undegraded":"2024-04-25T13:17:27.355127+0000","last_fullsized":"2024-04-25T13:17:27.355127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T13:17:27.355046+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T13:17:27.355046+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.355046+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:01:35.725928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.528951+0000","last_change":"2024-04-25T13:17:26.528975+0000","last_active":"2024-04-25T13:17:26.528951+0000","last_peered":"2024-04-25T13:17:26.528951+0000","last_clean":"2024-04-25T13:17:26.528951+0000","last_became_active":"2024-04-25T13:16:12.036508+0000","last_became_peered":"2024-04-25T13:16:12.036508+0000","last_unstale":"2024-04-25T13:17:26.528951+0000","last_undegraded":"2024-04-25T13:17:26.528951+0000","last_fullsized":"2024-04-25T13:17:26.528951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.528865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.528865+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.528865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:37.524800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.155799+0000","last_change":"2024-04-25T13:17:32.155824+0000","last_active":"2024-04-25T13:17:32.155799+0000","last_peered":"2024-04-25T13:17:32.155799+0000","last_clean":"2024-04-25T13:17:32.155799+0000","last_became_active":"2024-04-25T13:16:08.013269+0000","last_became_peered":"2024-04-25T13:16:08.013269+0000","last_unstale":"2024-04-25T13:17:32.155799+0000","last_undegraded":"2024-04-25T13:17:32.155799+0000","last_fullsized":"2024-04-25T13:17:32.155799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.155711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.155711+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.155711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:18.189169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.438521+0000","last_change":"2024-04-25T13:17:22.438554+0000","last_active":"2024-04-25T13:17:22.438521+0000","last_peered":"2024-04-25T13:17:22.438521+0000","last_clean":"2024-04-25T13:17:22.438521+0000","last_became_active":"2024-04-25T13:16:06.993807+0000","last_became_peered":"2024-04-25T13:16:06.993807+0000","last_unstale":"2024-04-25T13:17:22.438521+0000","last_undegraded":"2024-04-25T13:17:22.438521+0000","last_fullsized":"2024-04-25T13:17:22.438521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:22.438431+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:22.438431+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.438431+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:25.580446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.604577+0000","last_change":"2024-04-25T13:17:30.604622+0000","last_active":"2024-04-25T13:17:30.604577+0000","last_peered":"2024-04-25T13:17:30.604577+0000","last_clean":"2024-04-25T13:17:30.604577+0000","last_became_active":"2024-04-25T13:16:12.038953+0000","last_became_peered":"2024-04-25T13:16:12.038953+0000","last_unstale":"2024-04-25T13:17:30.604577+0000","last_undegraded":"2024-04-25T13:17:30.604577+0000","last_fullsized":"2024-04-25T13:17:30.604577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.604481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.604481+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.604481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:04.473846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.092635+0000","last_change":"2024-04-25T13:17:29.092662+0000","last_active":"2024-04-25T13:17:29.092635+0000","last_peered":"2024-04-25T13:17:29.092635+0000","last_clean":"2024-04-25T13:17:29.092635+0000","last_became_active":"2024-04-25T13:16:08.008446+0000","last_became_peered":"2024-04-25T13:16:08.008446+0000","last_unstale":"2024-04-25T13:17:29.092635+0000","last_undegraded":"2024-04-25T13:17:29.092635+0000","last_fullsized":"2024-04-25T13:17:29.092635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.092541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.092541+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.092541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:04.543558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.424407+0000","last_change":"2024-04-25T13:17:21.424457+0000","last_active":"2024-04-25T13:17:21.424407+0000","last_peered":"2024-04-25T13:17:21.424407+0000","last_clean":"2024-04-25T13:17:21.424407+0000","last_became_active":"2024-04-25T13:16:06.992593+0000","last_became_peered":"2024-04-25T13:16:06.992593+0000","last_unstale":"2024-04-25T13:17:21.424407+0000","last_undegraded":"2024-04-25T13:17:21.424407+0000","last_fullsized":"2024-04-25T13:17:21.424407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T13:17:21.424304+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T13:17:21.424304+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.424304+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:47.921821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.365705+0000","last_change":"2024-04-25T13:17:34.365761+0000","last_active":"2024-04-25T13:17:34.365705+0000","last_peered":"2024-04-25T13:17:34.365705+0000","last_clean":"2024-04-25T13:17:34.365705+0000","last_became_active":"2024-04-25T13:16:12.733485+0000","last_became_peered":"2024-04-25T13:16:12.733485+0000","last_unstale":"2024-04-25T13:17:34.365705+0000","last_undegraded":"2024-04-25T13:17:34.365705+0000","last_fullsized":"2024-04-25T13:17:34.365705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.365603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.365603+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.365603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:25.113539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.541807+0000","last_change":"2024-04-25T13:17:21.541830+0000","last_active":"2024-04-25T13:17:21.541807+0000","last_peered":"2024-04-25T13:17:21.541807+0000","last_clean":"2024-04-25T13:17:21.541807+0000","last_became_active":"2024-04-25T13:16:07.998658+0000","last_became_peered":"2024-04-25T13:16:07.998658+0000","last_unstale":"2024-04-25T13:17:21.541807+0000","last_undegraded":"2024-04-25T13:17:21.541807+0000","last_fullsized":"2024-04-25T13:17:21.541807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:21.541723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:21.541723+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.541723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:44:20.645921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.347541+0000","last_change":"2024-04-25T13:17:28.347584+0000","last_active":"2024-04-25T13:17:28.347541+0000","last_peered":"2024-04-25T13:17:28.347541+0000","last_clean":"2024-04-25T13:17:28.347541+0000","last_became_active":"2024-04-25T13:16:07.000846+0000","last_became_peered":"2024-04-25T13:16:07.000846+0000","last_unstale":"2024-04-25T13:17:28.347541+0000","last_undegraded":"2024-04-25T13:17:28.347541+0000","last_fullsized":"2024-04-25T13:17:28.347541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T13:17:28.347428+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T13:17:28.347428+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.347428+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:26.579172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.571960+0000","last_change":"2024-04-25T13:17:27.571988+0000","last_active":"2024-04-25T13:17:27.571960+0000","last_peered":"2024-04-25T13:17:27.571960+0000","last_clean":"2024-04-25T13:17:27.571960+0000","last_became_active":"2024-04-25T13:16:12.038032+0000","last_became_peered":"2024-04-25T13:16:12.038032+0000","last_unstale":"2024-04-25T13:17:27.571960+0000","last_undegraded":"2024-04-25T13:17:27.571960+0000","last_fullsized":"2024-04-25T13:17:27.571960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.571876+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:08:57.006010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.423292+0000","last_change":"2024-04-25T13:17:21.423326+0000","last_active":"2024-04-25T13:17:21.423292+0000","last_peered":"2024-04-25T13:17:21.423292+0000","last_clean":"2024-04-25T13:17:21.423292+0000","last_became_active":"2024-04-25T13:16:07.998037+0000","last_became_peered":"2024-04-25T13:16:07.998037+0000","last_unstale":"2024-04-25T13:17:21.423292+0000","last_undegraded":"2024-04-25T13:17:21.423292+0000","last_fullsized":"2024-04-25T13:17:21.423292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:21.423203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:21.423203+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.423203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:52.331705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.214577+0000","last_change":"2024-04-25T13:17:23.214617+0000","last_active":"2024-04-25T13:17:23.214577+0000","last_peered":"2024-04-25T13:17:23.214577+0000","last_clean":"2024-04-25T13:17:23.214577+0000","last_became_active":"2024-04-25T13:16:06.995420+0000","last_became_peered":"2024-04-25T13:16:06.995420+0000","last_unstale":"2024-04-25T13:17:23.214577+0000","last_undegraded":"2024-04-25T13:17:23.214577+0000","last_fullsized":"2024-04-25T13:17:23.214577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T13:17:23.214497+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T13:17:23.214497+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.214497+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:40.554665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.669761+0000","last_change":"2024-04-25T13:17:32.669786+0000","last_active":"2024-04-25T13:17:32.669761+0000","last_peered":"2024-04-25T13:17:32.669761+0000","last_clean":"2024-04-25T13:17:32.669761+0000","last_became_active":"2024-04-25T13:16:12.733772+0000","last_became_peered":"2024-04-25T13:16:12.733772+0000","last_unstale":"2024-04-25T13:17:32.669761+0000","last_undegraded":"2024-04-25T13:17:32.669761+0000","last_fullsized":"2024-04-25T13:17:32.669761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.669678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.669678+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.669678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:58.871214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.986324+0000","last_change":"2024-04-25T13:17:22.986367+0000","last_active":"2024-04-25T13:17:22.986324+0000","last_peered":"2024-04-25T13:17:22.986324+0000","last_clean":"2024-04-25T13:17:22.986324+0000","last_became_active":"2024-04-25T13:16:08.017205+0000","last_became_peered":"2024-04-25T13:16:08.017205+0000","last_unstale":"2024-04-25T13:17:22.986324+0000","last_undegraded":"2024-04-25T13:17:22.986324+0000","last_fullsized":"2024-04-25T13:17:22.986324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:22.986222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:22.986222+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.986222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:03.690370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:20.412064+0000","last_change":"2024-04-25T13:17:20.412113+0000","last_active":"2024-04-25T13:17:20.412064+0000","last_peered":"2024-04-25T13:17:20.412064+0000","last_clean":"2024-04-25T13:17:20.412064+0000","last_became_active":"2024-04-25T13:16:06.991766+0000","last_became_peered":"2024-04-25T13:16:06.991766+0000","last_unstale":"2024-04-25T13:17:20.412064+0000","last_undegraded":"2024-04-25T13:17:20.412064+0000","last_fullsized":"2024-04-25T13:17:20.412064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T13:17:20.411986+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T13:17:20.411986+0000","last_clean_scrub_stamp":"2024-04-25T13:17:20.411986+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:10.695576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.069667+0000","last_change":"2024-04-25T13:17:40.069715+0000","last_active":"2024-04-25T13:17:40.069667+0000","last_peered":"2024-04-25T13:17:40.069667+0000","last_clean":"2024-04-25T13:17:40.069667+0000","last_became_active":"2024-04-25T13:16:12.734394+0000","last_became_peered":"2024-04-25T13:16:12.734394+0000","last_unstale":"2024-04-25T13:17:40.069667+0000","last_undegraded":"2024-04-25T13:17:40.069667+0000","last_fullsized":"2024-04-25T13:17:40.069667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.069561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.069561+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.069561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:28.272421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.341083+0000","last_change":"2024-04-25T13:17:26.341109+0000","last_active":"2024-04-25T13:17:26.341083+0000","last_peered":"2024-04-25T13:17:26.341083+0000","last_clean":"2024-04-25T13:17:26.341083+0000","last_became_active":"2024-04-25T13:16:07.999797+0000","last_became_peered":"2024-04-25T13:16:07.999797+0000","last_unstale":"2024-04-25T13:17:26.341083+0000","last_undegraded":"2024-04-25T13:17:26.341083+0000","last_fullsized":"2024-04-25T13:17:26.341083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.340964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.340964+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.340964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:24.427743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.311138+0000","last_change":"2024-04-25T13:17:29.311175+0000","last_active":"2024-04-25T13:17:29.311138+0000","last_peered":"2024-04-25T13:17:29.311138+0000","last_clean":"2024-04-25T13:17:29.311138+0000","last_became_active":"2024-04-25T13:16:07.001918+0000","last_became_peered":"2024-04-25T13:16:07.001918+0000","last_unstale":"2024-04-25T13:17:29.311138+0000","last_undegraded":"2024-04-25T13:17:29.311138+0000","last_fullsized":"2024-04-25T13:17:29.311138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T13:17:29.311056+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T13:17:29.311056+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.311056+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:54.153559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.200204+0000","last_change":"2024-04-25T13:17:29.200228+0000","last_active":"2024-04-25T13:17:29.200204+0000","last_peered":"2024-04-25T13:17:29.200204+0000","last_clean":"2024-04-25T13:17:29.200204+0000","last_became_active":"2024-04-25T13:16:12.733361+0000","last_became_peered":"2024-04-25T13:16:12.733361+0000","last_unstale":"2024-04-25T13:17:29.200204+0000","last_undegraded":"2024-04-25T13:17:29.200204+0000","last_fullsized":"2024-04-25T13:17:29.200204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.200106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.200106+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.200106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:17.928205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.021481+0000","last_change":"2024-04-25T13:17:35.021505+0000","last_active":"2024-04-25T13:17:35.021481+0000","last_peered":"2024-04-25T13:17:35.021481+0000","last_clean":"2024-04-25T13:17:35.021481+0000","last_became_active":"2024-04-25T13:16:08.015172+0000","last_became_peered":"2024-04-25T13:16:08.015172+0000","last_unstale":"2024-04-25T13:17:35.021481+0000","last_undegraded":"2024-04-25T13:17:35.021481+0000","last_fullsized":"2024-04-25T13:17:35.021481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.021398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.021398+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.021398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:27.216804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.452612+0000","last_change":"2024-04-25T13:17:23.452637+0000","last_active":"2024-04-25T13:17:23.452612+0000","last_peered":"2024-04-25T13:17:23.452612+0000","last_clean":"2024-04-25T13:17:23.452612+0000","last_became_active":"2024-04-25T13:16:06.995957+0000","last_became_peered":"2024-04-25T13:16:06.995957+0000","last_unstale":"2024-04-25T13:17:23.452612+0000","last_undegraded":"2024-04-25T13:17:23.452612+0000","last_fullsized":"2024-04-25T13:17:23.452612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-25T13:17:23.452531+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-25T13:17:23.452531+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.452531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:12.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.371301+0000","last_change":"2024-04-25T13:17:33.371332+0000","last_active":"2024-04-25T13:17:33.371301+0000","last_peered":"2024-04-25T13:17:33.371301+0000","last_clean":"2024-04-25T13:17:33.371301+0000","last_became_active":"2024-04-25T13:16:12.039987+0000","last_became_peered":"2024-04-25T13:16:12.039987+0000","last_unstale":"2024-04-25T13:17:33.371301+0000","last_undegraded":"2024-04-25T13:17:33.371301+0000","last_fullsized":"2024-04-25T13:17:33.371301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.371211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.371211+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.371211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:19.354130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.504622+0000","last_change":"2024-04-25T13:17:23.504643+0000","last_active":"2024-04-25T13:17:23.504622+0000","last_peered":"2024-04-25T13:17:23.504622+0000","last_clean":"2024-04-25T13:17:23.504622+0000","last_became_active":"2024-04-25T13:16:08.002131+0000","last_became_peered":"2024-04-25T13:16:08.002131+0000","last_unstale":"2024-04-25T13:17:23.504622+0000","last_undegraded":"2024-04-25T13:17:23.504622+0000","last_fullsized":"2024-04-25T13:17:23.504622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:23.504499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:23.504499+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.504499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:37.686374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.033733+0000","last_change":"2024-04-25T13:17:22.033779+0000","last_active":"2024-04-25T13:17:22.033733+0000","last_peered":"2024-04-25T13:17:22.033733+0000","last_clean":"2024-04-25T13:17:22.033733+0000","last_became_active":"2024-04-25T13:16:06.989652+0000","last_became_peered":"2024-04-25T13:16:06.989652+0000","last_unstale":"2024-04-25T13:17:22.033733+0000","last_undegraded":"2024-04-25T13:17:22.033733+0000","last_fullsized":"2024-04-25T13:17:22.033733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T13:17:22.033627+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T13:17:22.033627+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.033627+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:55.148753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.293911+0000","last_change":"2024-04-25T13:17:31.293934+0000","last_active":"2024-04-25T13:17:31.293911+0000","last_peered":"2024-04-25T13:17:31.293911+0000","last_clean":"2024-04-25T13:17:31.293911+0000","last_became_active":"2024-04-25T13:16:12.032184+0000","last_became_peered":"2024-04-25T13:16:12.032184+0000","last_unstale":"2024-04-25T13:17:31.293911+0000","last_undegraded":"2024-04-25T13:17:31.293911+0000","last_fullsized":"2024-04-25T13:17:31.293911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.293830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.293830+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.293830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:03.792249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.376393+0000","last_change":"2024-04-25T13:17:25.376443+0000","last_active":"2024-04-25T13:17:25.376393+0000","last_peered":"2024-04-25T13:17:25.376393+0000","last_clean":"2024-04-25T13:17:25.376393+0000","last_became_active":"2024-04-25T13:16:07.996545+0000","last_became_peered":"2024-04-25T13:16:07.996545+0000","last_unstale":"2024-04-25T13:17:25.376393+0000","last_undegraded":"2024-04-25T13:17:25.376393+0000","last_fullsized":"2024-04-25T13:17:25.376393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:25.376308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:25.376308+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.376308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:05.970732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.453630+0000","last_change":"2024-04-25T13:17:21.453654+0000","last_active":"2024-04-25T13:17:21.453630+0000","last_peered":"2024-04-25T13:17:21.453630+0000","last_clean":"2024-04-25T13:17:21.453630+0000","last_became_active":"2024-04-25T13:16:06.993387+0000","last_became_peered":"2024-04-25T13:16:06.993387+0000","last_unstale":"2024-04-25T13:17:21.453630+0000","last_undegraded":"2024-04-25T13:17:21.453630+0000","last_fullsized":"2024-04-25T13:17:21.453630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T13:17:21.453571+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T13:17:21.453571+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.453571+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:32.228548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.452973+0000","last_change":"2024-04-25T13:17:29.453003+0000","last_active":"2024-04-25T13:17:29.452973+0000","last_peered":"2024-04-25T13:17:29.452973+0000","last_clean":"2024-04-25T13:17:29.452973+0000","last_became_active":"2024-04-25T13:16:49.236873+0000","last_became_peered":"2024-04-25T13:16:49.236873+0000","last_unstale":"2024-04-25T13:17:29.452973+0000","last_undegraded":"2024-04-25T13:17:29.452973+0000","last_fullsized":"2024-04-25T13:17:29.452973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.452883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.452883+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.452883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:24.898285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.380160+0000","last_change":"2024-04-25T13:17:24.380184+0000","last_active":"2024-04-25T13:17:24.380160+0000","last_peered":"2024-04-25T13:17:24.380160+0000","last_clean":"2024-04-25T13:17:24.380160+0000","last_became_active":"2024-04-25T13:16:08.003908+0000","last_became_peered":"2024-04-25T13:16:08.003908+0000","last_unstale":"2024-04-25T13:17:24.380160+0000","last_undegraded":"2024-04-25T13:17:24.380160+0000","last_fullsized":"2024-04-25T13:17:24.380160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:24.380064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:24.380064+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.380064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:12.320176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.356284+0000","last_change":"2024-04-25T13:17:25.356313+0000","last_active":"2024-04-25T13:17:25.356284+0000","last_peered":"2024-04-25T13:17:25.356284+0000","last_clean":"2024-04-25T13:17:25.356284+0000","last_became_active":"2024-04-25T13:16:06.999126+0000","last_became_peered":"2024-04-25T13:16:06.999126+0000","last_unstale":"2024-04-25T13:17:25.356284+0000","last_undegraded":"2024-04-25T13:17:25.356284+0000","last_fullsized":"2024-04-25T13:17:25.356284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T13:17:25.356205+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T13:17:25.356205+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.356205+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:16.883930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.249363+0000","last_change":"2024-04-25T13:17:30.249390+0000","last_active":"2024-04-25T13:17:30.249363+0000","last_peered":"2024-04-25T13:17:30.249363+0000","last_clean":"2024-04-25T13:17:30.249363+0000","last_became_active":"2024-04-25T13:16:12.733316+0000","last_became_peered":"2024-04-25T13:16:12.733316+0000","last_unstale":"2024-04-25T13:17:30.249363+0000","last_undegraded":"2024-04-25T13:17:30.249363+0000","last_fullsized":"2024-04-25T13:17:30.249363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.249245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.249245+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.249245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:24.939225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.109091+0000","last_change":"2024-04-25T13:17:33.109160+0000","last_active":"2024-04-25T13:17:33.109091+0000","last_peered":"2024-04-25T13:17:33.109091+0000","last_clean":"2024-04-25T13:17:33.109091+0000","last_became_active":"2024-04-25T13:16:08.021346+0000","last_became_peered":"2024-04-25T13:16:08.021346+0000","last_unstale":"2024-04-25T13:17:33.109091+0000","last_undegraded":"2024-04-25T13:17:33.109091+0000","last_fullsized":"2024-04-25T13:17:33.109091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.108975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.108975+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.108975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:14.609712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.047886+0000","last_change":"2024-04-25T13:17:23.047949+0000","last_active":"2024-04-25T13:17:23.047886+0000","last_peered":"2024-04-25T13:17:23.047886+0000","last_clean":"2024-04-25T13:17:23.047886+0000","last_became_active":"2024-04-25T13:16:06.990379+0000","last_became_peered":"2024-04-25T13:16:06.990379+0000","last_unstale":"2024-04-25T13:17:23.047886+0000","last_undegraded":"2024-04-25T13:17:23.047886+0000","last_fullsized":"2024-04-25T13:17:23.047886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T13:17:23.047783+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T13:17:23.047783+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.047783+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:34.901040+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.398731+0000","last_change":"2024-04-25T13:17:24.398731+0000","last_active":"2024-04-25T13:17:24.398731+0000","last_peered":"2024-04-25T13:17:24.398731+0000","last_clean":"2024-04-25T13:17:24.398731+0000","last_became_active":"2024-04-25T13:15:57.167692+0000","last_became_peered":"2024-04-25T13:15:57.167692+0000","last_unstale":"2024-04-25T13:17:24.398731+0000","last_undegraded":"2024-04-25T13:17:24.398731+0000","last_fullsized":"2024-04-25T13:17:24.398731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-25T13:17:24.398601+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-25T13:17:24.398601+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.398601+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:55.011248+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.201591+0000","last_change":"2024-04-25T13:17:35.201614+0000","last_active":"2024-04-25T13:17:35.201591+0000","last_peered":"2024-04-25T13:17:35.201591+0000","last_clean":"2024-04-25T13:17:35.201591+0000","last_became_active":"2024-04-25T13:16:12.734288+0000","last_became_peered":"2024-04-25T13:16:12.734288+0000","last_unstale":"2024-04-25T13:17:35.201591+0000","last_undegraded":"2024-04-25T13:17:35.201591+0000","last_fullsized":"2024-04-25T13:17:35.201591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.201512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.201512+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.201512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:47.236662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.363537+0000","last_change":"2024-04-25T13:17:39.363562+0000","last_active":"2024-04-25T13:17:39.363537+0000","last_peered":"2024-04-25T13:17:39.363537+0000","last_clean":"2024-04-25T13:17:39.363537+0000","last_became_active":"2024-04-25T13:16:08.013989+0000","last_became_peered":"2024-04-25T13:16:08.013989+0000","last_unstale":"2024-04-25T13:17:39.363537+0000","last_undegraded":"2024-04-25T13:17:39.363537+0000","last_fullsized":"2024-04-25T13:17:39.363537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.363454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.363454+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.363454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:24.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.489784+0000","last_change":"2024-04-25T13:17:22.489821+0000","last_active":"2024-04-25T13:17:22.489784+0000","last_peered":"2024-04-25T13:17:22.489784+0000","last_clean":"2024-04-25T13:17:22.489784+0000","last_became_active":"2024-04-25T13:16:06.996251+0000","last_became_peered":"2024-04-25T13:16:06.996251+0000","last_unstale":"2024-04-25T13:17:22.489784+0000","last_undegraded":"2024-04-25T13:17:22.489784+0000","last_fullsized":"2024-04-25T13:17:22.489784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T13:17:22.489690+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T13:17:22.489690+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.489690+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:56.624913+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.164342+0000","last_change":"2024-04-25T13:17:34.164369+0000","last_active":"2024-04-25T13:17:34.164342+0000","last_peered":"2024-04-25T13:17:34.164342+0000","last_clean":"2024-04-25T13:17:34.164342+0000","last_became_active":"2024-04-25T13:16:12.733114+0000","last_became_peered":"2024-04-25T13:16:12.733114+0000","last_unstale":"2024-04-25T13:17:34.164342+0000","last_undegraded":"2024-04-25T13:17:34.164342+0000","last_fullsized":"2024-04-25T13:17:34.164342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.164252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.164252+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.164252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:38.529575+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.925221+0000","last_change":"2024-04-25T13:17:27.925250+0000","last_active":"2024-04-25T13:17:27.925221+0000","last_peered":"2024-04-25T13:17:27.925221+0000","last_clean":"2024-04-25T13:17:27.925221+0000","last_became_active":"2024-04-25T13:16:08.011113+0000","last_became_peered":"2024-04-25T13:16:08.011113+0000","last_unstale":"2024-04-25T13:17:27.925221+0000","last_undegraded":"2024-04-25T13:17:27.925221+0000","last_fullsized":"2024-04-25T13:17:27.925221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.925106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.925106+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.925106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:19.036376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.381156+0000","last_change":"2024-04-25T13:17:19.381199+0000","last_active":"2024-04-25T13:17:19.381156+0000","last_peered":"2024-04-25T13:17:19.381156+0000","last_clean":"2024-04-25T13:17:19.381156+0000","last_became_active":"2024-04-25T13:16:06.988631+0000","last_became_peered":"2024-04-25T13:16:06.988631+0000","last_unstale":"2024-04-25T13:17:19.381156+0000","last_undegraded":"2024-04-25T13:17:19.381156+0000","last_fullsized":"2024-04-25T13:17:19.381156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:19.381072+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:19.381072+0000","last_clean_scrub_stamp":"2024-04-25T13:17:19.381072+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:02.009329+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.247148+0000","last_change":"2024-04-25T13:17:28.247176+0000","last_active":"2024-04-25T13:17:28.247148+0000","last_peered":"2024-04-25T13:17:28.247148+0000","last_clean":"2024-04-25T13:17:28.247148+0000","last_became_active":"2024-04-25T13:16:12.046780+0000","last_became_peered":"2024-04-25T13:16:12.046780+0000","last_unstale":"2024-04-25T13:17:28.247148+0000","last_undegraded":"2024-04-25T13:17:28.247148+0000","last_fullsized":"2024-04-25T13:17:28.247148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.247052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.247052+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.247052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:20.082472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.334439+0000","last_change":"2024-04-25T13:17:35.334463+0000","last_active":"2024-04-25T13:17:35.334439+0000","last_peered":"2024-04-25T13:17:35.334439+0000","last_clean":"2024-04-25T13:17:35.334439+0000","last_became_active":"2024-04-25T13:16:08.007681+0000","last_became_peered":"2024-04-25T13:16:08.007681+0000","last_unstale":"2024-04-25T13:17:35.334439+0000","last_undegraded":"2024-04-25T13:17:35.334439+0000","last_fullsized":"2024-04-25T13:17:35.334439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.334349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.334349+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.334349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:44.840474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:20.452162+0000","last_change":"2024-04-25T13:17:20.452188+0000","last_active":"2024-04-25T13:17:20.452162+0000","last_peered":"2024-04-25T13:17:20.452162+0000","last_clean":"2024-04-25T13:17:20.452162+0000","last_became_active":"2024-04-25T13:16:06.991578+0000","last_became_peered":"2024-04-25T13:16:06.991578+0000","last_unstale":"2024-04-25T13:17:20.452162+0000","last_undegraded":"2024-04-25T13:17:20.452162+0000","last_fullsized":"2024-04-25T13:17:20.452162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T13:17:20.452098+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T13:17:20.452098+0000","last_clean_scrub_stamp":"2024-04-25T13:17:20.452098+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:21.791926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.989581+0000","last_change":"2024-04-25T13:17:35.989610+0000","last_active":"2024-04-25T13:17:35.989581+0000","last_peered":"2024-04-25T13:17:35.989581+0000","last_clean":"2024-04-25T13:17:35.989581+0000","last_became_active":"2024-04-25T13:16:12.733136+0000","last_became_peered":"2024-04-25T13:16:12.733136+0000","last_unstale":"2024-04-25T13:17:35.989581+0000","last_undegraded":"2024-04-25T13:17:35.989581+0000","last_fullsized":"2024-04-25T13:17:35.989581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.989488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.989488+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.989488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:28.003597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.401571+0000","last_change":"2024-04-25T13:17:22.401601+0000","last_active":"2024-04-25T13:17:22.401571+0000","last_peered":"2024-04-25T13:17:22.401571+0000","last_clean":"2024-04-25T13:17:22.401571+0000","last_became_active":"2024-04-25T13:16:08.004180+0000","last_became_peered":"2024-04-25T13:16:08.004180+0000","last_unstale":"2024-04-25T13:17:22.401571+0000","last_undegraded":"2024-04-25T13:17:22.401571+0000","last_fullsized":"2024-04-25T13:17:22.401571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:22.401483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:22.401483+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.401483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:30.078452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:20.573428+0000","last_change":"2024-04-25T13:17:20.573456+0000","last_active":"2024-04-25T13:17:20.573428+0000","last_peered":"2024-04-25T13:17:20.573428+0000","last_clean":"2024-04-25T13:17:20.573428+0000","last_became_active":"2024-04-25T13:16:06.994235+0000","last_became_peered":"2024-04-25T13:16:06.994235+0000","last_unstale":"2024-04-25T13:17:20.573428+0000","last_undegraded":"2024-04-25T13:17:20.573428+0000","last_fullsized":"2024-04-25T13:17:20.573428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T13:17:20.573306+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T13:17:20.573306+0000","last_clean_scrub_stamp":"2024-04-25T13:17:20.573306+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:44.308553+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.577947+0000","last_change":"2024-04-25T13:17:29.577973+0000","last_active":"2024-04-25T13:17:29.577947+0000","last_peered":"2024-04-25T13:17:29.577947+0000","last_clean":"2024-04-25T13:17:29.577947+0000","last_became_active":"2024-04-25T13:16:12.038534+0000","last_became_peered":"2024-04-25T13:16:12.038534+0000","last_unstale":"2024-04-25T13:17:29.577947+0000","last_undegraded":"2024-04-25T13:17:29.577947+0000","last_fullsized":"2024-04-25T13:17:29.577947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.577856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.577856+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.577856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:25.559854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.321611+0000","last_change":"2024-04-25T13:17:34.321662+0000","last_active":"2024-04-25T13:17:34.321611+0000","last_peered":"2024-04-25T13:17:34.321611+0000","last_clean":"2024-04-25T13:17:34.321611+0000","last_became_active":"2024-04-25T13:16:08.007050+0000","last_became_peered":"2024-04-25T13:16:08.007050+0000","last_unstale":"2024-04-25T13:17:34.321611+0000","last_undegraded":"2024-04-25T13:17:34.321611+0000","last_fullsized":"2024-04-25T13:17:34.321611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.321509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.321509+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.321509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:49.436811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.416366+0000","last_change":"2024-04-25T13:17:19.416399+0000","last_active":"2024-04-25T13:17:19.416366+0000","last_peered":"2024-04-25T13:17:19.416366+0000","last_clean":"2024-04-25T13:17:19.416366+0000","last_became_active":"2024-04-25T13:16:06.982320+0000","last_became_peered":"2024-04-25T13:16:06.982320+0000","last_unstale":"2024-04-25T13:17:19.416366+0000","last_undegraded":"2024-04-25T13:17:19.416366+0000","last_fullsized":"2024-04-25T13:17:19.416366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-25T13:17:19.416275+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-25T13:17:19.416275+0000","last_clean_scrub_stamp":"2024-04-25T13:17:19.416275+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:40.159412+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.256342+0000","last_change":"2024-04-25T13:17:27.256368+0000","last_active":"2024-04-25T13:17:27.256342+0000","last_peered":"2024-04-25T13:17:27.256342+0000","last_clean":"2024-04-25T13:17:27.256342+0000","last_became_active":"2024-04-25T13:16:12.042902+0000","last_became_peered":"2024-04-25T13:16:12.042902+0000","last_unstale":"2024-04-25T13:17:27.256342+0000","last_undegraded":"2024-04-25T13:17:27.256342+0000","last_fullsized":"2024-04-25T13:17:27.256342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.256250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.256250+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.256250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:00.532550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.209142+0000","last_change":"2024-04-25T13:17:30.209165+0000","last_active":"2024-04-25T13:17:30.209142+0000","last_peered":"2024-04-25T13:17:30.209142+0000","last_clean":"2024-04-25T13:17:30.209142+0000","last_became_active":"2024-04-25T13:16:08.008102+0000","last_became_peered":"2024-04-25T13:16:08.008102+0000","last_unstale":"2024-04-25T13:17:30.209142+0000","last_undegraded":"2024-04-25T13:17:30.209142+0000","last_fullsized":"2024-04-25T13:17:30.209142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.209058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.209058+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.209058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:25.554448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.194410+0000","last_change":"2024-04-25T13:17:22.194441+0000","last_active":"2024-04-25T13:17:22.194410+0000","last_peered":"2024-04-25T13:17:22.194410+0000","last_clean":"2024-04-25T13:17:22.194410+0000","last_became_active":"2024-04-25T13:16:06.993008+0000","last_became_peered":"2024-04-25T13:16:06.993008+0000","last_unstale":"2024-04-25T13:17:22.194410+0000","last_undegraded":"2024-04-25T13:17:22.194410+0000","last_fullsized":"2024-04-25T13:17:22.194410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T13:17:22.194329+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T13:17:22.194329+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.194329+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:16.911178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.136695+0000","last_change":"2024-04-25T13:17:37.136722+0000","last_active":"2024-04-25T13:17:37.136695+0000","last_peered":"2024-04-25T13:17:37.136695+0000","last_clean":"2024-04-25T13:17:37.136695+0000","last_became_active":"2024-04-25T13:16:12.733359+0000","last_became_peered":"2024-04-25T13:16:12.733359+0000","last_unstale":"2024-04-25T13:17:37.136695+0000","last_undegraded":"2024-04-25T13:17:37.136695+0000","last_fullsized":"2024-04-25T13:17:37.136695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.136603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.136603+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.136603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:12.254489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.309852+0000","last_change":"2024-04-25T13:17:36.309888+0000","last_active":"2024-04-25T13:17:36.309852+0000","last_peered":"2024-04-25T13:17:36.309852+0000","last_clean":"2024-04-25T13:17:36.309852+0000","last_became_active":"2024-04-25T13:16:08.007790+0000","last_became_peered":"2024-04-25T13:16:08.007790+0000","last_unstale":"2024-04-25T13:17:36.309852+0000","last_undegraded":"2024-04-25T13:17:36.309852+0000","last_fullsized":"2024-04-25T13:17:36.309852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.309757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.309757+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.309757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:49.326246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.986564+0000","last_change":"2024-04-25T13:17:24.986625+0000","last_active":"2024-04-25T13:17:24.986564+0000","last_peered":"2024-04-25T13:17:24.986564+0000","last_clean":"2024-04-25T13:17:24.986564+0000","last_became_active":"2024-04-25T13:16:06.996439+0000","last_became_peered":"2024-04-25T13:16:06.996439+0000","last_unstale":"2024-04-25T13:17:24.986564+0000","last_undegraded":"2024-04-25T13:17:24.986564+0000","last_fullsized":"2024-04-25T13:17:24.986564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T13:17:24.986459+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T13:17:24.986459+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.986459+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:30.744200+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.136664+0000","last_change":"2024-04-25T13:17:38.136692+0000","last_active":"2024-04-25T13:17:38.136664+0000","last_peered":"2024-04-25T13:17:38.136664+0000","last_clean":"2024-04-25T13:17:38.136664+0000","last_became_active":"2024-04-25T13:16:12.733328+0000","last_became_peered":"2024-04-25T13:16:12.733328+0000","last_unstale":"2024-04-25T13:17:38.136664+0000","last_undegraded":"2024-04-25T13:17:38.136664+0000","last_fullsized":"2024-04-25T13:17:38.136664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.136570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.136570+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.136570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:52.154678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.453543+0000","last_change":"2024-04-25T13:17:28.453567+0000","last_active":"2024-04-25T13:17:28.453543+0000","last_peered":"2024-04-25T13:17:28.453543+0000","last_clean":"2024-04-25T13:17:28.453543+0000","last_became_active":"2024-04-25T13:16:49.135704+0000","last_became_peered":"2024-04-25T13:16:49.135704+0000","last_unstale":"2024-04-25T13:17:28.453543+0000","last_undegraded":"2024-04-25T13:17:28.453543+0000","last_fullsized":"2024-04-25T13:17:28.453543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.453462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.453462+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.453462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:30.347089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.13","version":"27'13","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:18.444587+0000","last_change":"2024-04-25T13:17:18.444644+0000","last_active":"2024-04-25T13:17:18.444587+0000","last_peered":"2024-04-25T13:17:18.444587+0000","last_clean":"2024-04-25T13:17:18.444587+0000","last_became_active":"2024-04-25T13:16:07.000243+0000","last_became_peered":"2024-04-25T13:16:07.000243+0000","last_unstale":"2024-04-25T13:17:18.444587+0000","last_undegraded":"2024-04-25T13:17:18.444587+0000","last_fullsized":"2024-04-25T13:17:18.444587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-04-25T13:17:18.444488+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-04-25T13:17:18.444488+0000","last_clean_scrub_stamp":"2024-04-25T13:17:18.444488+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:39:32.397333+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.973060+0000","last_change":"2024-04-25T13:17:36.973088+0000","last_active":"2024-04-25T13:17:36.973060+0000","last_peered":"2024-04-25T13:17:36.973060+0000","last_clean":"2024-04-25T13:17:36.973060+0000","last_became_active":"2024-04-25T13:16:12.733245+0000","last_became_peered":"2024-04-25T13:16:12.733245+0000","last_unstale":"2024-04-25T13:17:36.973060+0000","last_undegraded":"2024-04-25T13:17:36.973060+0000","last_fullsized":"2024-04-25T13:17:36.973060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.972919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.972919+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.972919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:24.100521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.354983+0000","last_change":"2024-04-25T13:17:37.355028+0000","last_active":"2024-04-25T13:17:37.354983+0000","last_peered":"2024-04-25T13:17:37.354983+0000","last_clean":"2024-04-25T13:17:37.354983+0000","last_became_active":"2024-04-25T13:16:08.008530+0000","last_became_peered":"2024-04-25T13:16:08.008530+0000","last_unstale":"2024-04-25T13:17:37.354983+0000","last_undegraded":"2024-04-25T13:17:37.354983+0000","last_fullsized":"2024-04-25T13:17:37.354983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.354902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.354902+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.354902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:27.028424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'19","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.221812+0000","last_change":"2024-04-25T13:17:25.221854+0000","last_active":"2024-04-25T13:17:25.221812+0000","last_peered":"2024-04-25T13:17:25.221812+0000","last_clean":"2024-04-25T13:17:25.221812+0000","last_became_active":"2024-04-25T13:16:06.997289+0000","last_became_peered":"2024-04-25T13:16:06.997289+0000","last_unstale":"2024-04-25T13:17:25.221812+0000","last_undegraded":"2024-04-25T13:17:25.221812+0000","last_fullsized":"2024-04-25T13:17:25.221812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-04-25T13:17:25.221727+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-04-25T13:17:25.221727+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.221727+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:18.743557+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.334636+0000","last_change":"2024-04-25T13:17:32.334661+0000","last_active":"2024-04-25T13:17:32.334636+0000","last_peered":"2024-04-25T13:17:32.334636+0000","last_clean":"2024-04-25T13:17:32.334636+0000","last_became_active":"2024-04-25T13:16:12.039443+0000","last_became_peered":"2024-04-25T13:16:12.039443+0000","last_unstale":"2024-04-25T13:17:32.334636+0000","last_undegraded":"2024-04-25T13:17:32.334636+0000","last_fullsized":"2024-04-25T13:17:32.334636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.334540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.334540+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.334540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:25.198912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.517981+0000","last_change":"2024-04-25T13:17:24.518011+0000","last_active":"2024-04-25T13:17:24.517981+0000","last_peered":"2024-04-25T13:17:24.517981+0000","last_clean":"2024-04-25T13:17:24.517981+0000","last_became_active":"2024-04-25T13:16:08.002583+0000","last_became_peered":"2024-04-25T13:16:08.002583+0000","last_unstale":"2024-04-25T13:17:24.517981+0000","last_undegraded":"2024-04-25T13:17:24.517981+0000","last_fullsized":"2024-04-25T13:17:24.517981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:24.517894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:24.517894+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.517894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:09.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.423380+0000","last_change":"2024-04-25T13:17:24.423413+0000","last_active":"2024-04-25T13:17:24.423380+0000","last_peered":"2024-04-25T13:17:24.423380+0000","last_clean":"2024-04-25T13:17:24.423380+0000","last_became_active":"2024-04-25T13:16:06.995616+0000","last_became_peered":"2024-04-25T13:16:06.995616+0000","last_unstale":"2024-04-25T13:17:24.423380+0000","last_undegraded":"2024-04-25T13:17:24.423380+0000","last_fullsized":"2024-04-25T13:17:24.423380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T13:17:24.423302+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T13:17:24.423302+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.423302+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:23.006424+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.631803+0000","last_change":"2024-04-25T13:17:31.631857+0000","last_active":"2024-04-25T13:17:31.631803+0000","last_peered":"2024-04-25T13:17:31.631803+0000","last_clean":"2024-04-25T13:17:31.631803+0000","last_became_active":"2024-04-25T13:16:12.043267+0000","last_became_peered":"2024-04-25T13:16:12.043267+0000","last_unstale":"2024-04-25T13:17:31.631803+0000","last_undegraded":"2024-04-25T13:17:31.631803+0000","last_fullsized":"2024-04-25T13:17:31.631803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.631707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.631707+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.631707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:46.469784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.220450+0000","last_change":"2024-04-25T13:17:32.220502+0000","last_active":"2024-04-25T13:17:32.220450+0000","last_peered":"2024-04-25T13:17:32.220450+0000","last_clean":"2024-04-25T13:17:32.220450+0000","last_became_active":"2024-04-25T13:16:49.136773+0000","last_became_peered":"2024-04-25T13:16:49.136773+0000","last_unstale":"2024-04-25T13:17:32.220450+0000","last_undegraded":"2024-04-25T13:17:32.220450+0000","last_fullsized":"2024-04-25T13:17:32.220450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.220358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.220358+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.220358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:18.538683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.954733+0000","last_change":"2024-04-25T13:17:25.954787+0000","last_active":"2024-04-25T13:17:25.954733+0000","last_peered":"2024-04-25T13:17:25.954733+0000","last_clean":"2024-04-25T13:17:25.954733+0000","last_became_active":"2024-04-25T13:16:06.996418+0000","last_became_peered":"2024-04-25T13:16:06.996418+0000","last_unstale":"2024-04-25T13:17:25.954733+0000","last_undegraded":"2024-04-25T13:17:25.954733+0000","last_fullsized":"2024-04-25T13:17:25.954733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T13:17:25.954648+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T13:17:25.954648+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.954648+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:23.229488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.090870+0000","last_change":"2024-04-25T13:17:35.090897+0000","last_active":"2024-04-25T13:17:35.090870+0000","last_peered":"2024-04-25T13:17:35.090870+0000","last_clean":"2024-04-25T13:17:35.090870+0000","last_became_active":"2024-04-25T13:16:12.042252+0000","last_became_peered":"2024-04-25T13:16:12.042252+0000","last_unstale":"2024-04-25T13:17:35.090870+0000","last_undegraded":"2024-04-25T13:17:35.090870+0000","last_fullsized":"2024-04-25T13:17:35.090870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.090769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.090769+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.090769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:08.391115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.019888+0000","last_change":"2024-04-25T13:17:33.019919+0000","last_active":"2024-04-25T13:17:33.019888+0000","last_peered":"2024-04-25T13:17:33.019888+0000","last_clean":"2024-04-25T13:17:33.019888+0000","last_became_active":"2024-04-25T13:16:08.015820+0000","last_became_peered":"2024-04-25T13:16:08.015820+0000","last_unstale":"2024-04-25T13:17:33.019888+0000","last_undegraded":"2024-04-25T13:17:33.019888+0000","last_fullsized":"2024-04-25T13:17:33.019888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.019786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.019786+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.019786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:22.853110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.175591+0000","last_change":"2024-04-25T13:17:24.175628+0000","last_active":"2024-04-25T13:17:24.175591+0000","last_peered":"2024-04-25T13:17:24.175591+0000","last_clean":"2024-04-25T13:17:24.175591+0000","last_became_active":"2024-04-25T13:16:06.996373+0000","last_became_peered":"2024-04-25T13:16:06.996373+0000","last_unstale":"2024-04-25T13:17:24.175591+0000","last_undegraded":"2024-04-25T13:17:24.175591+0000","last_fullsized":"2024-04-25T13:17:24.175591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T13:17:24.175503+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T13:17:24.175503+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.175503+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:44.379433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.110506+0000","last_change":"2024-04-25T13:17:36.110536+0000","last_active":"2024-04-25T13:17:36.110506+0000","last_peered":"2024-04-25T13:17:36.110506+0000","last_clean":"2024-04-25T13:17:36.110506+0000","last_became_active":"2024-04-25T13:16:12.733314+0000","last_became_peered":"2024-04-25T13:16:12.733314+0000","last_unstale":"2024-04-25T13:17:36.110506+0000","last_undegraded":"2024-04-25T13:17:36.110506+0000","last_fullsized":"2024-04-25T13:17:36.110506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.110405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.110405+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.110405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:38.559653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.256633+0000","last_change":"2024-04-25T13:17:31.256680+0000","last_active":"2024-04-25T13:17:31.256633+0000","last_peered":"2024-04-25T13:17:31.256633+0000","last_clean":"2024-04-25T13:17:31.256633+0000","last_became_active":"2024-04-25T13:16:12.733908+0000","last_became_peered":"2024-04-25T13:16:12.733908+0000","last_unstale":"2024-04-25T13:17:31.256633+0000","last_undegraded":"2024-04-25T13:17:31.256633+0000","last_fullsized":"2024-04-25T13:17:31.256633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.256540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.256540+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.256540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:43.843772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.281216+0000","last_change":"2024-04-25T13:17:30.281242+0000","last_active":"2024-04-25T13:17:30.281216+0000","last_peered":"2024-04-25T13:17:30.281216+0000","last_clean":"2024-04-25T13:17:30.281216+0000","last_became_active":"2024-04-25T13:16:08.008586+0000","last_became_peered":"2024-04-25T13:16:08.008586+0000","last_unstale":"2024-04-25T13:17:30.281216+0000","last_undegraded":"2024-04-25T13:17:30.281216+0000","last_fullsized":"2024-04-25T13:17:30.281216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.281130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.281130+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.281130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:16:50.209045+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.024557+0000","last_change":"2024-04-25T13:17:24.024590+0000","last_active":"2024-04-25T13:17:24.024557+0000","last_peered":"2024-04-25T13:17:24.024557+0000","last_clean":"2024-04-25T13:17:24.024557+0000","last_became_active":"2024-04-25T13:16:06.994005+0000","last_became_peered":"2024-04-25T13:16:06.994005+0000","last_unstale":"2024-04-25T13:17:24.024557+0000","last_undegraded":"2024-04-25T13:17:24.024557+0000","last_fullsized":"2024-04-25T13:17:24.024557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:24.024471+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:24.024471+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.024471+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:13.422592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.174940+0000","last_change":"2024-04-25T13:17:33.174965+0000","last_active":"2024-04-25T13:17:33.174940+0000","last_peered":"2024-04-25T13:17:33.174940+0000","last_clean":"2024-04-25T13:17:33.174940+0000","last_became_active":"2024-04-25T13:16:12.036569+0000","last_became_peered":"2024-04-25T13:16:12.036569+0000","last_unstale":"2024-04-25T13:17:33.174940+0000","last_undegraded":"2024-04-25T13:17:33.174940+0000","last_fullsized":"2024-04-25T13:17:33.174940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.174861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.174861+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.174861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:22.868372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.045257+0000","last_change":"2024-04-25T13:17:28.045296+0000","last_active":"2024-04-25T13:17:28.045257+0000","last_peered":"2024-04-25T13:17:28.045257+0000","last_clean":"2024-04-25T13:17:28.045257+0000","last_became_active":"2024-04-25T13:16:08.008078+0000","last_became_peered":"2024-04-25T13:16:08.008078+0000","last_unstale":"2024-04-25T13:17:28.045257+0000","last_undegraded":"2024-04-25T13:17:28.045257+0000","last_fullsized":"2024-04-25T13:17:28.045257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.045170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.045170+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.045170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:15.593975+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.057987+0000","last_change":"2024-04-25T13:17:26.058019+0000","last_active":"2024-04-25T13:17:26.057987+0000","last_peered":"2024-04-25T13:17:26.057987+0000","last_clean":"2024-04-25T13:17:26.057987+0000","last_became_active":"2024-04-25T13:16:06.996985+0000","last_became_peered":"2024-04-25T13:16:06.996985+0000","last_unstale":"2024-04-25T13:17:26.057987+0000","last_undegraded":"2024-04-25T13:17:26.057987+0000","last_fullsized":"2024-04-25T13:17:26.057987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:26.057902+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:26.057902+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.057902+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:00.699389+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.162900+0000","last_change":"2024-04-25T13:17:21.162952+0000","last_active":"2024-04-25T13:17:21.162900+0000","last_peered":"2024-04-25T13:17:21.162900+0000","last_clean":"2024-04-25T13:17:21.162900+0000","last_became_active":"2024-04-25T13:16:06.992407+0000","last_became_peered":"2024-04-25T13:16:06.992407+0000","last_unstale":"2024-04-25T13:17:21.162900+0000","last_undegraded":"2024-04-25T13:17:21.162900+0000","last_fullsized":"2024-04-25T13:17:21.162900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T13:17:21.162784+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T13:17:21.162784+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.162784+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:47.666696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.335642+0000","last_change":"2024-04-25T13:17:25.335670+0000","last_active":"2024-04-25T13:17:25.335642+0000","last_peered":"2024-04-25T13:17:25.335642+0000","last_clean":"2024-04-25T13:17:25.335642+0000","last_became_active":"2024-04-25T13:16:08.003959+0000","last_became_peered":"2024-04-25T13:16:08.003959+0000","last_unstale":"2024-04-25T13:17:25.335642+0000","last_undegraded":"2024-04-25T13:17:25.335642+0000","last_fullsized":"2024-04-25T13:17:25.335642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:25.335552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:25.335552+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.335552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:36.584211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.449092+0000","last_change":"2024-04-25T13:17:25.449121+0000","last_active":"2024-04-25T13:17:25.449092+0000","last_peered":"2024-04-25T13:17:25.449092+0000","last_clean":"2024-04-25T13:17:25.449092+0000","last_became_active":"2024-04-25T13:16:12.036651+0000","last_became_peered":"2024-04-25T13:16:12.036651+0000","last_unstale":"2024-04-25T13:17:25.449092+0000","last_undegraded":"2024-04-25T13:17:25.449092+0000","last_fullsized":"2024-04-25T13:17:25.449092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:25.448992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:25.448992+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.448992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:49.007955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.039507+0000","last_change":"2024-04-25T13:17:25.039538+0000","last_active":"2024-04-25T13:17:25.039507+0000","last_peered":"2024-04-25T13:17:25.039507+0000","last_clean":"2024-04-25T13:17:25.039507+0000","last_became_active":"2024-04-25T13:16:06.996010+0000","last_became_peered":"2024-04-25T13:16:06.996010+0000","last_unstale":"2024-04-25T13:17:25.039507+0000","last_undegraded":"2024-04-25T13:17:25.039507+0000","last_fullsized":"2024-04-25T13:17:25.039507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T13:17:25.039429+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T13:17:25.039429+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.039429+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:55.868188+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.502519+0000","last_change":"2024-04-25T13:17:22.502541+0000","last_active":"2024-04-25T13:17:22.502519+0000","last_peered":"2024-04-25T13:17:22.502519+0000","last_clean":"2024-04-25T13:17:22.502519+0000","last_became_active":"2024-04-25T13:16:08.001833+0000","last_became_peered":"2024-04-25T13:16:08.001833+0000","last_unstale":"2024-04-25T13:17:22.502519+0000","last_undegraded":"2024-04-25T13:17:22.502519+0000","last_fullsized":"2024-04-25T13:17:22.502519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:22.502444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:22.502444+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.502444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:13.756726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.116970+0000","last_change":"2024-04-25T13:17:34.116997+0000","last_active":"2024-04-25T13:17:34.116970+0000","last_peered":"2024-04-25T13:17:34.116970+0000","last_clean":"2024-04-25T13:17:34.116970+0000","last_became_active":"2024-04-25T13:16:12.042000+0000","last_became_peered":"2024-04-25T13:16:12.042000+0000","last_unstale":"2024-04-25T13:17:34.116970+0000","last_undegraded":"2024-04-25T13:17:34.116970+0000","last_fullsized":"2024-04-25T13:17:34.116970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.116877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.116877+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.116877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:16:48.434664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.255373+0000","last_change":"2024-04-25T13:17:28.255396+0000","last_active":"2024-04-25T13:17:28.255373+0000","last_peered":"2024-04-25T13:17:28.255373+0000","last_clean":"2024-04-25T13:17:28.255373+0000","last_became_active":"2024-04-25T13:16:08.007728+0000","last_became_peered":"2024-04-25T13:16:08.007728+0000","last_unstale":"2024-04-25T13:17:28.255373+0000","last_undegraded":"2024-04-25T13:17:28.255373+0000","last_fullsized":"2024-04-25T13:17:28.255373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.255292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.255292+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.255292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:01.389332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.435514+0000","last_change":"2024-04-25T13:17:24.435538+0000","last_active":"2024-04-25T13:17:24.435514+0000","last_peered":"2024-04-25T13:17:24.435514+0000","last_clean":"2024-04-25T13:17:24.435514+0000","last_became_active":"2024-04-25T13:16:08.010981+0000","last_became_peered":"2024-04-25T13:16:08.010981+0000","last_unstale":"2024-04-25T13:17:24.435514+0000","last_undegraded":"2024-04-25T13:17:24.435514+0000","last_fullsized":"2024-04-25T13:17:24.435514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:24.435431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:24.435431+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.435431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:50.837464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.998903+0000","last_change":"2024-04-25T13:17:33.998923+0000","last_active":"2024-04-25T13:17:33.998903+0000","last_peered":"2024-04-25T13:17:33.998903+0000","last_clean":"2024-04-25T13:17:33.998903+0000","last_became_active":"2024-04-25T13:16:08.016084+0000","last_became_peered":"2024-04-25T13:16:08.016084+0000","last_unstale":"2024-04-25T13:17:33.998903+0000","last_undegraded":"2024-04-25T13:17:33.998903+0000","last_fullsized":"2024-04-25T13:17:33.998903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.998800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.998800+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.998800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:24.211041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.209615+0000","last_change":"2024-04-25T13:17:33.209640+0000","last_active":"2024-04-25T13:17:33.209615+0000","last_peered":"2024-04-25T13:17:33.209615+0000","last_clean":"2024-04-25T13:17:33.209615+0000","last_became_active":"2024-04-25T13:16:49.137825+0000","last_became_peered":"2024-04-25T13:16:49.137825+0000","last_unstale":"2024-04-25T13:17:33.209615+0000","last_undegraded":"2024-04-25T13:17:33.209615+0000","last_fullsized":"2024-04-25T13:17:33.209615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.209532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.209532+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.209532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:12.857719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:30.127057+0000","last_change":"2024-04-25T13:17:30.127081+0000","last_active":"2024-04-25T13:17:30.127057+0000","last_peered":"2024-04-25T13:17:30.127057+0000","last_clean":"2024-04-25T13:17:30.127057+0000","last_became_active":"2024-04-25T13:16:08.012481+0000","last_became_peered":"2024-04-25T13:16:08.012481+0000","last_unstale":"2024-04-25T13:17:30.127057+0000","last_undegraded":"2024-04-25T13:17:30.127057+0000","last_fullsized":"2024-04-25T13:17:30.127057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:30.126957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:30.126957+0000","last_clean_scrub_stamp":"2024-04-25T13:17:30.126957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:44.965035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.305189+0000","last_change":"2024-04-25T13:17:29.305214+0000","last_active":"2024-04-25T13:17:29.305189+0000","last_peered":"2024-04-25T13:17:29.305189+0000","last_clean":"2024-04-25T13:17:29.305189+0000","last_became_active":"2024-04-25T13:16:08.008489+0000","last_became_peered":"2024-04-25T13:16:08.008489+0000","last_unstale":"2024-04-25T13:17:29.305189+0000","last_undegraded":"2024-04-25T13:17:29.305189+0000","last_fullsized":"2024-04-25T13:17:29.305189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.305102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.305102+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.305102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:49.057062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.258251+0000","last_change":"2024-04-25T13:17:27.258301+0000","last_active":"2024-04-25T13:17:27.258251+0000","last_peered":"2024-04-25T13:17:27.258251+0000","last_clean":"2024-04-25T13:17:27.258251+0000","last_became_active":"2024-04-25T13:16:08.007727+0000","last_became_peered":"2024-04-25T13:16:08.007727+0000","last_unstale":"2024-04-25T13:17:27.258251+0000","last_undegraded":"2024-04-25T13:17:27.258251+0000","last_fullsized":"2024-04-25T13:17:27.258251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.258154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.258154+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.258154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:18.512436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.940233+0000","last_change":"2024-04-25T13:17:21.940259+0000","last_active":"2024-04-25T13:17:21.940233+0000","last_peered":"2024-04-25T13:17:21.940233+0000","last_clean":"2024-04-25T13:17:21.940233+0000","last_became_active":"2024-04-25T13:16:08.014579+0000","last_became_peered":"2024-04-25T13:16:08.014579+0000","last_unstale":"2024-04-25T13:17:21.940233+0000","last_undegraded":"2024-04-25T13:17:21.940233+0000","last_fullsized":"2024-04-25T13:17:21.940233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:21.940159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:21.940159+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.940159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:47.447961+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.983513+0000","last_change":"2024-04-25T13:17:29.983535+0000","last_active":"2024-04-25T13:17:29.983513+0000","last_peered":"2024-04-25T13:17:29.983513+0000","last_clean":"2024-04-25T13:17:29.983513+0000","last_became_active":"2024-04-25T13:16:08.014693+0000","last_became_peered":"2024-04-25T13:16:08.014693+0000","last_unstale":"2024-04-25T13:17:29.983513+0000","last_undegraded":"2024-04-25T13:17:29.983513+0000","last_fullsized":"2024-04-25T13:17:29.983513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.983403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.983403+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.983403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:45.588387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:24.032539+0000","last_change":"2024-04-25T13:17:24.032567+0000","last_active":"2024-04-25T13:17:24.032539+0000","last_peered":"2024-04-25T13:17:24.032539+0000","last_clean":"2024-04-25T13:17:24.032539+0000","last_became_active":"2024-04-25T13:16:08.014575+0000","last_became_peered":"2024-04-25T13:16:08.014575+0000","last_unstale":"2024-04-25T13:17:24.032539+0000","last_undegraded":"2024-04-25T13:17:24.032539+0000","last_fullsized":"2024-04-25T13:17:24.032539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:24.032452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:24.032452+0000","last_clean_scrub_stamp":"2024-04-25T13:17:24.032452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:59.051739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:26.444664+0000","last_change":"2024-04-25T13:17:26.444686+0000","last_active":"2024-04-25T13:17:26.444664+0000","last_peered":"2024-04-25T13:17:26.444664+0000","last_clean":"2024-04-25T13:17:26.444664+0000","last_became_active":"2024-04-25T13:16:49.133449+0000","last_became_peered":"2024-04-25T13:16:49.133449+0000","last_unstale":"2024-04-25T13:17:26.444664+0000","last_undegraded":"2024-04-25T13:17:26.444664+0000","last_fullsized":"2024-04-25T13:17:26.444664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:26.444568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:26.444568+0000","last_clean_scrub_stamp":"2024-04-25T13:17:26.444568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:10.506124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.425700+0000","last_change":"2024-04-25T13:17:23.425741+0000","last_active":"2024-04-25T13:17:23.425700+0000","last_peered":"2024-04-25T13:17:23.425700+0000","last_clean":"2024-04-25T13:17:23.425700+0000","last_became_active":"2024-04-25T13:16:08.000102+0000","last_became_peered":"2024-04-25T13:16:08.000102+0000","last_unstale":"2024-04-25T13:17:23.425700+0000","last_undegraded":"2024-04-25T13:17:23.425700+0000","last_fullsized":"2024-04-25T13:17:23.425700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:23.425599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:23.425599+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.425599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:26.901720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:29.255829+0000","last_change":"2024-04-25T13:17:29.255851+0000","last_active":"2024-04-25T13:17:29.255829+0000","last_peered":"2024-04-25T13:17:29.255829+0000","last_clean":"2024-04-25T13:17:29.255829+0000","last_became_active":"2024-04-25T13:16:08.008173+0000","last_became_peered":"2024-04-25T13:16:08.008173+0000","last_unstale":"2024-04-25T13:17:29.255829+0000","last_undegraded":"2024-04-25T13:17:29.255829+0000","last_fullsized":"2024-04-25T13:17:29.255829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:29.255745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:29.255745+0000","last_clean_scrub_stamp":"2024-04-25T13:17:29.255745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:43.639435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.426502+0000","last_change":"2024-04-25T13:17:23.426525+0000","last_active":"2024-04-25T13:17:23.426502+0000","last_peered":"2024-04-25T13:17:23.426502+0000","last_clean":"2024-04-25T13:17:23.426502+0000","last_became_active":"2024-04-25T13:16:08.004340+0000","last_became_peered":"2024-04-25T13:16:08.004340+0000","last_unstale":"2024-04-25T13:17:23.426502+0000","last_undegraded":"2024-04-25T13:17:23.426502+0000","last_fullsized":"2024-04-25T13:17:23.426502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:23.426430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:23.426430+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.426430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:40.584178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.440592+0000","last_change":"2024-04-25T13:17:23.440621+0000","last_active":"2024-04-25T13:17:23.440592+0000","last_peered":"2024-04-25T13:17:23.440592+0000","last_clean":"2024-04-25T13:17:23.440592+0000","last_became_active":"2024-04-25T13:16:08.005041+0000","last_became_peered":"2024-04-25T13:16:08.005041+0000","last_unstale":"2024-04-25T13:17:23.440592+0000","last_undegraded":"2024-04-25T13:17:23.440592+0000","last_fullsized":"2024-04-25T13:17:23.440592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:23.440506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:23.440506+0000","last_clean_scrub_stamp":"2024-04-25T13:17:23.440506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:24.582404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.467846+0000","last_change":"2024-04-25T13:17:27.467873+0000","last_active":"2024-04-25T13:17:27.467846+0000","last_peered":"2024-04-25T13:17:27.467846+0000","last_clean":"2024-04-25T13:17:27.467846+0000","last_became_active":"2024-04-25T13:16:49.135476+0000","last_became_peered":"2024-04-25T13:16:49.135476+0000","last_unstale":"2024-04-25T13:17:27.467846+0000","last_undegraded":"2024-04-25T13:17:27.467846+0000","last_fullsized":"2024-04-25T13:17:27.467846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.467765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.467765+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.467765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:44:19.718055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:21.064912+0000","last_change":"2024-04-25T13:17:21.064934+0000","last_active":"2024-04-25T13:17:21.064912+0000","last_peered":"2024-04-25T13:17:21.064912+0000","last_clean":"2024-04-25T13:17:21.064912+0000","last_became_active":"2024-04-25T13:16:08.012472+0000","last_became_peered":"2024-04-25T13:16:08.012472+0000","last_unstale":"2024-04-25T13:17:21.064912+0000","last_undegraded":"2024-04-25T13:17:21.064912+0000","last_fullsized":"2024-04-25T13:17:21.064912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:21.064834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:21.064834+0000","last_clean_scrub_stamp":"2024-04-25T13:17:21.064834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:38.103238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:28.289212+0000","last_change":"2024-04-25T13:17:28.289254+0000","last_active":"2024-04-25T13:17:28.289212+0000","last_peered":"2024-04-25T13:17:28.289212+0000","last_clean":"2024-04-25T13:17:28.289212+0000","last_became_active":"2024-04-25T13:16:08.006866+0000","last_became_peered":"2024-04-25T13:16:08.006866+0000","last_unstale":"2024-04-25T13:17:28.289212+0000","last_undegraded":"2024-04-25T13:17:28.289212+0000","last_fullsized":"2024-04-25T13:17:28.289212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:28.289113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:28.289113+0000","last_clean_scrub_stamp":"2024-04-25T13:17:28.289113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:25.533017+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:22.425541+0000","last_change":"2024-04-25T13:17:22.425562+0000","last_active":"2024-04-25T13:17:22.425541+0000","last_peered":"2024-04-25T13:17:22.425541+0000","last_clean":"2024-04-25T13:17:22.425541+0000","last_became_active":"2024-04-25T13:16:07.999033+0000","last_became_peered":"2024-04-25T13:16:07.999033+0000","last_unstale":"2024-04-25T13:17:22.425541+0000","last_undegraded":"2024-04-25T13:17:22.425541+0000","last_fullsized":"2024-04-25T13:17:22.425541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:22.425457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:22.425457+0000","last_clean_scrub_stamp":"2024-04-25T13:17:22.425457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:26.351777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:20.941532+0000","last_change":"2024-04-25T13:17:20.941551+0000","last_active":"2024-04-25T13:17:20.941532+0000","last_peered":"2024-04-25T13:17:20.941532+0000","last_clean":"2024-04-25T13:17:20.941532+0000","last_became_active":"2024-04-25T13:16:08.016068+0000","last_became_peered":"2024-04-25T13:16:08.016068+0000","last_unstale":"2024-04-25T13:17:20.941532+0000","last_undegraded":"2024-04-25T13:17:20.941532+0000","last_fullsized":"2024-04-25T13:17:20.941532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:20.941452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:20.941452+0000","last_clean_scrub_stamp":"2024-04-25T13:17:20.941452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:50.538881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:25.553155+0000","last_change":"2024-04-25T13:17:25.553179+0000","last_active":"2024-04-25T13:17:25.553155+0000","last_peered":"2024-04-25T13:17:25.553155+0000","last_clean":"2024-04-25T13:17:25.553155+0000","last_became_active":"2024-04-25T13:16:08.004655+0000","last_became_peered":"2024-04-25T13:16:08.004655+0000","last_unstale":"2024-04-25T13:17:25.553155+0000","last_undegraded":"2024-04-25T13:17:25.553155+0000","last_fullsized":"2024-04-25T13:17:25.553155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:25.553071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:25.553071+0000","last_clean_scrub_stamp":"2024-04-25T13:17:25.553071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:06.122559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.184852+0000","last_change":"2024-04-25T13:17:31.184880+0000","last_active":"2024-04-25T13:17:31.184852+0000","last_peered":"2024-04-25T13:17:31.184852+0000","last_clean":"2024-04-25T13:17:31.184852+0000","last_became_active":"2024-04-25T13:16:08.011047+0000","last_became_peered":"2024-04-25T13:16:08.011047+0000","last_unstale":"2024-04-25T13:17:31.184852+0000","last_undegraded":"2024-04-25T13:17:31.184852+0000","last_fullsized":"2024-04-25T13:17:31.184852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.184751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.184751+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.184751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:13.841074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.171907+0000","last_change":"2024-04-25T13:17:32.171950+0000","last_active":"2024-04-25T13:17:32.171907+0000","last_peered":"2024-04-25T13:17:32.171907+0000","last_clean":"2024-04-25T13:17:32.171907+0000","last_became_active":"2024-04-25T13:16:08.011916+0000","last_became_peered":"2024-04-25T13:16:08.011916+0000","last_unstale":"2024-04-25T13:17:32.171907+0000","last_undegraded":"2024-04-25T13:17:32.171907+0000","last_fullsized":"2024-04-25T13:17:32.171907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.171807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.171807+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.171807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:24.167938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.335761+0000","last_change":"2024-04-25T13:17:38.335808+0000","last_active":"2024-04-25T13:17:38.335761+0000","last_peered":"2024-04-25T13:17:38.335761+0000","last_clean":"2024-04-25T13:17:38.335761+0000","last_became_active":"2024-04-25T13:16:08.011893+0000","last_became_peered":"2024-04-25T13:16:08.011893+0000","last_unstale":"2024-04-25T13:17:38.335761+0000","last_undegraded":"2024-04-25T13:17:38.335761+0000","last_fullsized":"2024-04-25T13:17:38.335761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.335656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.335656+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.335656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:27.573724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.900941+0000","last_change":"2024-04-25T13:17:19.900960+0000","last_active":"2024-04-25T13:17:19.900941+0000","last_peered":"2024-04-25T13:17:19.900941+0000","last_clean":"2024-04-25T13:17:19.900941+0000","last_became_active":"2024-04-25T13:16:08.015405+0000","last_became_peered":"2024-04-25T13:16:08.015405+0000","last_unstale":"2024-04-25T13:17:19.900941+0000","last_undegraded":"2024-04-25T13:17:19.900941+0000","last_fullsized":"2024-04-25T13:17:19.900941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:19.900871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:19.900871+0000","last_clean_scrub_stamp":"2024-04-25T13:17:19.900871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:49.982701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.308910+0000","last_change":"2024-04-25T13:17:31.308930+0000","last_active":"2024-04-25T13:17:31.308910+0000","last_peered":"2024-04-25T13:17:31.308910+0000","last_clean":"2024-04-25T13:17:31.308910+0000","last_became_active":"2024-04-25T13:16:08.000193+0000","last_became_peered":"2024-04-25T13:16:08.000193+0000","last_unstale":"2024-04-25T13:17:31.308910+0000","last_undegraded":"2024-04-25T13:17:31.308910+0000","last_fullsized":"2024-04-25T13:17:31.308910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.308791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.308791+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.308791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:10.935456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.045209+0000","last_change":"2024-04-25T13:17:32.045247+0000","last_active":"2024-04-25T13:17:32.045209+0000","last_peered":"2024-04-25T13:17:32.045209+0000","last_clean":"2024-04-25T13:17:32.045209+0000","last_became_active":"2024-04-25T13:16:08.014300+0000","last_became_peered":"2024-04-25T13:16:08.014300+0000","last_unstale":"2024-04-25T13:17:32.045209+0000","last_undegraded":"2024-04-25T13:17:32.045209+0000","last_fullsized":"2024-04-25T13:17:32.045209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.045105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.045105+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.045105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:22.912515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:32.299824+0000","last_change":"2024-04-25T13:17:32.299848+0000","last_active":"2024-04-25T13:17:32.299824+0000","last_peered":"2024-04-25T13:17:32.299824+0000","last_clean":"2024-04-25T13:17:32.299824+0000","last_became_active":"2024-04-25T13:16:08.004673+0000","last_became_peered":"2024-04-25T13:16:08.004673+0000","last_unstale":"2024-04-25T13:17:32.299824+0000","last_undegraded":"2024-04-25T13:17:32.299824+0000","last_fullsized":"2024-04-25T13:17:32.299824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:32.299686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:32.299686+0000","last_clean_scrub_stamp":"2024-04-25T13:17:32.299686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:37.562504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:31.025020+0000","last_change":"2024-04-25T13:17:31.025068+0000","last_active":"2024-04-25T13:17:31.025020+0000","last_peered":"2024-04-25T13:17:31.025020+0000","last_clean":"2024-04-25T13:17:31.025020+0000","last_became_active":"2024-04-25T13:16:08.014719+0000","last_became_peered":"2024-04-25T13:16:08.014719+0000","last_unstale":"2024-04-25T13:17:31.025020+0000","last_undegraded":"2024-04-25T13:17:31.025020+0000","last_fullsized":"2024-04-25T13:17:31.025020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:31.024919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:31.024919+0000","last_clean_scrub_stamp":"2024-04-25T13:17:31.024919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:59.040925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:20.375729+0000","last_change":"2024-04-25T13:17:20.375753+0000","last_active":"2024-04-25T13:17:20.375729+0000","last_peered":"2024-04-25T13:17:20.375729+0000","last_clean":"2024-04-25T13:17:20.375729+0000","last_became_active":"2024-04-25T13:16:07.996792+0000","last_became_peered":"2024-04-25T13:16:07.996792+0000","last_unstale":"2024-04-25T13:17:20.375729+0000","last_undegraded":"2024-04-25T13:17:20.375729+0000","last_fullsized":"2024-04-25T13:17:20.375729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:20.375658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:20.375658+0000","last_clean_scrub_stamp":"2024-04-25T13:17:20.375658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:23.334624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:27.305551+0000","last_change":"2024-04-25T13:17:27.305595+0000","last_active":"2024-04-25T13:17:27.305551+0000","last_peered":"2024-04-25T13:17:27.305551+0000","last_clean":"2024-04-25T13:17:27.305551+0000","last_became_active":"2024-04-25T13:16:08.001182+0000","last_became_peered":"2024-04-25T13:16:08.001182+0000","last_unstale":"2024-04-25T13:17:27.305551+0000","last_undegraded":"2024-04-25T13:17:27.305551+0000","last_fullsized":"2024-04-25T13:17:27.305551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:27.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:27.305449+0000","last_clean_scrub_stamp":"2024-04-25T13:17:27.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:46.735547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.274246+0000","last_change":"2024-04-25T13:17:33.274287+0000","last_active":"2024-04-25T13:17:33.274246+0000","last_peered":"2024-04-25T13:17:33.274246+0000","last_clean":"2024-04-25T13:17:33.274246+0000","last_became_active":"2024-04-25T13:16:08.005976+0000","last_became_peered":"2024-04-25T13:16:08.005976+0000","last_unstale":"2024-04-25T13:17:33.274246+0000","last_undegraded":"2024-04-25T13:17:33.274246+0000","last_fullsized":"2024-04-25T13:17:33.274246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.274153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.274153+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.274153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:48.395775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":264,"ondisk_log_size":264,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":714627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":127373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":126091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":123489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":127407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":123621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":123109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":913408,"data_stored":712819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:18:02.573 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T13:18:02.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.707+0000 7f3a6479b640 1 Processor -- start 2024-04-25T13:18:02.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.707+0000 7f3a6479b640 1 -- start start 2024-04-25T13:18:02.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.708+0000 7f3a6479b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a5c0cb980 0x7f3a5c15e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:02.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.708+0000 7f3a6479b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c155470 0x7f3a5c15ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:02.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.708+0000 7f3a6479b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a5c15b060 con 0x7f3a5c0cb5a0 2024-04-25T13:18:02.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.708+0000 7f3a6479b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3a5c15bee0 con 0x7f3a5c0cb980 2024-04-25T13:18:02.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.708+0000 7f3a6479b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5c15b2d0 con 0x7f3a5c155470 2024-04-25T13:18:02.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.708+0000 7f3a61d36640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a5c0cb980 0x7f3a5c15e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:02.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.708+0000 7f3a61d36640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a5c0cb980 0x7f3a5c15e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46716/0 (socket says 172.21.15.52:46716) 2024-04-25T13:18:02.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.708+0000 7f3a61d36640 1 -- 172.21.15.52:0/1142329663 learned_addr learned my addr 172.21.15.52:0/1142329663 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:02.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.708+0000 7f3a62537640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3a5c0cb5a0 0x7f3a5c154d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48312/0 (socket says 172.21.15.52:48312) 2024-04-25T13:18:02.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.709+0000 7f3a62d38640 1 --2- 172.21.15.52:0/1142329663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c155470 0x7f3a5c15ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:02.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.709+0000 7f3a61d36640 1 -- 172.21.15.52:0/1142329663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c155470 msgr2=0x7f3a5c15ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:02.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.709+0000 7f3a61d36640 1 --2- 172.21.15.52:0/1142329663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c155470 0x7f3a5c15ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.709+0000 7f3a61d36640 1 -- 172.21.15.52:0/1142329663 >> v1:172.21.15.52:6789/0 conn(0x7f3a5c0cb5a0 legacy=0x7f3a5c154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.709+0000 7f3a61d36640 1 -- 172.21.15.52:0/1142329663 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c15b5b0 con 0x7f3a5c0cb980 2024-04-25T13:18:02.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.709+0000 7f3a61535640 1 -- 172.21.15.52:0/1142329663 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685230725 0 0) 0x7f3a5c15b060 con 0x7f3a5c0cb5a0 2024-04-25T13:18:02.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.709+0000 7f3a61d36640 1 --2- 172.21.15.52:0/1142329663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cb980 0x7f3a5c15e850 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009870 tx=0x7f3a5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75958db684c11b1c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:02.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.710+0000 7f3a61535640 1 -- 172.21.15.52:0/1142329663 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58037070 con 0x7f3a5c0cb980 2024-04-25T13:18:02.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.710+0000 7f3a61535640 1 -- 172.21.15.52:0/1142329663 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a58032440 con 0x7f3a5c0cb980 2024-04-25T13:18:02.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.710+0000 7f3a61535640 1 -- 172.21.15.52:0/1142329663 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58032810 con 0x7f3a5c0cb980 2024-04-25T13:18:02.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.710+0000 7f3a6479b640 1 -- 172.21.15.52:0/1142329663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cb980 msgr2=0x7f3a5c15e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.710+0000 7f3a6479b640 1 --2- 172.21.15.52:0/1142329663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cb980 0x7f3a5c15e850 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009870 tx=0x7f3a5802a270 comp rx=0 tx=0).stop 2024-04-25T13:18:02.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.710+0000 7f3a6479b640 1 -- 172.21.15.52:0/1142329663 shutdown_connections 2024-04-25T13:18:02.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.710+0000 7f3a6479b640 1 --2- 172.21.15.52:0/1142329663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cb980 0x7f3a5c15e850 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.710+0000 7f3a6479b640 1 --2- 172.21.15.52:0/1142329663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c155470 0x7f3a5c15ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.710+0000 7f3a6479b640 1 -- 172.21.15.52:0/1142329663 >> 172.21.15.52:0/1142329663 conn(0x7f3a5c074f30 msgr2=0x7f3a5c075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:02.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.710+0000 7f3a6479b640 1 -- 172.21.15.52:0/1142329663 shutdown_connections 2024-04-25T13:18:02.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.710+0000 7f3a6479b640 1 -- 172.21.15.52:0/1142329663 wait complete. 2024-04-25T13:18:02.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.711+0000 7f3a6479b640 1 Processor -- start 2024-04-25T13:18:02.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.711+0000 7f3a6479b640 1 -- start start 2024-04-25T13:18:02.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a6479b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a5c0cb5a0 0x7f3a5c1f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:02.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a6479b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cb980 0x7f3a5c1e7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:02.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a6479b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c155470 0x7f3a5c15c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:02.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a6479b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c071ab0 con 0x7f3a5c0cb980 2024-04-25T13:18:02.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a6479b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c15bb70 con 0x7f3a5c0cb5a0 2024-04-25T13:18:02.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a6479b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5c071c30 con 0x7f3a5c155470 2024-04-25T13:18:02.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a61d36640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cb980 0x7f3a5c1e7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:02.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a61d36640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cb980 0x7f3a5c1e7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46728/0 (socket says 172.21.15.52:46728) 2024-04-25T13:18:02.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a61d36640 1 -- 172.21.15.52:0/3334715878 learned_addr learned my addr 172.21.15.52:0/3334715878 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:02.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a62537640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a5c0cb5a0 0x7f3a5c1f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:02.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a61d36640 1 -- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c155470 msgr2=0x7f3a5c15c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a62d38640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c155470 0x7f3a5c15c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:02.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a61d36640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c155470 0x7f3a5c15c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a61d36640 1 -- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a5c0cb5a0 msgr2=0x7f3a5c1f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a61d36640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a5c0cb5a0 0x7f3a5c1f4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a61d36640 1 -- 172.21.15.52:0/3334715878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c1e7020 con 0x7f3a5c0cb980 2024-04-25T13:18:02.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.712+0000 7f3a62537640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a5c0cb5a0 0x7f3a5c1f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:18:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.713+0000 7f3a61d36640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cb980 0x7f3a5c1e7620 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3a58000c00 tx=0x7f3a580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.713+0000 7f3a52ffd640 1 -- 172.21.15.52:0/3334715878 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58037040 con 0x7f3a5c0cb980 2024-04-25T13:18:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.713+0000 7f3a52ffd640 1 -- 172.21.15.52:0/3334715878 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a58042070 con 0x7f3a5c0cb980 2024-04-25T13:18:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.713+0000 7f3a6479b640 1 -- 172.21.15.52:0/3334715878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5c150f40 con 0x7f3a5c0cb980 2024-04-25T13:18:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.713+0000 7f3a52ffd640 1 -- 172.21.15.52:0/3334715878 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58030bd0 con 0x7f3a5c0cb980 2024-04-25T13:18:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.713+0000 7f3a6479b640 1 -- 172.21.15.52:0/3334715878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5c1f0ef0 con 0x7f3a5c0cb980 2024-04-25T13:18:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.714+0000 7f3a6479b640 1 -- 172.21.15.52:0/3334715878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5c068f50 con 0x7f3a5c0cb980 2024-04-25T13:18:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.714+0000 7f3a52ffd640 1 -- 172.21.15.52:0/3334715878 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a58047460 con 0x7f3a5c0cb980 2024-04-25T13:18:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.715+0000 7f3a52ffd640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3a4006c8f0 0x7f3a4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:02.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.715+0000 7f3a52ffd640 1 -- 172.21.15.52:0/3334715878 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f3a580acc30 con 0x7f3a5c0cb980 2024-04-25T13:18:02.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.715+0000 7f3a62537640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3a4006c8f0 0x7f3a4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:02.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.715+0000 7f3a62537640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3a4006c8f0 0x7f3a4006edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c000f60 tx=0x7f3a4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:02.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.719+0000 7f3a52ffd640 1 -- 172.21.15.52:0/3334715878 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a5807abb0 con 0x7f3a5c0cb980 2024-04-25T13:18:02.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.906+0000 7f3a6479b640 1 -- 172.21.15.52:0/3334715878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3a5c06c480 con 0x7f3a5c0cb980 2024-04-25T13:18:02.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.909+0000 7f3a52ffd640 1 -- 172.21.15.52:0/3334715878 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f3a5807a4b0 con 0x7f3a5c0cb980 2024-04-25T13:18:02.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.911+0000 7f3a52ffd640 1 -- 172.21.15.52:0/3334715878 <== mon.0 v2:172.21.15.52:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3a5807e860 con 0x7f3a5c0cb980 2024-04-25T13:18:02.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.912+0000 7f3a6479b640 1 -- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3a4006c8f0 msgr2=0x7f3a4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.912+0000 7f3a6479b640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3a4006c8f0 0x7f3a4006edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c000f60 tx=0x7f3a4c009040 comp rx=0 tx=0).stop 2024-04-25T13:18:02.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.912+0000 7f3a6479b640 1 -- 172.21.15.52:0/3334715878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cb980 msgr2=0x7f3a5c1e7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.912+0000 7f3a6479b640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cb980 0x7f3a5c1e7620 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3a58000c00 tx=0x7f3a580046c0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.912+0000 7f3a6479b640 1 -- 172.21.15.52:0/3334715878 shutdown_connections 2024-04-25T13:18:02.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.912+0000 7f3a6479b640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f3a4006c8f0 0x7f3a4006edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.912+0000 7f3a6479b640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a5c155470 0x7f3a5c15c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.912+0000 7f3a6479b640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a5c0cb980 0x7f3a5c1e7620 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.912+0000 7f3a6479b640 1 --2- 172.21.15.52:0/3334715878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a5c0cb5a0 0x7f3a5c1f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.912+0000 7f3a6479b640 1 -- 172.21.15.52:0/3334715878 >> 172.21.15.52:0/3334715878 conn(0x7f3a5c074f30 msgr2=0x7f3a5c151c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:02.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.912+0000 7f3a6479b640 1 -- 172.21.15.52:0/3334715878 shutdown_connections 2024-04-25T13:18:02.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:02.912+0000 7f3a6479b640 1 -- 172.21.15.52:0/3334715878 wait complete. 2024-04-25T13:18:02.923 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T13:18:02.923 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:18:03.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.023+0000 7efc1fa31640 1 Processor -- start 2024-04-25T13:18:03.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.023+0000 7efc1fa31640 1 -- start start 2024-04-25T13:18:03.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.024+0000 7efc1fa31640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc180b3c00 0x7efc180b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.024+0000 7efc1fa31640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc181558c0 con 0x7efc180b5450 2024-04-25T13:18:03.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.024+0000 7efc1fa31640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc180cb8c0 con 0x7efc181554e0 2024-04-25T13:18:03.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.024+0000 7efc1fa31640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7efc180b4a80 con 0x7efc180b3c00 2024-04-25T13:18:03.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.024+0000 7efc1cfcc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc180b3c00 0x7efc180b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.024+0000 7efc1dfce640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efc180b5450 0x7efc180d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48316/0 (socket says 172.21.15.52:48316) 2024-04-25T13:18:03.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.024+0000 7efc1dfce640 1 -- 172.21.15.52:0/300800940 learned_addr learned my addr 172.21.15.52:0/300800940 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:18:03.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.025+0000 7efc1cfcc640 1 -- 172.21.15.52:0/300800940 >> v1:172.21.15.102:6789/0 conn(0x7efc181554e0 legacy=0x7efc1815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.025+0000 7efc1cfcc640 1 -- 172.21.15.52:0/300800940 >> v1:172.21.15.52:6789/0 conn(0x7efc180b5450 legacy=0x7efc180d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.025+0000 7efc17fff640 1 -- 172.21.15.52:0/300800940 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397696076 0 0) 0x7efc08001490 con 0x7efc180b5450 2024-04-25T13:18:03.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.025+0000 7efc1cfcc640 1 -- 172.21.15.52:0/300800940 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc180cbba0 con 0x7efc180b3c00 2024-04-25T13:18:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.025+0000 7efc1cfcc640 1 --2- 172.21.15.52:0/300800940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc180b3c00 0x7efc180b4f10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0097a0 tx=0x7efc0c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e789a0e65b34ac8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.025+0000 7efc17fff640 1 -- 172.21.15.52:0/300800940 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c037070 con 0x7efc180b3c00 2024-04-25T13:18:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.025+0000 7efc17fff640 1 -- 172.21.15.52:0/300800940 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efc0c032640 con 0x7efc180b3c00 2024-04-25T13:18:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.026+0000 7efc17fff640 1 -- 172.21.15.52:0/300800940 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c032a30 con 0x7efc180b3c00 2024-04-25T13:18:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.026+0000 7efc1fa31640 1 -- 172.21.15.52:0/300800940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc180b3c00 msgr2=0x7efc180b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.026+0000 7efc1fa31640 1 --2- 172.21.15.52:0/300800940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc180b3c00 0x7efc180b4f10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0097a0 tx=0x7efc0c02a2c0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.026+0000 7efc1fa31640 1 -- 172.21.15.52:0/300800940 shutdown_connections 2024-04-25T13:18:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.026+0000 7efc1fa31640 1 --2- 172.21.15.52:0/300800940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc180b3c00 0x7efc180b4f10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.026+0000 7efc1fa31640 1 -- 172.21.15.52:0/300800940 >> 172.21.15.52:0/300800940 conn(0x7efc18074d50 msgr2=0x7efc18075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.026+0000 7efc1fa31640 1 -- 172.21.15.52:0/300800940 shutdown_connections 2024-04-25T13:18:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.026+0000 7efc1fa31640 1 -- 172.21.15.52:0/300800940 wait complete. 2024-04-25T13:18:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.027+0000 7efc1fa31640 1 Processor -- start 2024-04-25T13:18:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.027+0000 7efc1fa31640 1 -- start start 2024-04-25T13:18:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1fa31640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efc180b3c00 0x7efc181566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1fa31640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc180b5450 0x7efc18150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1fa31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc181554e0 0x7efc1814e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1fa31640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efc180b4710 con 0x7efc180b5450 2024-04-25T13:18:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1fa31640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efc180b4430 con 0x7efc181554e0 2024-04-25T13:18:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1fa31640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efc180b3580 con 0x7efc180b3c00 2024-04-25T13:18:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1cfcc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc180b5450 0x7efc18150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1cfcc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc180b5450 0x7efc18150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46736/0 (socket says 172.21.15.52:46736) 2024-04-25T13:18:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1cfcc640 1 -- 172.21.15.52:0/42688825 learned_addr learned my addr 172.21.15.52:0/42688825 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1dfce640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc181554e0 0x7efc1814e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1d7cd640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efc180b3c00 0x7efc181566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1cfcc640 1 -- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efc180b3c00 msgr2=0x7efc181566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1cfcc640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efc180b3c00 0x7efc181566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1cfcc640 1 -- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc181554e0 msgr2=0x7efc1814e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1cfcc640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc181554e0 0x7efc1814e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1cfcc640 1 -- 172.21.15.52:0/42688825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc181f1a20 con 0x7efc180b5450 2024-04-25T13:18:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.028+0000 7efc1d7cd640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efc180b3c00 0x7efc181566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:18:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.029+0000 7efc1cfcc640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc180b5450 0x7efc18150e00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efc0c035040 tx=0x7efc0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.029+0000 7efc15ffb640 1 -- 172.21.15.52:0/42688825 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c044070 con 0x7efc180b5450 2024-04-25T13:18:03.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.029+0000 7efc15ffb640 1 -- 172.21.15.52:0/42688825 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efc0c038040 con 0x7efc180b5450 2024-04-25T13:18:03.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.029+0000 7efc15ffb640 1 -- 172.21.15.52:0/42688825 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c037050 con 0x7efc180b5450 2024-04-25T13:18:03.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.029+0000 7efc1fa31640 1 -- 172.21.15.52:0/42688825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1815a160 con 0x7efc180b5450 2024-04-25T13:18:03.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.029+0000 7efc1fa31640 1 -- 172.21.15.52:0/42688825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc1815a720 con 0x7efc180b5450 2024-04-25T13:18:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.030+0000 7efc1fa31640 1 -- 172.21.15.52:0/42688825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc18068e40 con 0x7efc180b5450 2024-04-25T13:18:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.030+0000 7efc15ffb640 1 -- 172.21.15.52:0/42688825 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc0c047070 con 0x7efc180b5450 2024-04-25T13:18:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.031+0000 7efc15ffb640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efc0406c8f0 0x7efc0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.031+0000 7efc15ffb640 1 -- 172.21.15.52:0/42688825 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7efc0c0ac560 con 0x7efc180b5450 2024-04-25T13:18:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.031+0000 7efc1d7cd640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efc0406c8f0 0x7efc0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.032+0000 7efc1d7cd640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efc0406c8f0 0x7efc0406edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc10000f60 tx=0x7efc10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:03.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.035+0000 7efc15ffb640 1 -- 172.21.15.52:0/42688825 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efc0c07a440 con 0x7efc180b5450 2024-04-25T13:18:03.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.260+0000 7efc1fa31640 1 -- 172.21.15.52:0/42688825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc180cd3e0 con 0x7efc180b5450 2024-04-25T13:18:03.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.261+0000 7efc15ffb640 1 -- 172.21.15.52:0/42688825 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6914 (secure 0 0 0) 0x7efc0c079d40 con 0x7efc180b5450 2024-04-25T13:18:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:18:03.261 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2650846419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2650846419},{"type":"v1","addr":"172.21.15.102:6837","nonce":2650846419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:07.352382+0000","modified":"2024-04-25T13:16:57.155694+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4290,"mds_1":4284,"mds_2":4273,"mds_3":4265,"mds_4":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":15,"addr":"172.21.15.102:6838/1508646651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":1508646651},{"type":"v1","addr":"172.21.15.102:6838","nonce":1508646651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4265":{"gid":4265,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":14,"addr":"172.21.15.102:6839/1980846137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1980846137},{"type":"v1","addr":"172.21.15.102:6839","nonce":1980846137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4273":{"gid":4273,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.52:6835/714334205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":714334205},{"type":"v1","addr":"172.21.15.52:6835","nonce":714334205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6834/3228537118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3228537118},{"type":"v1","addr":"172.21.15.52:6834","nonce":3228537118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4290":{"gid":4290,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6837/413759311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":413759311},{"type":"v1","addr":"172.21.15.52:6837","nonce":413759311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4262,4265,4273,4284,4290]},"id":1}]} 2024-04-25T13:18:03.262 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 18 2024-04-25T13:18:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.262+0000 7efc1fa31640 1 -- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efc0406c8f0 msgr2=0x7efc0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.262+0000 7efc1fa31640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efc0406c8f0 0x7efc0406edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc10000f60 tx=0x7efc10009040 comp rx=0 tx=0).stop 2024-04-25T13:18:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.262+0000 7efc1fa31640 1 -- 172.21.15.52:0/42688825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc180b5450 msgr2=0x7efc18150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.262+0000 7efc1fa31640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc180b5450 0x7efc18150e00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efc0c035040 tx=0x7efc0c0046c0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.262+0000 7efc1fa31640 1 -- 172.21.15.52:0/42688825 shutdown_connections 2024-04-25T13:18:03.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.262+0000 7efc1fa31640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7efc0406c8f0 0x7efc0406edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.262+0000 7efc1fa31640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc181554e0 0x7efc1814e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.262+0000 7efc1fa31640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc180b5450 0x7efc18150e00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.262+0000 7efc1fa31640 1 --2- 172.21.15.52:0/42688825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efc180b3c00 0x7efc181566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.262+0000 7efc1fa31640 1 -- 172.21.15.52:0/42688825 >> 172.21.15.52:0/42688825 conn(0x7efc18074d50 msgr2=0x7efc180cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:03.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.263+0000 7efc1fa31640 1 -- 172.21.15.52:0/42688825 shutdown_connections 2024-04-25T13:18:03.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.263+0000 7efc1fa31640 1 -- 172.21.15.52:0/42688825 wait complete. 2024-04-25T13:18:03.274 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:18:03.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.374+0000 7f4c57b9b640 1 Processor -- start 2024-04-25T13:18:03.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.374+0000 7f4c57b9b640 1 -- start start 2024-04-25T13:18:03.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c57b9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4c501554e0 0x7f4c5015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c57b9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c500d08a0 0x7f4c500d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c57b9b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c501558c0 con 0x7f4c500b3c00 2024-04-25T13:18:03.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c57b9b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4c500b4a80 con 0x7f4c500d08a0 2024-04-25T13:18:03.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c57b9b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4c5015f630 con 0x7f4c501554e0 2024-04-25T13:18:03.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c56138640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c500d08a0 0x7f4c500d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c56138640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c500d08a0 0x7f4c500d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46748/0 (socket says 172.21.15.52:46748) 2024-04-25T13:18:03.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c56138640 1 -- 172.21.15.52:0/1807015224 learned_addr learned my addr 172.21.15.52:0/1807015224 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:03.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c55937640 1 --2- 172.21.15.52:0/1807015224 >> v2:172.21.15.102:3300/0 conn(0x7f4c501554e0 0x7f4c5015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c56138640 1 -- 172.21.15.52:0/1807015224 >> v2:172.21.15.102:3300/0 conn(0x7f4c501554e0 msgr2=0x7f4c5015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:03.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c56138640 1 --2- 172.21.15.52:0/1807015224 >> v2:172.21.15.102:3300/0 conn(0x7f4c501554e0 0x7f4c5015f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c56138640 1 -- 172.21.15.52:0/1807015224 >> v1:172.21.15.102:6789/0 conn(0x7f4c500b3c00 legacy=0x7f4c500b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.375+0000 7f4c56138640 1 -- 172.21.15.52:0/1807015224 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c500cb8c0 con 0x7f4c500d08a0 2024-04-25T13:18:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.376+0000 7f4c56138640 1 --2- 172.21.15.52:0/1807015224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c500d08a0 0x7f4c500d0cb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4c5008e520 tx=0x7f4c4002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe210f35e0944fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.376+0000 7f4c54935640 1 -- 172.21.15.52:0/1807015224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40036070 con 0x7f4c500d08a0 2024-04-25T13:18:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.376+0000 7f4c54935640 1 -- 172.21.15.52:0/1807015224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4c40031600 con 0x7f4c500d08a0 2024-04-25T13:18:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.376+0000 7f4c54935640 1 -- 172.21.15.52:0/1807015224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40031a10 con 0x7f4c500d08a0 2024-04-25T13:18:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.377+0000 7f4c57b9b640 1 -- 172.21.15.52:0/1807015224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c500d08a0 msgr2=0x7f4c500d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.377+0000 7f4c57b9b640 1 --2- 172.21.15.52:0/1807015224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c500d08a0 0x7f4c500d0cb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4c5008e520 tx=0x7f4c4002a7c0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.377+0000 7f4c57b9b640 1 -- 172.21.15.52:0/1807015224 shutdown_connections 2024-04-25T13:18:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.377+0000 7f4c57b9b640 1 --2- 172.21.15.52:0/1807015224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c500d08a0 0x7f4c500d0cb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.377+0000 7f4c57b9b640 1 --2- 172.21.15.52:0/1807015224 >> v2:172.21.15.102:3300/0 conn(0x7f4c501554e0 0x7f4c5015f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.377+0000 7f4c57b9b640 1 -- 172.21.15.52:0/1807015224 >> 172.21.15.52:0/1807015224 conn(0x7f4c50074d50 msgr2=0x7f4c50075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.377+0000 7f4c57b9b640 1 -- 172.21.15.52:0/1807015224 shutdown_connections 2024-04-25T13:18:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.377+0000 7f4c57b9b640 1 -- 172.21.15.52:0/1807015224 wait complete. 2024-04-25T13:18:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.378+0000 7f4c57b9b640 1 Processor -- start 2024-04-25T13:18:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.378+0000 7f4c57b9b640 1 -- start start 2024-04-25T13:18:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c57b9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c500b3c00 0x7f4c500c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c57b9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c500d08a0 0x7f4c500c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c57b9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c501554e0 0x7f4c501f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c57b9b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4c500b4430 con 0x7f4c500d08a0 2024-04-25T13:18:03.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c57b9b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4c500b4150 con 0x7f4c501554e0 2024-04-25T13:18:03.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c57b9b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4c500b4710 con 0x7f4c500b3c00 2024-04-25T13:18:03.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c55136640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c500d08a0 0x7f4c500c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c55136640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c500d08a0 0x7f4c500c64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46750/0 (socket says 172.21.15.52:46750) 2024-04-25T13:18:03.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c55136640 1 -- 172.21.15.52:0/4216317066 learned_addr learned my addr 172.21.15.52:0/4216317066 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:03.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c55937640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c500b3c00 0x7f4c500c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c56138640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c501554e0 0x7f4c501f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c55136640 1 -- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c500b3c00 msgr2=0x7f4c500c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c55136640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c500b3c00 0x7f4c500c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c55136640 1 -- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c501554e0 msgr2=0x7f4c501f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c55136640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c501554e0 0x7f4c501f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c55136640 1 -- 172.21.15.52:0/4216317066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c500c9300 con 0x7f4c500d08a0 2024-04-25T13:18:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c55136640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c500d08a0 0x7f4c500c64d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400c430 tx=0x7f4c4400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.379+0000 7f4c4e7fc640 1 -- 172.21.15.52:0/4216317066 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44017070 con 0x7f4c500d08a0 2024-04-25T13:18:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.380+0000 7f4c4e7fc640 1 -- 172.21.15.52:0/4216317066 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4c440052d0 con 0x7f4c500d08a0 2024-04-25T13:18:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.380+0000 7f4c57b9b640 1 -- 172.21.15.52:0/4216317066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c500c95e0 con 0x7f4c500d08a0 2024-04-25T13:18:03.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.380+0000 7f4c4e7fc640 1 -- 172.21.15.52:0/4216317066 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44003870 con 0x7f4c500d08a0 2024-04-25T13:18:03.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.380+0000 7f4c57b9b640 1 -- 172.21.15.52:0/4216317066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c500c9ba0 con 0x7f4c500d08a0 2024-04-25T13:18:03.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.381+0000 7f4c57b9b640 1 -- 172.21.15.52:0/4216317066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c50068e40 con 0x7f4c500d08a0 2024-04-25T13:18:03.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.381+0000 7f4c4e7fc640 1 -- 172.21.15.52:0/4216317066 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c4401a070 con 0x7f4c500d08a0 2024-04-25T13:18:03.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.381+0000 7f4c4e7fc640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4c3c06c8f0 0x7f4c3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.382+0000 7f4c4e7fc640 1 -- 172.21.15.52:0/4216317066 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f4c4408b330 con 0x7f4c500d08a0 2024-04-25T13:18:03.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.382+0000 7f4c55937640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4c3c06c8f0 0x7f4c3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.382+0000 7f4c55937640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4c3c06c8f0 0x7f4c3c06edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009aa0 tx=0x7f4c48009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:03.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.386+0000 7f4c4e7fc640 1 -- 172.21.15.52:0/4216317066 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4c501558c0 con 0x7f4c500d08a0 2024-04-25T13:18:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.609+0000 7f4c57b9b640 1 -- 172.21.15.52:0/4216317066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c500cdc90 con 0x7f4c500d08a0 2024-04-25T13:18:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.609+0000 7f4c4e7fc640 1 -- 172.21.15.52:0/4216317066 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6914 (secure 0 0 0) 0x7f4c44058c60 con 0x7f4c500d08a0 2024-04-25T13:18:03.610 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:18:03.610 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2650846419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2650846419},{"type":"v1","addr":"172.21.15.102:6837","nonce":2650846419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:07.352382+0000","modified":"2024-04-25T13:16:57.155694+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4290,"mds_1":4284,"mds_2":4273,"mds_3":4265,"mds_4":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":15,"addr":"172.21.15.102:6838/1508646651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":1508646651},{"type":"v1","addr":"172.21.15.102:6838","nonce":1508646651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4265":{"gid":4265,"name":"f","rank":3,"incarnation":15,"state":"up:active","state_seq":14,"addr":"172.21.15.102:6839/1980846137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1980846137},{"type":"v1","addr":"172.21.15.102:6839","nonce":1980846137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4273":{"gid":4273,"name":"c","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.52:6835/714334205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":714334205},{"type":"v1","addr":"172.21.15.52:6835","nonce":714334205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6834/3228537118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3228537118},{"type":"v1","addr":"172.21.15.52:6834","nonce":3228537118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4290":{"gid":4290,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6837/413759311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":413759311},{"type":"v1","addr":"172.21.15.52:6837","nonce":413759311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4262,4265,4273,4284,4290]},"id":1}]} 2024-04-25T13:18:03.610 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 18 2024-04-25T13:18:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.611+0000 7f4c57b9b640 1 -- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4c3c06c8f0 msgr2=0x7f4c3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.611+0000 7f4c57b9b640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4c3c06c8f0 0x7f4c3c06edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009aa0 tx=0x7f4c48009190 comp rx=0 tx=0).stop 2024-04-25T13:18:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.611+0000 7f4c57b9b640 1 -- 172.21.15.52:0/4216317066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c500d08a0 msgr2=0x7f4c500c64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.611+0000 7f4c57b9b640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c500d08a0 0x7f4c500c64d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400c430 tx=0x7f4c4400c8f0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.611+0000 7f4c57b9b640 1 -- 172.21.15.52:0/4216317066 shutdown_connections 2024-04-25T13:18:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.611+0000 7f4c57b9b640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f4c3c06c8f0 0x7f4c3c06edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.611+0000 7f4c57b9b640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c501554e0 0x7f4c501f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.611+0000 7f4c57b9b640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c500d08a0 0x7f4c500c64d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.611+0000 7f4c57b9b640 1 --2- 172.21.15.52:0/4216317066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c500b3c00 0x7f4c500c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.611+0000 7f4c57b9b640 1 -- 172.21.15.52:0/4216317066 >> 172.21.15.52:0/4216317066 conn(0x7f4c50074d50 msgr2=0x7f4c50153810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:03.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.611+0000 7f4c57b9b640 1 -- 172.21.15.52:0/4216317066 shutdown_connections 2024-04-25T13:18:03.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.611+0000 7f4c57b9b640 1 -- 172.21.15.52:0/4216317066 wait complete. 2024-04-25T13:18:03.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:18:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.723+0000 7f40c18a7640 1 Processor -- start 2024-04-25T13:18:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.723+0000 7f40c18a7640 1 -- start start 2024-04-25T13:18:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40c18a7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40bc0b3c00 0x7f40bc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40c18a7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40bc0b5450 0x7f40bc0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40c18a7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40bc1558c0 con 0x7f40bc1554e0 2024-04-25T13:18:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40c18a7640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f40bc0b4a80 con 0x7f40bc0b3c00 2024-04-25T13:18:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40c18a7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f40bc0cb8c0 con 0x7f40bc0b5450 2024-04-25T13:18:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40ba7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40bc0b3c00 0x7f40bc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40ba7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40bc0b3c00 0x7f40bc0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46754/0 (socket says 172.21.15.52:46754) 2024-04-25T13:18:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40ba7fc640 1 -- 172.21.15.52:0/2481423576 learned_addr learned my addr 172.21.15.52:0/2481423576 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40bb7fe640 1 --2- 172.21.15.52:0/2481423576 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40bc0b5450 0x7f40bc0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40ba7fc640 1 -- 172.21.15.52:0/2481423576 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40bc0b5450 msgr2=0x7f40bc0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:03.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40ba7fc640 1 --2- 172.21.15.52:0/2481423576 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40bc0b5450 0x7f40bc0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40ba7fc640 1 -- 172.21.15.52:0/2481423576 >> v1:172.21.15.102:6789/0 conn(0x7f40bc1554e0 legacy=0x7f40bc15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40b9ffb640 1 -- 172.21.15.52:0/2481423576 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054529574 0 0) 0x7f40b0001110 con 0x7f40bc1554e0 2024-04-25T13:18:03.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.724+0000 7f40ba7fc640 1 -- 172.21.15.52:0/2481423576 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc0cbba0 con 0x7f40bc0b3c00 2024-04-25T13:18:03.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.725+0000 7f40ba7fc640 1 --2- 172.21.15.52:0/2481423576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40bc0b3c00 0x7f40bc0b4f10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009870 tx=0x7f40ac02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71985da84dfa08f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:03.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.725+0000 7f40b9ffb640 1 -- 172.21.15.52:0/2481423576 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac037070 con 0x7f40bc0b3c00 2024-04-25T13:18:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.725+0000 7f40b9ffb640 1 -- 172.21.15.52:0/2481423576 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f40ac02ae50 con 0x7f40bc0b3c00 2024-04-25T13:18:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.725+0000 7f40b9ffb640 1 -- 172.21.15.52:0/2481423576 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac032880 con 0x7f40bc0b3c00 2024-04-25T13:18:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.726+0000 7f40c18a7640 1 -- 172.21.15.52:0/2481423576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40bc0b3c00 msgr2=0x7f40bc0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.726+0000 7f40c18a7640 1 --2- 172.21.15.52:0/2481423576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40bc0b3c00 0x7f40bc0b4f10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009870 tx=0x7f40ac02a300 comp rx=0 tx=0).stop 2024-04-25T13:18:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.726+0000 7f40c18a7640 1 -- 172.21.15.52:0/2481423576 shutdown_connections 2024-04-25T13:18:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.726+0000 7f40c18a7640 1 --2- 172.21.15.52:0/2481423576 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40bc0b5450 0x7f40bc0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.726+0000 7f40c18a7640 1 --2- 172.21.15.52:0/2481423576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40bc0b3c00 0x7f40bc0b4f10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.726+0000 7f40c18a7640 1 -- 172.21.15.52:0/2481423576 >> 172.21.15.52:0/2481423576 conn(0x7f40bc074d50 msgr2=0x7f40bc075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.726+0000 7f40c18a7640 1 -- 172.21.15.52:0/2481423576 shutdown_connections 2024-04-25T13:18:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.726+0000 7f40c18a7640 1 -- 172.21.15.52:0/2481423576 wait complete. 2024-04-25T13:18:03.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.727+0000 7f40c18a7640 1 Processor -- start 2024-04-25T13:18:03.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.727+0000 7f40c18a7640 1 -- start start 2024-04-25T13:18:03.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40c18a7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40bc0b3c00 0x7f40bc14ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40c18a7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40bc0b5450 0x7f40bc1f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40c18a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40bc1554e0 0x7f40bc0cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40c18a7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc0b4710 con 0x7f40bc0b5450 2024-04-25T13:18:03.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40c18a7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc0b4430 con 0x7f40bc1554e0 2024-04-25T13:18:03.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40c18a7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f40bc0b3580 con 0x7f40bc0b3c00 2024-04-25T13:18:03.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40ba7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40bc0b5450 0x7f40bc1f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40ba7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40bc0b5450 0x7f40bc1f22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46762/0 (socket says 172.21.15.52:46762) 2024-04-25T13:18:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40ba7fc640 1 -- 172.21.15.52:0/144648077 learned_addr learned my addr 172.21.15.52:0/144648077 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40bb7fe640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40bc1554e0 0x7f40bc0cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40baffd640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40bc0b3c00 0x7f40bc14ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40ba7fc640 1 -- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40bc0b3c00 msgr2=0x7f40bc14ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40ba7fc640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40bc0b3c00 0x7f40bc14ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40ba7fc640 1 -- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40bc1554e0 msgr2=0x7f40bc0cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40ba7fc640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40bc1554e0 0x7f40bc0cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40ba7fc640 1 -- 172.21.15.52:0/144648077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc1f4f50 con 0x7f40bc0b5450 2024-04-25T13:18:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40bb7fe640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40bc1554e0 0x7f40bc0cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:18:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40baffd640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40bc0b3c00 0x7f40bc14ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:18:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40ba7fc640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40bc0b5450 0x7f40bc1f22e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f40ac035040 tx=0x7f40ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.728+0000 7f40a3fff640 1 -- 172.21.15.52:0/144648077 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac037040 con 0x7f40bc0b5450 2024-04-25T13:18:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.729+0000 7f40a3fff640 1 -- 172.21.15.52:0/144648077 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f40ac004030 con 0x7f40bc0b5450 2024-04-25T13:18:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.729+0000 7f40a3fff640 1 -- 172.21.15.52:0/144648077 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac004440 con 0x7f40bc0b5450 2024-04-25T13:18:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.729+0000 7f40c18a7640 1 -- 172.21.15.52:0/144648077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40bc1f0f80 con 0x7f40bc0b5450 2024-04-25T13:18:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.729+0000 7f40c18a7640 1 -- 172.21.15.52:0/144648077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40bc1f1540 con 0x7f40bc0b5450 2024-04-25T13:18:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.730+0000 7f40c18a7640 1 -- 172.21.15.52:0/144648077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40bc068e40 con 0x7f40bc0b5450 2024-04-25T13:18:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.730+0000 7f40a3fff640 1 -- 172.21.15.52:0/144648077 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f40ac03a070 con 0x7f40bc0b5450 2024-04-25T13:18:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.730+0000 7f40a3fff640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f40a806c8f0 0x7f40a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.730+0000 7f40a3fff640 1 -- 172.21.15.52:0/144648077 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f40ac0ac6f0 con 0x7f40bc0b5450 2024-04-25T13:18:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.731+0000 7f40baffd640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f40a806c8f0 0x7f40a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.731+0000 7f40baffd640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f40a806c8f0 0x7f40a806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f40b0000f60 tx=0x7f40b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:03.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.735+0000 7f40a3fff640 1 -- 172.21.15.52:0/144648077 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f40ac041020 con 0x7f40bc0b5450 2024-04-25T13:18:03.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.922+0000 7f40c18a7640 1 -- 172.21.15.52:0/144648077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40bc073e70 con 0x7f40bc0b5450 2024-04-25T13:18:03.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.923+0000 7f40a3fff640 1 -- 172.21.15.52:0/144648077 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18927 (secure 0 0 0) 0x7f40ac07a670 con 0x7f40bc0b5450 2024-04-25T13:18:03.924 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T13:18:03.924 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"fsid":"223f60a6-8e09-4413-a2a5-fc4244f2a674","created":"2024-04-25T13:15:43.620124+0000","modified":"2024-04-25T13:16:49.125761+0000","last_up_change":"2024-04-25T13:15:54.258771+0000","last_in_change":"2024-04-25T13:15:45.827611+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:15:55.833544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:05.935596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:06.297991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:10.015464+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ca31ab05-06c2-4777-8bfe-f23439eb52fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6819","nonce":4019725320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6823","nonce":4019725320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6831","nonce":4019725320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6825","nonce":4019725320},{"type":"v1","addr":"172.21.15.52:6827","nonce":4019725320}]},"public_addr":"172.21.15.52:6819/4019725320","cluster_addr":"172.21.15.52:6823/4019725320","heartbeat_back_addr":"172.21.15.52:6831/4019725320","heartbeat_front_addr":"172.21.15.52:6827/4019725320","state":["exists","up"]},{"osd":1,"uuid":"d3fb4cbe-b222-4237-a827-2f02e823e380","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6801","nonce":760490446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6803","nonce":760490446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6807","nonce":760490446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":760490446},{"type":"v1","addr":"172.21.15.52:6805","nonce":760490446}]},"public_addr":"172.21.15.52:6801/760490446","cluster_addr":"172.21.15.52:6803/760490446","heartbeat_back_addr":"172.21.15.52:6807/760490446","heartbeat_front_addr":"172.21.15.52:6805/760490446","state":["exists","up"]},{"osd":2,"uuid":"d1382850-2960-4354-8d63-d50bfbc36b86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6809","nonce":3392002317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6811","nonce":3392002317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6815","nonce":3392002317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392002317},{"type":"v1","addr":"172.21.15.52:6813","nonce":3392002317}]},"public_addr":"172.21.15.52:6809/3392002317","cluster_addr":"172.21.15.52:6811/3392002317","heartbeat_back_addr":"172.21.15.52:6815/3392002317","heartbeat_front_addr":"172.21.15.52:6813/3392002317","state":["exists","up"]},{"osd":3,"uuid":"2c406eac-6c0c-4add-a5ca-f89d6ab21d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6818","nonce":3429485352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6822","nonce":3429485352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6829","nonce":3429485352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3429485352},{"type":"v1","addr":"172.21.15.52:6826","nonce":3429485352}]},"public_addr":"172.21.15.52:6818/3429485352","cluster_addr":"172.21.15.52:6822/3429485352","heartbeat_back_addr":"172.21.15.52:6829/3429485352","heartbeat_front_addr":"172.21.15.52:6826/3429485352","state":["exists","up"]},{"osd":4,"uuid":"7eac025d-b6de-4c2e-a98d-f134954db46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6809","nonce":3635677901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6811","nonce":3635677901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6815","nonce":3635677901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3635677901},{"type":"v1","addr":"172.21.15.102:6813","nonce":3635677901}]},"public_addr":"172.21.15.102:6809/3635677901","cluster_addr":"172.21.15.102:6811/3635677901","heartbeat_back_addr":"172.21.15.102:6815/3635677901","heartbeat_front_addr":"172.21.15.102:6813/3635677901","state":["exists","up"]},{"osd":5,"uuid":"f43af6a1-c5e6-4f01-9012-8ea601776eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6825","nonce":82766007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6827","nonce":82766007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6831","nonce":82766007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":82766007},{"type":"v1","addr":"172.21.15.102:6829","nonce":82766007}]},"public_addr":"172.21.15.102:6825/82766007","cluster_addr":"172.21.15.102:6827/82766007","heartbeat_back_addr":"172.21.15.102:6831/82766007","heartbeat_front_addr":"172.21.15.102:6829/82766007","state":["exists","up"]},{"osd":6,"uuid":"7aa8935f-7f89-4803-b248-8e7c2a314e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6801","nonce":1825391266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6803","nonce":1825391266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6807","nonce":1825391266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1825391266},{"type":"v1","addr":"172.21.15.102:6805","nonce":1825391266}]},"public_addr":"172.21.15.102:6801/1825391266","cluster_addr":"172.21.15.102:6803/1825391266","heartbeat_back_addr":"172.21.15.102:6807/1825391266","heartbeat_front_addr":"172.21.15.102:6805/1825391266","state":["exists","up"]},{"osd":7,"uuid":"a67c52c4-5c3f-42d0-8c8e-61db85223666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6817","nonce":3909993822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6819","nonce":3909993822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6823","nonce":3909993822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3909993822},{"type":"v1","addr":"172.21.15.102:6821","nonce":3909993822}]},"public_addr":"172.21.15.102:6817/3909993822","cluster_addr":"172.21.15.102:6819/3909993822","heartbeat_back_addr":"172.21.15.102:6823/3909993822","heartbeat_front_addr":"172.21.15.102:6821/3909993822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.986854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.021807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.892903+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.967499+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.025437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.031572+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:50.971002+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:15:51.026808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:18:03.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.925+0000 7f40c18a7640 1 -- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f40a806c8f0 msgr2=0x7f40a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.925+0000 7f40c18a7640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f40a806c8f0 0x7f40a806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f40b0000f60 tx=0x7f40b0009040 comp rx=0 tx=0).stop 2024-04-25T13:18:03.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.925+0000 7f40c18a7640 1 -- 172.21.15.52:0/144648077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40bc0b5450 msgr2=0x7f40bc1f22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:03.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.925+0000 7f40c18a7640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40bc0b5450 0x7f40bc1f22e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f40ac035040 tx=0x7f40ac0046c0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.925+0000 7f40c18a7640 1 -- 172.21.15.52:0/144648077 shutdown_connections 2024-04-25T13:18:03.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.925+0000 7f40c18a7640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f40a806c8f0 0x7f40a806edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.925+0000 7f40c18a7640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40bc1554e0 0x7f40bc0cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.925+0000 7f40c18a7640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40bc0b5450 0x7f40bc1f22e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.925+0000 7f40c18a7640 1 --2- 172.21.15.52:0/144648077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40bc0b3c00 0x7f40bc14ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:03.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.925+0000 7f40c18a7640 1 -- 172.21.15.52:0/144648077 >> 172.21.15.52:0/144648077 conn(0x7f40bc074d50 msgr2=0x7f40bc0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:03.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.926+0000 7f40c18a7640 1 -- 172.21.15.52:0/144648077 shutdown_connections 2024-04-25T13:18:03.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:03.926+0000 7f40c18a7640 1 -- 172.21.15.52:0/144648077 wait complete. 2024-04-25T13:18:03.937 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T13:18:04.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.038+0000 7f5b2375c640 1 Processor -- start 2024-04-25T13:18:04.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.038+0000 7f5b2375c640 1 -- start start 2024-04-25T13:18:04.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b2375c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b1c155170 0x7f5b1c15eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b2375c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5b1c155550 0x7f5b1c0d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b2375c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b1c0ccf00 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b2375c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5b1c0cddf0 con 0x7f5b1c155170 2024-04-25T13:18:04.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b2375c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5b1c15f430 con 0x7f5b1c155550 2024-04-25T13:18:04.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b214f8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b1c155170 0x7f5b1c15eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b21cf9640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5b1c0cb9e0 0x7f5b1c0c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48320/0 (socket says 172.21.15.52:48320) 2024-04-25T13:18:04.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b214f8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b1c155170 0x7f5b1c15eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46778/0 (socket says 172.21.15.52:46778) 2024-04-25T13:18:04.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b21cf9640 1 -- 172.21.15.52:0/4262268538 learned_addr learned my addr 172.21.15.52:0/4262268538 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:18:04.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b20cf7640 1 --2- 172.21.15.52:0/4262268538 >> v2:172.21.15.102:3300/0 conn(0x7f5b1c155550 0x7f5b1c0d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b214f8640 1 -- 172.21.15.52:0/4262268538 >> v2:172.21.15.102:3300/0 conn(0x7f5b1c155550 msgr2=0x7f5b1c0d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:04.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b214f8640 1 --2- 172.21.15.52:0/4262268538 >> v2:172.21.15.102:3300/0 conn(0x7f5b1c155550 0x7f5b1c0d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b214f8640 1 -- 172.21.15.52:0/4262268538 >> v1:172.21.15.52:6789/0 conn(0x7f5b1c0cb9e0 legacy=0x7f5b1c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:04.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.039+0000 7f5b214f8640 1 -- 172.21.15.52:0/4262268538 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1c0cd1e0 con 0x7f5b1c155170 2024-04-25T13:18:04.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.040+0000 7f5b214f8640 1 --2- 172.21.15.52:0/4262268538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b1c155170 0x7f5b1c15eef0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5b100097a0 tx=0x7f5b1002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15aca8331dfb0fa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:04.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.041+0000 7f5b0ffff640 1 -- 172.21.15.52:0/4262268538 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10037070 con 0x7f5b1c155170 2024-04-25T13:18:04.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.041+0000 7f5b0ffff640 1 -- 172.21.15.52:0/4262268538 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5b10032440 con 0x7f5b1c155170 2024-04-25T13:18:04.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.041+0000 7f5b0ffff640 1 -- 172.21.15.52:0/4262268538 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10032830 con 0x7f5b1c155170 2024-04-25T13:18:04.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.041+0000 7f5b2375c640 1 -- 172.21.15.52:0/4262268538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b1c155170 msgr2=0x7f5b1c15eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:04.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.041+0000 7f5b2375c640 1 --2- 172.21.15.52:0/4262268538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b1c155170 0x7f5b1c15eef0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5b100097a0 tx=0x7f5b1002a1e0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.041+0000 7f5b2375c640 1 -- 172.21.15.52:0/4262268538 shutdown_connections 2024-04-25T13:18:04.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.041+0000 7f5b2375c640 1 --2- 172.21.15.52:0/4262268538 >> v2:172.21.15.102:3300/0 conn(0x7f5b1c155550 0x7f5b1c0d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.041+0000 7f5b2375c640 1 --2- 172.21.15.52:0/4262268538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b1c155170 0x7f5b1c15eef0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.041+0000 7f5b2375c640 1 -- 172.21.15.52:0/4262268538 >> 172.21.15.52:0/4262268538 conn(0x7f5b1c072570 msgr2=0x7f5b1c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:04.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.041+0000 7f5b2375c640 1 -- 172.21.15.52:0/4262268538 shutdown_connections 2024-04-25T13:18:04.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.041+0000 7f5b2375c640 1 -- 172.21.15.52:0/4262268538 wait complete. 2024-04-25T13:18:04.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.042+0000 7f5b2375c640 1 Processor -- start 2024-04-25T13:18:04.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.043+0000 7f5b2375c640 1 -- start start 2024-04-25T13:18:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.043+0000 7f5b2375c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b1c0cb9e0 0x7f5b1c0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.043+0000 7f5b2375c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b1c155170 0x7f5b1c1e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.043+0000 7f5b2375c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b1c155550 0x7f5b1c155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.043+0000 7f5b2375c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c0cda80 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.043+0000 7f5b2375c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c0cd7a0 con 0x7f5b1c155170 2024-04-25T13:18:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.043+0000 7f5b2375c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1c0ccae0 con 0x7f5b1c155550 2024-04-25T13:18:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.043+0000 7f5b214f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b1c0cb9e0 0x7f5b1c0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b214f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b1c0cb9e0 0x7f5b1c0caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46790/0 (socket says 172.21.15.52:46790) 2024-04-25T13:18:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b214f8640 1 -- 172.21.15.52:0/3539065883 learned_addr learned my addr 172.21.15.52:0/3539065883 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b20cf7640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b1c155170 0x7f5b1c1e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b21cf9640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b1c155550 0x7f5b1c155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b214f8640 1 -- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b1c155550 msgr2=0x7f5b1c155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b214f8640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b1c155550 0x7f5b1c155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b214f8640 1 -- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b1c155170 msgr2=0x7f5b1c1e7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b214f8640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b1c155170 0x7f5b1c1e7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b214f8640 1 -- 172.21.15.52:0/3539065883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1c14f850 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b21cf9640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b1c155550 0x7f5b1c155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:18:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b214f8640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b1c0cb9e0 0x7f5b1c0caa70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5b10000c00 tx=0x7f5b100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b0dffb640 1 -- 172.21.15.52:0/3539065883 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10041020 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b0dffb640 1 -- 172.21.15.52:0/3539065883 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5b10030990 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b2375c640 1 -- 172.21.15.52:0/3539065883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1c1f1c00 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.044+0000 7f5b0dffb640 1 -- 172.21.15.52:0/3539065883 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10032e60 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.045+0000 7f5b2375c640 1 -- 172.21.15.52:0/3539065883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b1c14fdd0 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.046+0000 7f5b2375c640 1 -- 172.21.15.52:0/3539065883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b1c068e40 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.046+0000 7f5b0dffb640 1 -- 172.21.15.52:0/3539065883 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b10044070 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.046+0000 7f5b0dffb640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5b0006c920 0x7f5b0006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.047+0000 7f5b0dffb640 1 -- 172.21.15.52:0/3539065883 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f5b100ac0c0 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.047+0000 7f5b20cf7640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5b0006c920 0x7f5b0006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.047+0000 7f5b20cf7640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5b0006c920 0x7f5b0006ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c152590 tx=0x7f5b18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:04.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.051+0000 7f5b0dffb640 1 -- 172.21.15.52:0/3539065883 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5b10079fa0 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.275+0000 7f5b2375c640 1 -- 172.21.15.52:0/3539065883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5b1c154320 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.277+0000 7f5b0dffb640 1 -- 172.21.15.52:0/3539065883 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f5b100798a0 con 0x7f5b1c0cb9e0 2024-04-25T13:18:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T13:18:04.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.281+0000 7f5b2375c640 1 -- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5b0006c920 msgr2=0x7f5b0006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:04.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.281+0000 7f5b2375c640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5b0006c920 0x7f5b0006ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c152590 tx=0x7f5b18008040 comp rx=0 tx=0).stop 2024-04-25T13:18:04.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.281+0000 7f5b2375c640 1 -- 172.21.15.52:0/3539065883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b1c0cb9e0 msgr2=0x7f5b1c0caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:04.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.281+0000 7f5b2375c640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b1c0cb9e0 0x7f5b1c0caa70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5b10000c00 tx=0x7f5b100046c0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.281+0000 7f5b2375c640 1 -- 172.21.15.52:0/3539065883 shutdown_connections 2024-04-25T13:18:04.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.281+0000 7f5b2375c640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f5b0006c920 0x7f5b0006ede0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.281+0000 7f5b2375c640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b1c155550 0x7f5b1c155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.281+0000 7f5b2375c640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b1c155170 0x7f5b1c1e7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.281+0000 7f5b2375c640 1 --2- 172.21.15.52:0/3539065883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b1c0cb9e0 0x7f5b1c0caa70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.281+0000 7f5b2375c640 1 -- 172.21.15.52:0/3539065883 >> 172.21.15.52:0/3539065883 conn(0x7f5b1c072570 msgr2=0x7f5b1c153320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:04.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.281+0000 7f5b2375c640 1 -- 172.21.15.52:0/3539065883 shutdown_connections 2024-04-25T13:18:04.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.281+0000 7f5b2375c640 1 -- 172.21.15.52:0/3539065883 wait complete. 2024-04-25T13:18:04.284 INFO:tasks.ceph.mds.e.smithi052.stderr: -5871> 2024-04-25T13:16:18.427+0000 7f78d9f68640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T13:18:04.289 INFO:tasks.ceph.mds.e.smithi052.stderr: -3458> 2024-04-25T13:16:51.121+0000 7f78dc76d640 -1 quiesce.mds.0 failed to decode message of type 1286 v1: End of buffer [buffer:2] 2024-04-25T13:18:04.298 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T13:18:04.314 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-04-25T13:18:04.315 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-04-25T13:18:04.315 INFO:tasks.ceph.mds.a.smithi052.stderr:2024-04-25T13:18:04.315+0000 7f504e580640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-25T13:18:04.316 INFO:tasks.ceph.mds.f.smithi102.stdout:starting mds.f at 2024-04-25T13:18:04.316 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-04-25T13:18:04.323 INFO:tasks.ceph.mds.e.smithi052.stdout:starting mds.e at 2024-04-25T13:18:04.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.405+0000 7f48cd9e8640 1 Processor -- start 2024-04-25T13:18:04.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.406+0000 7f48cd9e8640 1 -- start start 2024-04-25T13:18:04.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.406+0000 7f48cd9e8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c80caa30 0x7f48c80d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.406+0000 7f48cd9e8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f48c80b3870 0x7f48c80d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.406+0000 7f48cd9e8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f48c80b3c90 0x7f48c815b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.406+0000 7f48cd9e8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f48c80cc840 con 0x7f48c80b3c90 2024-04-25T13:18:04.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.406+0000 7f48cd9e8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f48c815f580 con 0x7f48c80b3870 2024-04-25T13:18:04.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.406+0000 7f48cd9e8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f48c80cb6b0 con 0x7f48c80caa30 2024-04-25T13:18:04.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.406+0000 7f48c77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f48c80b3c90 0x7f48c815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.407+0000 7f48c77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f48c80b3c90 0x7f48c815b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46834/0 (socket says 172.21.15.52:46834) 2024-04-25T13:18:04.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.407+0000 7f48c77fe640 1 -- 172.21.15.52:0/2552053912 learned_addr learned my addr 172.21.15.52:0/2552053912 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:04.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.407+0000 7f48c67fc640 1 --2- 172.21.15.52:0/2552053912 >> v2:172.21.15.102:3300/0 conn(0x7f48c80b3870 0x7f48c80d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.407+0000 7f48c6ffd640 1 --2- 172.21.15.52:0/2552053912 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c80caa30 0x7f48c80d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.407+0000 7f48c77fe640 1 -- 172.21.15.52:0/2552053912 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c80caa30 msgr2=0x7f48c80d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:04.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.407+0000 7f48c77fe640 1 --2- 172.21.15.52:0/2552053912 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c80caa30 0x7f48c80d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.407+0000 7f48c77fe640 1 -- 172.21.15.52:0/2552053912 >> v2:172.21.15.102:3300/0 conn(0x7f48c80b3870 msgr2=0x7f48c80d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:04.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.407+0000 7f48c77fe640 1 --2- 172.21.15.52:0/2552053912 >> v2:172.21.15.102:3300/0 conn(0x7f48c80b3870 0x7f48c80d0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.407+0000 7f48c77fe640 1 -- 172.21.15.52:0/2552053912 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c80cb990 con 0x7f48c80b3c90 2024-04-25T13:18:04.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.407+0000 7f48c77fe640 1 --2- 172.21.15.52:0/2552053912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48c80b3c90 0x7f48c815b230 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f48c80689a0 tx=0x7f48b802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8080e0b89841ae30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:04.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.408+0000 7f48c5ffb640 1 -- 172.21.15.52:0/2552053912 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8036070 con 0x7f48c80b3c90 2024-04-25T13:18:04.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.408+0000 7f48c5ffb640 1 -- 172.21.15.52:0/2552053912 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f48b8031600 con 0x7f48c80b3c90 2024-04-25T13:18:04.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.408+0000 7f48c5ffb640 1 -- 172.21.15.52:0/2552053912 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b80319f0 con 0x7f48c80b3c90 2024-04-25T13:18:04.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.408+0000 7f48cd9e8640 1 -- 172.21.15.52:0/2552053912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48c80b3c90 msgr2=0x7f48c815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:04.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.408+0000 7f48cd9e8640 1 --2- 172.21.15.52:0/2552053912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48c80b3c90 0x7f48c815b230 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f48c80689a0 tx=0x7f48b802a730 comp rx=0 tx=0).stop 2024-04-25T13:18:04.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.408+0000 7f48cd9e8640 1 -- 172.21.15.52:0/2552053912 shutdown_connections 2024-04-25T13:18:04.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.408+0000 7f48cd9e8640 1 --2- 172.21.15.52:0/2552053912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48c80b3c90 0x7f48c815b230 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.408+0000 7f48cd9e8640 1 --2- 172.21.15.52:0/2552053912 >> v2:172.21.15.102:3300/0 conn(0x7f48c80b3870 0x7f48c80d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.408+0000 7f48cd9e8640 1 --2- 172.21.15.52:0/2552053912 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c80caa30 0x7f48c80d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.408+0000 7f48cd9e8640 1 -- 172.21.15.52:0/2552053912 >> 172.21.15.52:0/2552053912 conn(0x7f48c8068360 msgr2=0x7f48c8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:04.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.408+0000 7f48cd9e8640 1 -- 172.21.15.52:0/2552053912 shutdown_connections 2024-04-25T13:18:04.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.408+0000 7f48cd9e8640 1 -- 172.21.15.52:0/2552053912 wait complete. 2024-04-25T13:18:04.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.409+0000 7f48cd9e8640 1 Processor -- start 2024-04-25T13:18:04.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.410+0000 7f48cd9e8640 1 -- start start 2024-04-25T13:18:04.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.410+0000 7f48cd9e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c80b3870 0x7f48c814d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.410+0000 7f48cd9e8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c80b3c90 0x7f48c80c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.410+0000 7f48cd9e8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48c80caa30 0x7f48c80ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.410+0000 7f48cd9e8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f48c815f1b0 con 0x7f48c80caa30 2024-04-25T13:18:04.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.410+0000 7f48cd9e8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f48c80cc4d0 con 0x7f48c80b3870 2024-04-25T13:18:04.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.410+0000 7f48cd9e8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f48c815f330 con 0x7f48c80b3c90 2024-04-25T13:18:04.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.410+0000 7f48c77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48c80caa30 0x7f48c80ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.410+0000 7f48c77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48c80caa30 0x7f48c80ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46842/0 (socket says 172.21.15.52:46842) 2024-04-25T13:18:04.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.410+0000 7f48c77fe640 1 -- 172.21.15.52:0/486524862 learned_addr learned my addr 172.21.15.52:0/486524862 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:04.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48c6ffd640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c80b3870 0x7f48c814d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48c77fe640 1 -- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c80b3c90 msgr2=0x7f48c80c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:04.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48c67fc640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c80b3c90 0x7f48c80c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48c77fe640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c80b3c90 0x7f48c80c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48c77fe640 1 -- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c80b3870 msgr2=0x7f48c814d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:04.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48c77fe640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c80b3870 0x7f48c814d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:04.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48c77fe640 1 -- 172.21.15.52:0/486524862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c80d0df0 con 0x7f48c80caa30 2024-04-25T13:18:04.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48c6ffd640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c80b3870 0x7f48c814d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:18:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48c67fc640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c80b3c90 0x7f48c80c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:18:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48c77fe640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48c80caa30 0x7f48c80ce830 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f48b8034040 tx=0x7f48b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48affff640 1 -- 172.21.15.52:0/486524862 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8036050 con 0x7f48c80caa30 2024-04-25T13:18:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48affff640 1 -- 172.21.15.52:0/486524862 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f48b8042070 con 0x7f48c80caa30 2024-04-25T13:18:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48cd9e8640 1 -- 172.21.15.52:0/486524862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c80c5840 con 0x7f48c80caa30 2024-04-25T13:18:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48affff640 1 -- 172.21.15.52:0/486524862 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8009510 con 0x7f48c80caa30 2024-04-25T13:18:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.411+0000 7f48cd9e8640 1 -- 172.21.15.52:0/486524862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c80d0830 con 0x7f48c80caa30 2024-04-25T13:18:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.412+0000 7f48cd9e8640 1 -- 172.21.15.52:0/486524862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c8068f50 con 0x7f48c80caa30 2024-04-25T13:18:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.413+0000 7f48affff640 1 -- 172.21.15.52:0/486524862 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f48b8007bf0 con 0x7f48c80caa30 2024-04-25T13:18:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.413+0000 7f48affff640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f48b406c8f0 0x7f48b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.413+0000 7f48affff640 1 -- 172.21.15.52:0/486524862 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 7194+0+0 (secure 0 0 0) 0x7f48b80ad020 con 0x7f48c80caa30 2024-04-25T13:18:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.413+0000 7f48c6ffd640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f48b406c8f0 0x7f48b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.414+0000 7f48c6ffd640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f48b406c8f0 0x7f48b406edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f48c0006fd0 tx=0x7f48c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.417+0000 7f48affff640 1 -- 172.21.15.52:0/486524862 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f48b8045360 con 0x7f48c80caa30 2024-04-25T13:18:04.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:04.640+0000 7f48cd9e8640 1 -- 172.21.15.52:0/486524862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f48c8155590 con 0x7f48c80caa30 2024-04-25T13:18:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.307+0000 7f48affff640 1 -- 172.21.15.52:0/486524862 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f48b807adf0 con 0x7f48c80caa30 2024-04-25T13:18:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.310+0000 7f48cd9e8640 1 -- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f48b406c8f0 msgr2=0x7f48b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.310+0000 7f48cd9e8640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f48b406c8f0 0x7f48b406edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f48c0006fd0 tx=0x7f48c0008040 comp rx=0 tx=0).stop 2024-04-25T13:18:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.310+0000 7f48cd9e8640 1 -- 172.21.15.52:0/486524862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48c80caa30 msgr2=0x7f48c80ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.310+0000 7f48cd9e8640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48c80caa30 0x7f48c80ce830 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f48b8034040 tx=0x7f48b8004a40 comp rx=0 tx=0).stop 2024-04-25T13:18:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.310+0000 7f48cd9e8640 1 -- 172.21.15.52:0/486524862 shutdown_connections 2024-04-25T13:18:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.310+0000 7f48cd9e8640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f48b406c8f0 0x7f48b406edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.310+0000 7f48cd9e8640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c80b3c90 0x7f48c80c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.310+0000 7f48cd9e8640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48c80caa30 0x7f48c80ce830 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.310+0000 7f48cd9e8640 1 --2- 172.21.15.52:0/486524862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c80b3870 0x7f48c814d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.310+0000 7f48cd9e8640 1 -- 172.21.15.52:0/486524862 >> 172.21.15.52:0/486524862 conn(0x7f48c8068360 msgr2=0x7f48c80c70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.311+0000 7f48cd9e8640 1 -- 172.21.15.52:0/486524862 shutdown_connections 2024-04-25T13:18:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.311+0000 7f48cd9e8640 1 -- 172.21.15.52:0/486524862 wait complete. 2024-04-25T13:18:05.327 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T13:18:05.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.479+0000 7f05f8662640 1 Processor -- start 2024-04-25T13:18:05.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.479+0000 7f05f8662640 1 -- start start 2024-04-25T13:18:05.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f8662640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05f00c9490 0x7f05f0158740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f8662640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f05f00c9870 0x7f05f01593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f8662640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f0158c80 con 0x7f05f00c8760 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f8662640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f05f00c8c30 con 0x7f05f00c9870 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f8662640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f05f00c3a90 con 0x7f05f00c9490 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f6bff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f05f00c9870 0x7f05f01593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f6bff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f05f00c9870 0x7f05f01593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46856/0 (socket says 172.21.15.52:46856) 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f6bff640 1 -- 172.21.15.52:0/2491029585 learned_addr learned my addr 172.21.15.52:0/2491029585 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f63fe640 1 --2- 172.21.15.52:0/2491029585 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05f00c9490 0x7f05f0158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:05.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f6bff640 1 -- 172.21.15.52:0/2491029585 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05f00c9490 msgr2=0x7f05f0158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:05.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f6bff640 1 --2- 172.21.15.52:0/2491029585 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05f00c9490 0x7f05f0158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:05.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f6bff640 1 -- 172.21.15.52:0/2491029585 >> v1:172.21.15.102:6789/0 conn(0x7f05f00c8760 legacy=0x7f05f0151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:05.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f6bff640 1 -- 172.21.15.52:0/2491029585 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f015b2b0 con 0x7f05f00c9870 2024-04-25T13:18:05.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.480+0000 7f05f63fe640 1 --2- 172.21.15.52:0/2491029585 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05f00c9490 0x7f05f0158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:18:05.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.481+0000 7f05f6bff640 1 --2- 172.21.15.52:0/2491029585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f00c9870 0x7f05f01593f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009e50 tx=0x7f05e802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e09b92b6893994 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:05.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.481+0000 7f05f53fc640 1 -- 172.21.15.52:0/2491029585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8036070 con 0x7f05f00c9870 2024-04-25T13:18:05.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.481+0000 7f05f53fc640 1 -- 172.21.15.52:0/2491029585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f05e8031600 con 0x7f05f00c9870 2024-04-25T13:18:05.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.481+0000 7f05f53fc640 1 -- 172.21.15.52:0/2491029585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e80319f0 con 0x7f05f00c9870 2024-04-25T13:18:05.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.482+0000 7f05f8662640 1 -- 172.21.15.52:0/2491029585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f00c9870 msgr2=0x7f05f01593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:05.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.482+0000 7f05f8662640 1 --2- 172.21.15.52:0/2491029585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f00c9870 0x7f05f01593f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009e50 tx=0x7f05e802a710 comp rx=0 tx=0).stop 2024-04-25T13:18:05.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.482+0000 7f05f8662640 1 -- 172.21.15.52:0/2491029585 shutdown_connections 2024-04-25T13:18:05.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.482+0000 7f05f8662640 1 --2- 172.21.15.52:0/2491029585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f00c9870 0x7f05f01593f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:05.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.482+0000 7f05f8662640 1 --2- 172.21.15.52:0/2491029585 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05f00c9490 0x7f05f0158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:05.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.482+0000 7f05f8662640 1 -- 172.21.15.52:0/2491029585 >> 172.21.15.52:0/2491029585 conn(0x7f05f0074f30 msgr2=0x7f05f0075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:05.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.482+0000 7f05f8662640 1 -- 172.21.15.52:0/2491029585 shutdown_connections 2024-04-25T13:18:05.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.482+0000 7f05f8662640 1 -- 172.21.15.52:0/2491029585 wait complete. 2024-04-25T13:18:05.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.483+0000 7f05f8662640 1 Processor -- start 2024-04-25T13:18:05.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.483+0000 7f05f8662640 1 -- start start 2024-04-25T13:18:05.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f8662640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f00c8760 0x7f05f014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:05.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f8662640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05f00c9490 0x7f05f00cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:05.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f8662640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05f00c9870 0x7f05f014c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:05.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f8662640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f05f015bb50 con 0x7f05f00c8760 2024-04-25T13:18:05.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f8662640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f05f015b870 con 0x7f05f00c9870 2024-04-25T13:18:05.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f8662640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f05f015be30 con 0x7f05f00c9490 2024-04-25T13:18:05.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f63fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f00c8760 0x7f05f014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:05.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f63fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f00c8760 0x7f05f014d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46860/0 (socket says 172.21.15.52:46860) 2024-04-25T13:18:05.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f63fe640 1 -- 172.21.15.52:0/3681067562 learned_addr learned my addr 172.21.15.52:0/3681067562 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:05.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f6bff640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05f00c9870 0x7f05f014c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:05.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f5bfd640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05f00c9490 0x7f05f00cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:05.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f63fe640 1 -- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05f00c9490 msgr2=0x7f05f00cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:05.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f63fe640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05f00c9490 0x7f05f00cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:05.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f63fe640 1 -- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05f00c9870 msgr2=0x7f05f014c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:05.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f63fe640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05f00c9870 0x7f05f014c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:05.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f63fe640 1 -- 172.21.15.52:0/3681067562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f0073ec0 con 0x7f05f00c8760 2024-04-25T13:18:05.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05f63fe640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f00c8760 0x7f05f014d6a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00d7d0 tx=0x7f05ec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:05.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.484+0000 7f05e6ffd640 1 -- 172.21.15.52:0/3681067562 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec004030 con 0x7f05f00c8760 2024-04-25T13:18:05.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.485+0000 7f05e6ffd640 1 -- 172.21.15.52:0/3681067562 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f05ec0041d0 con 0x7f05f00c8760 2024-04-25T13:18:05.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.485+0000 7f05f8662640 1 -- 172.21.15.52:0/3681067562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f01ed2b0 con 0x7f05f00c8760 2024-04-25T13:18:05.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.485+0000 7f05e6ffd640 1 -- 172.21.15.52:0/3681067562 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00b6c0 con 0x7f05f00c8760 2024-04-25T13:18:05.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.485+0000 7f05f8662640 1 -- 172.21.15.52:0/3681067562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f01ed850 con 0x7f05f00c8760 2024-04-25T13:18:05.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.485+0000 7f05f8662640 1 -- 172.21.15.52:0/3681067562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f0155b10 con 0x7f05f00c8760 2024-04-25T13:18:05.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.486+0000 7f05e6ffd640 1 -- 172.21.15.52:0/3681067562 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05ec00b860 con 0x7f05f00c8760 2024-04-25T13:18:05.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.486+0000 7f05e6ffd640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f05d406c8f0 0x7f05d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:05.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.486+0000 7f05e6ffd640 1 -- 172.21.15.52:0/3681067562 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 7194+0+0 (secure 0 0 0) 0x7f05ec08c340 con 0x7f05f00c8760 2024-04-25T13:18:05.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.487+0000 7f05f5bfd640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f05d406c8f0 0x7f05d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:05.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.487+0000 7f05f5bfd640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f05d406c8f0 0x7f05d406edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f05f014dc00 tx=0x7f05e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:05.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.491+0000 7f05e6ffd640 1 -- 172.21.15.52:0/3681067562 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f05ec059ac0 con 0x7f05f00c8760 2024-04-25T13:18:05.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:05.676+0000 7f05f8662640 1 -- 172.21.15.52:0/3681067562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f05f00c4420 con 0x7f05f00c8760 2024-04-25T13:18:06.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.318+0000 7f05e6ffd640 1 -- 172.21.15.52:0/3681067562 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f05ec05ddc0 con 0x7f05f00c8760 2024-04-25T13:18:06.319 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-04-25T13:18:06.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.323+0000 7f05f8662640 1 -- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f05d406c8f0 msgr2=0x7f05d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:06.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.323+0000 7f05f8662640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f05d406c8f0 0x7f05d406edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f05f014dc00 tx=0x7f05e0009040 comp rx=0 tx=0).stop 2024-04-25T13:18:06.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.323+0000 7f05f8662640 1 -- 172.21.15.52:0/3681067562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f00c8760 msgr2=0x7f05f014d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:06.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.323+0000 7f05f8662640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f00c8760 0x7f05f014d6a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00d7d0 tx=0x7f05ec00dc90 comp rx=0 tx=0).stop 2024-04-25T13:18:06.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.323+0000 7f05f8662640 1 -- 172.21.15.52:0/3681067562 shutdown_connections 2024-04-25T13:18:06.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.323+0000 7f05f8662640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f05d406c8f0 0x7f05d406edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:06.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.323+0000 7f05f8662640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05f00c9490 0x7f05f00cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:06.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.323+0000 7f05f8662640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05f00c9870 0x7f05f014c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:06.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.323+0000 7f05f8662640 1 --2- 172.21.15.52:0/3681067562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05f00c8760 0x7f05f014d6a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:06.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.323+0000 7f05f8662640 1 -- 172.21.15.52:0/3681067562 >> 172.21.15.52:0/3681067562 conn(0x7f05f0074f30 msgr2=0x7f05f015aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:06.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.323+0000 7f05f8662640 1 -- 172.21.15.52:0/3681067562 shutdown_connections 2024-04-25T13:18:06.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.323+0000 7f05f8662640 1 -- 172.21.15.52:0/3681067562 wait complete. 2024-04-25T13:18:06.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T13:18:06.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.450+0000 7f8c87243640 1 Processor -- start 2024-04-25T13:18:06.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.450+0000 7f8c87243640 1 -- start start 2024-04-25T13:18:06.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.451+0000 7f8c87243640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c80155510 0x7f8c8015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:06.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.451+0000 7f8c87243640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8c800cde80 0x7f8c800c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:06.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.451+0000 7f8c87243640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c8015e800 con 0x7f8c80155130 2024-04-25T13:18:06.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.451+0000 7f8c87243640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8c8015e5d0 con 0x7f8c80155510 2024-04-25T13:18:06.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.451+0000 7f8c87243640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8c8015bfa0 con 0x7f8c800cde80 2024-04-25T13:18:06.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.451+0000 7f8c7ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c80155510 0x7f8c8015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:06.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.451+0000 7f8c84fdf640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8c80155130 0x7f8c80073150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48352/0 (socket says 172.21.15.52:48352) 2024-04-25T13:18:06.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.451+0000 7f8c84fdf640 1 -- 172.21.15.52:0/454981661 learned_addr learned my addr 172.21.15.52:0/454981661 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-04-25T13:18:06.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.452+0000 7f8c857e0640 1 --2- 172.21.15.52:0/454981661 >> v2:172.21.15.102:3300/0 conn(0x7f8c800cde80 0x7f8c800c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:06.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.452+0000 7f8c7ffff640 1 -- 172.21.15.52:0/454981661 >> v2:172.21.15.102:3300/0 conn(0x7f8c800cde80 msgr2=0x7f8c800c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:06.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.452+0000 7f8c7ffff640 1 --2- 172.21.15.52:0/454981661 >> v2:172.21.15.102:3300/0 conn(0x7f8c800cde80 0x7f8c800c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:06.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.452+0000 7f8c7ffff640 1 -- 172.21.15.52:0/454981661 >> v1:172.21.15.52:6789/0 conn(0x7f8c80155130 legacy=0x7f8c80073150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:06.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.452+0000 7f8c7ffff640 1 -- 172.21.15.52:0/454981661 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8015eac0 con 0x7f8c80155510 2024-04-25T13:18:06.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.452+0000 7f8c7f7fe640 1 -- 172.21.15.52:0/454981661 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1107675180 0 0) 0x7f8c8015e800 con 0x7f8c80155130 2024-04-25T13:18:06.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.452+0000 7f8c7ffff640 1 --2- 172.21.15.52:0/454981661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c80155510 0x7f8c8015ba60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8c800b3c10 tx=0x7f8c7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a907cd43db733b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:06.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.453+0000 7f8c7f7fe640 1 -- 172.21.15.52:0/454981661 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74037070 con 0x7f8c80155510 2024-04-25T13:18:06.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.453+0000 7f8c7f7fe640 1 -- 172.21.15.52:0/454981661 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8c74032440 con 0x7f8c80155510 2024-04-25T13:18:06.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.453+0000 7f8c7f7fe640 1 -- 172.21.15.52:0/454981661 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74032830 con 0x7f8c80155510 2024-04-25T13:18:06.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.453+0000 7f8c87243640 1 -- 172.21.15.52:0/454981661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c80155510 msgr2=0x7f8c8015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:06.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.453+0000 7f8c87243640 1 --2- 172.21.15.52:0/454981661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c80155510 0x7f8c8015ba60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8c800b3c10 tx=0x7f8c7402a1e0 comp rx=0 tx=0).stop 2024-04-25T13:18:06.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.453+0000 7f8c87243640 1 -- 172.21.15.52:0/454981661 shutdown_connections 2024-04-25T13:18:06.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.453+0000 7f8c87243640 1 --2- 172.21.15.52:0/454981661 >> v2:172.21.15.102:3300/0 conn(0x7f8c800cde80 0x7f8c800c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:06.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.453+0000 7f8c87243640 1 --2- 172.21.15.52:0/454981661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c80155510 0x7f8c8015ba60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:06.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.453+0000 7f8c87243640 1 -- 172.21.15.52:0/454981661 >> 172.21.15.52:0/454981661 conn(0x7f8c80068360 msgr2=0x7f8c8006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:06.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.453+0000 7f8c87243640 1 -- 172.21.15.52:0/454981661 shutdown_connections 2024-04-25T13:18:06.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.453+0000 7f8c87243640 1 -- 172.21.15.52:0/454981661 wait complete. 2024-04-25T13:18:06.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.454+0000 7f8c87243640 1 Processor -- start 2024-04-25T13:18:06.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.454+0000 7f8c87243640 1 -- start start 2024-04-25T13:18:06.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.455+0000 7f8c87243640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c800cde80 0x7f8c8015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:06.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.455+0000 7f8c87243640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c80155130 0x7f8c801f1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:06.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.455+0000 7f8c87243640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c80155510 0x7f8c801f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.455+0000 7f8c87243640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8015f080 con 0x7f8c800cde80 2024-04-25T13:18:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.455+0000 7f8c87243640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8c800c57a0 con 0x7f8c80155130 2024-04-25T13:18:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.455+0000 7f8c87243640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8015f360 con 0x7f8c80155510 2024-04-25T13:18:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.455+0000 7f8c84fdf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c800cde80 0x7f8c8015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.455+0000 7f8c84fdf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c800cde80 0x7f8c8015a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46882/0 (socket says 172.21.15.52:46882) 2024-04-25T13:18:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.455+0000 7f8c84fdf640 1 -- 172.21.15.52:0/41026505 learned_addr learned my addr 172.21.15.52:0/41026505 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.456+0000 7f8c7ffff640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c80155130 0x7f8c801f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.456+0000 7f8c84fdf640 1 -- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c80155510 msgr2=0x7f8c801f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.456+0000 7f8c84fdf640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c80155510 0x7f8c801f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:06.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.456+0000 7f8c84fdf640 1 -- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c80155130 msgr2=0x7f8c801f1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:06.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.456+0000 7f8c84fdf640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c80155130 0x7f8c801f1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:06.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.456+0000 7f8c84fdf640 1 -- 172.21.15.52:0/41026505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8015c240 con 0x7f8c800cde80 2024-04-25T13:18:06.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.456+0000 7f8c84fdf640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c800cde80 0x7f8c8015a4a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c8c0 tx=0x7f8c7800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:06.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.456+0000 7f8c7d7fa640 1 -- 172.21.15.52:0/41026505 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78018070 con 0x7f8c800cde80 2024-04-25T13:18:06.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.456+0000 7f8c7d7fa640 1 -- 172.21.15.52:0/41026505 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8c7800a5e0 con 0x7f8c800cde80 2024-04-25T13:18:06.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.456+0000 7f8c87243640 1 -- 172.21.15.52:0/41026505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8015c4e0 con 0x7f8c800cde80 2024-04-25T13:18:06.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.456+0000 7f8c7d7fa640 1 -- 172.21.15.52:0/41026505 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800a9f0 con 0x7f8c800cde80 2024-04-25T13:18:06.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.456+0000 7f8c87243640 1 -- 172.21.15.52:0/41026505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c801f4840 con 0x7f8c800cde80 2024-04-25T13:18:06.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.457+0000 7f8c87243640 1 -- 172.21.15.52:0/41026505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c800c6e50 con 0x7f8c800cde80 2024-04-25T13:18:06.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.457+0000 7f8c7d7fa640 1 -- 172.21.15.52:0/41026505 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c7801b070 con 0x7f8c800cde80 2024-04-25T13:18:06.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.458+0000 7f8c7d7fa640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8c6c06c8f0 0x7f8c6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:06.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.458+0000 7f8c7d7fa640 1 -- 172.21.15.52:0/41026505 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6756+0+0 (secure 0 0 0) 0x7f8c7808b6c0 con 0x7f8c800cde80 2024-04-25T13:18:06.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.458+0000 7f8c7ffff640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8c6c06c8f0 0x7f8c6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:06.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.459+0000 7f8c7ffff640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8c6c06c8f0 0x7f8c6c06edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c74034000 tx=0x7f8c7402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:06.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.462+0000 7f8c7d7fa640 1 -- 172.21.15.52:0/41026505 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c800c6e50 con 0x7f8c800cde80 2024-04-25T13:18:06.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:06.649+0000 7f8c87243640 1 -- 172.21.15.52:0/41026505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8c800cad50 con 0x7f8c800cde80 2024-04-25T13:18:07.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.323+0000 7f8c7d7fa640 1 -- 172.21.15.52:0/41026505 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f8c78059640 con 0x7f8c800cde80 2024-04-25T13:18:07.324 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-04-25T13:18:07.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.328+0000 7f8c87243640 1 -- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8c6c06c8f0 msgr2=0x7f8c6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:07.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.328+0000 7f8c87243640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8c6c06c8f0 0x7f8c6c06edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c74034000 tx=0x7f8c7402e000 comp rx=0 tx=0).stop 2024-04-25T13:18:07.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.328+0000 7f8c87243640 1 -- 172.21.15.52:0/41026505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c800cde80 msgr2=0x7f8c8015a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:07.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.328+0000 7f8c87243640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c800cde80 0x7f8c8015a4a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c8c0 tx=0x7f8c7800cd80 comp rx=0 tx=0).stop 2024-04-25T13:18:07.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.329+0000 7f8c87243640 1 -- 172.21.15.52:0/41026505 shutdown_connections 2024-04-25T13:18:07.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.329+0000 7f8c87243640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7f8c6c06c8f0 0x7f8c6c06edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:07.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.329+0000 7f8c87243640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c80155510 0x7f8c801f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:07.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.329+0000 7f8c87243640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c80155130 0x7f8c801f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:07.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.329+0000 7f8c87243640 1 --2- 172.21.15.52:0/41026505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c800cde80 0x7f8c8015a4a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:07.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.329+0000 7f8c87243640 1 -- 172.21.15.52:0/41026505 >> 172.21.15.52:0/41026505 conn(0x7f8c80068360 msgr2=0x7f8c800cb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:07.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.329+0000 7f8c87243640 1 -- 172.21.15.52:0/41026505 shutdown_connections 2024-04-25T13:18:07.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.330+0000 7f8c87243640 1 -- 172.21.15.52:0/41026505 wait complete. 2024-04-25T13:18:07.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T13:18:07.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.462+0000 7fba4cd84640 1 Processor -- start 2024-04-25T13:18:07.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.462+0000 7fba4cd84640 1 -- start start 2024-04-25T13:18:07.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba4cd84640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fba48155130 0x7fba4815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:07.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba4cd84640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fba48155510 0x7fba48073150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:07.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba4cd84640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4815e800 con 0x7fba480cde80 2024-04-25T13:18:07.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba4cd84640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fba4815e5d0 con 0x7fba48155130 2024-04-25T13:18:07.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba4cd84640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fba4815bfa0 con 0x7fba48155510 2024-04-25T13:18:07.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba4659c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fba48155130 0x7fba4815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:07.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba4659c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fba48155130 0x7fba4815ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46896/0 (socket says 172.21.15.52:46896) 2024-04-25T13:18:07.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba4659c640 1 -- 172.21.15.52:0/1278931702 learned_addr learned my addr 172.21.15.52:0/1278931702 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:07.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba3ffff640 1 --2- 172.21.15.52:0/1278931702 >> v2:172.21.15.102:3300/0 conn(0x7fba48155510 0x7fba48073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:07.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba4659c640 1 -- 172.21.15.52:0/1278931702 >> v2:172.21.15.102:3300/0 conn(0x7fba48155510 msgr2=0x7fba48073150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba4659c640 1 --2- 172.21.15.52:0/1278931702 >> v2:172.21.15.102:3300/0 conn(0x7fba48155510 0x7fba48073150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba4659c640 1 -- 172.21.15.52:0/1278931702 >> v1:172.21.15.102:6789/0 conn(0x7fba480cde80 legacy=0x7fba480c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba4659c640 1 -- 172.21.15.52:0/1278931702 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4815eac0 con 0x7fba48155130 2024-04-25T13:18:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.463+0000 7fba3ffff640 1 --2- 172.21.15.52:0/1278931702 >> v2:172.21.15.102:3300/0 conn(0x7fba48155510 0x7fba48073150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:18:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.464+0000 7fba4659c640 1 --2- 172.21.15.52:0/1278931702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba48155130 0x7fba4815ba60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fba480cbe40 tx=0x7fba3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a274237ae3bca4bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.464+0000 7fba45d9b640 1 -- 172.21.15.52:0/1278931702 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38037070 con 0x7fba48155130 2024-04-25T13:18:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.464+0000 7fba45d9b640 1 -- 172.21.15.52:0/1278931702 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fba38032440 con 0x7fba48155130 2024-04-25T13:18:07.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.464+0000 7fba45d9b640 1 -- 172.21.15.52:0/1278931702 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38032830 con 0x7fba48155130 2024-04-25T13:18:07.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.465+0000 7fba4cd84640 1 -- 172.21.15.52:0/1278931702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba48155130 msgr2=0x7fba4815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:07.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.465+0000 7fba4cd84640 1 --2- 172.21.15.52:0/1278931702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba48155130 0x7fba4815ba60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fba480cbe40 tx=0x7fba3802a270 comp rx=0 tx=0).stop 2024-04-25T13:18:07.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.465+0000 7fba4cd84640 1 -- 172.21.15.52:0/1278931702 shutdown_connections 2024-04-25T13:18:07.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.465+0000 7fba4cd84640 1 --2- 172.21.15.52:0/1278931702 >> v2:172.21.15.102:3300/0 conn(0x7fba48155510 0x7fba48073150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:07.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.465+0000 7fba4cd84640 1 --2- 172.21.15.52:0/1278931702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba48155130 0x7fba4815ba60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:07.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.465+0000 7fba4cd84640 1 -- 172.21.15.52:0/1278931702 >> 172.21.15.52:0/1278931702 conn(0x7fba48068360 msgr2=0x7fba4806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:07.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.465+0000 7fba4cd84640 1 -- 172.21.15.52:0/1278931702 shutdown_connections 2024-04-25T13:18:07.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.465+0000 7fba4cd84640 1 -- 172.21.15.52:0/1278931702 wait complete. 2024-04-25T13:18:07.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.466+0000 7fba4cd84640 1 Processor -- start 2024-04-25T13:18:07.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.466+0000 7fba4cd84640 1 -- start start 2024-04-25T13:18:07.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4cd84640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba480cde80 0x7fba480c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:07.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4cd84640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba48155130 0x7fba4815d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:07.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4cd84640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba48155510 0x7fba481f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:07.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4cd84640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fba4815f080 con 0x7fba480cde80 2024-04-25T13:18:07.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4cd84640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fba480c57a0 con 0x7fba48155510 2024-04-25T13:18:07.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4cd84640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fba4815f360 con 0x7fba48155130 2024-04-25T13:18:07.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba480cde80 0x7fba480c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:07.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba480cde80 0x7fba480c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46910/0 (socket says 172.21.15.52:46910) 2024-04-25T13:18:07.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4659c640 1 -- 172.21.15.52:0/1623105140 learned_addr learned my addr 172.21.15.52:0/1623105140 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-04-25T13:18:07.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba46d9d640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba48155510 0x7fba481f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:07.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba3ffff640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba48155130 0x7fba4815d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:07.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4659c640 1 -- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba48155130 msgr2=0x7fba4815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:07.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4659c640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba48155130 0x7fba4815d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:07.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4659c640 1 -- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba48155510 msgr2=0x7fba481f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:07.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4659c640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba48155510 0x7fba481f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:07.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba4659c640 1 -- 172.21.15.52:0/1623105140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba481e43e0 con 0x7fba480cde80 2024-04-25T13:18:07.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.467+0000 7fba46d9d640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba48155510 0x7fba481f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:18:07.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.468+0000 7fba4659c640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba480cde80 0x7fba480c86d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fba380097f0 tx=0x7fba380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:07.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.468+0000 7fba3effd640 1 -- 172.21.15.52:0/1623105140 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38037040 con 0x7fba480cde80 2024-04-25T13:18:07.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.468+0000 7fba3effd640 1 -- 172.21.15.52:0/1623105140 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fba38004230 con 0x7fba480cde80 2024-04-25T13:18:07.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.468+0000 7fba3effd640 1 -- 172.21.15.52:0/1623105140 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38030770 con 0x7fba480cde80 2024-04-25T13:18:07.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.468+0000 7fba4cd84640 1 -- 172.21.15.52:0/1623105140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba481510c0 con 0x7fba480cde80 2024-04-25T13:18:07.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.468+0000 7fba4cd84640 1 -- 172.21.15.52:0/1623105140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4814e170 con 0x7fba480cde80 2024-04-25T13:18:07.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.469+0000 7fba4cd84640 1 -- 172.21.15.52:0/1623105140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba48152770 con 0x7fba480cde80 2024-04-25T13:18:07.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.469+0000 7fba3effd640 1 -- 172.21.15.52:0/1623105140 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba38030910 con 0x7fba480cde80 2024-04-25T13:18:07.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.470+0000 7fba3effd640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fba2806c8f0 0x7fba2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:07.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.470+0000 7fba3effd640 1 -- 172.21.15.52:0/1623105140 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6197+0+0 (secure 0 0 0) 0x7fba380acd10 con 0x7fba480cde80 2024-04-25T13:18:07.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.470+0000 7fba3ffff640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fba2806c8f0 0x7fba2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:07.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.470+0000 7fba3ffff640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fba2806c8f0 0x7fba2806edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba480cac10 tx=0x7fba30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:07.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.474+0000 7fba3effd640 1 -- 172.21.15.52:0/1623105140 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba48152770 con 0x7fba480cde80 2024-04-25T13:18:07.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:07.659+0000 7fba4cd84640 1 -- 172.21.15.52:0/1623105140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fba480b5d30 con 0x7fba480cde80 2024-04-25T13:18:08.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.330+0000 7fba3effd640 1 -- 172.21.15.52:0/1623105140 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7fba3807aec0 con 0x7fba480cde80 2024-04-25T13:18:08.330 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data_ec' removed 2024-04-25T13:18:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.333+0000 7fba4cd84640 1 -- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fba2806c8f0 msgr2=0x7fba2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.333+0000 7fba4cd84640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fba2806c8f0 0x7fba2806edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba480cac10 tx=0x7fba30008040 comp rx=0 tx=0).stop 2024-04-25T13:18:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.333+0000 7fba4cd84640 1 -- 172.21.15.52:0/1623105140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba480cde80 msgr2=0x7fba480c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.333+0000 7fba4cd84640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba480cde80 0x7fba480c86d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fba380097f0 tx=0x7fba380046c0 comp rx=0 tx=0).stop 2024-04-25T13:18:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.333+0000 7fba4cd84640 1 -- 172.21.15.52:0/1623105140 shutdown_connections 2024-04-25T13:18:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.333+0000 7fba4cd84640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:6832/44610470,v1:172.21.15.102:6833/44610470] conn(0x7fba2806c8f0 0x7fba2806edb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.333+0000 7fba4cd84640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fba48155130 0x7fba4815d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.333+0000 7fba4cd84640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba48155510 0x7fba481f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.333+0000 7fba4cd84640 1 --2- 172.21.15.52:0/1623105140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba480cde80 0x7fba480c86d0 secure :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fba380097f0 tx=0x7fba380046c0 comp rx=0 tx=0).stop 2024-04-25T13:18:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.333+0000 7fba4cd84640 1 -- 172.21.15.52:0/1623105140 >> 172.21.15.52:0/1623105140 conn(0x7fba48068360 msgr2=0x7fba48154440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.334+0000 7fba4cd84640 1 -- 172.21.15.52:0/1623105140 shutdown_connections 2024-04-25T13:18:08.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T13:18:08.334+0000 7fba4cd84640 1 -- 172.21.15.52:0/1623105140 wait complete. 2024-04-25T13:18:08.352 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T13:18:08.352 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T13:18:08.352 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:08.364 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T13:18:08.364 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T13:18:08.364 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:08.415 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T13:18:08.415 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-25T13:18:08.415 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:08.465 INFO:tasks.ceph.mds.e:Stopped 2024-04-25T13:18:08.466 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T13:18:08.466 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:08.477 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T13:18:08.477 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T13:18:08.477 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:08.529 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T13:18:08.529 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-25T13:18:08.529 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:08.580 INFO:tasks.ceph.mds.f:Stopped 2024-04-25T13:18:08.580 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T13:18:08.581 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T13:18:08.581 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:08.615 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T13:18:08.615 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T13:18:08.615 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:08.689 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T13:18:08.689 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T13:18:08.689 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:08.760 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T13:18:08.760 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T13:18:08.760 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:08.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-25T13:18:08.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-04-25T13:18:08.830 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T13:18:08.830 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T13:18:08.830 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:08.869 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T13:18:08.869 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T13:18:08.869 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:08.937 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T13:18:08.937 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T13:18:08.937 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:09.012 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T13:18:09.012 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T13:18:09.012 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:09.079 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T13:18:09.079 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T13:18:09.079 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T13:18:09.079 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:09.107 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T13:18:09.107 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T13:18:09.107 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:09.148 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T13:18:09.148 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T13:18:09.149 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T13:18:09.149 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:09.163 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T13:18:09.163 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T13:18:09.163 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:09.199 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T13:18:09.200 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T13:18:09.200 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:09.252 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T13:18:09.252 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T13:18:09.252 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-25T13:18:09.299 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:18:09.299 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T13:18:09.590 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:18:09.591 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T13:18:09.657 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:18:09.657 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T13:18:09.715 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:18:09.715 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T13:18:09.772 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi102.front.sepia.ceph.com 2024-04-25T13:18:09.772 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T13:18:10.026 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi102.front.sepia.ceph.com 2024-04-25T13:18:10.026 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T13:18:10.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:10.100 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi102.front.sepia.ceph.com 2024-04-25T13:18:10.100 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T13:18:10.103 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:10.151 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi102.front.sepia.ceph.com 2024-04-25T13:18:10.151 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T13:18:10.260 INFO:tasks.ceph:Archiving mon data... 2024-04-25T13:18:10.261 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468/data/mon.a.tgz 2024-04-25T13:18:10.261 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-04-25T13:18:10.280 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.R8LNXOknAU 2024-04-25T13:18:10.280 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.R8LNXOknAU 2024-04-25T13:18:10.421 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.R8LNXOknAU 2024-04-25T13:18:10.505 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.R8LNXOknAU is 288KB 2024-04-25T13:18:10.580 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.R8LNXOknAU 2024-04-25T13:18:10.595 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468/data/mon.b.tgz 2024-04-25T13:18:10.595 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-04-25T13:18:10.613 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.CHhf37E2dv 2024-04-25T13:18:10.613 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.CHhf37E2dv 2024-04-25T13:18:10.767 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.CHhf37E2dv 2024-04-25T13:18:10.849 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.CHhf37E2dv is 395KB 2024-04-25T13:18:10.917 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.CHhf37E2dv 2024-04-25T13:18:10.931 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468/data/mon.c.tgz 2024-04-25T13:18:10.931 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-04-25T13:18:10.985 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.5YtocTIMmR 2024-04-25T13:18:10.986 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.5YtocTIMmR 2024-04-25T13:18:11.120 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.5YtocTIMmR 2024-04-25T13:18:11.201 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.5YtocTIMmR is 394KB 2024-04-25T13:18:11.267 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.5YtocTIMmR 2024-04-25T13:18:11.281 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T13:18:11.281 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:18:11.284 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:18:11.368 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:18:11.399 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:18:11.399 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T13:18:11.400 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468/remote/smithi052/crash 2024-04-25T13:18:11.401 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:18:11.437 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468/remote/smithi102/crash 2024-04-25T13:18:11.438 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:18:11.461 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T13:18:11.462 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:11.482 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:11.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:11.591 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:11.613 INFO:tasks.ceph:Compressing logs... 2024-04-25T13:18:11.614 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:18:11.634 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:18:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44361.log 2024-04-25T13:18:11.658 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46136.log 2024-04-25T13:18:11.658 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44319.log 2024-04-25T13:18:11.711 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T13:18:11.712 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34452.log 2024-04-25T13:18:11.712 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34492.log 2024-04-25T13:18:11.712 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34452.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-25T13:18:11.712 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34492.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T13:18:11.712 INFO:teuthology.orchestra.run.smithi102.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34452.log.gz 2024-04-25T13:18:11.712 INFO:teuthology.orchestra.run.smithi102.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34492.log.gz 2024-04-25T13:18:11.713 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34703.log 2024-04-25T13:18:11.713 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T13:18:11.713 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T13:18:11.713 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34703.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T13:18:11.713 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34703.log.gz 2024-04-25T13:18:11.713 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34623.log 2024-04-25T13:18:11.713 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T13:18:11.713 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.admin.34623.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T13:18:11.713 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34623.log.gz 2024-04-25T13:18:11.713 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T13:18:11.714 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T13:18:11.714 INFO:teuthology.orchestra.run.smithi102.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T13:18:11.714 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T13:18:11.714 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T13:18:11.714 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34532.log 2024-04-25T13:18:11.714 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34743.log 2024-04-25T13:18:11.714 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34532.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34532.log.gz 2024-04-25T13:18:11.715 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34663.log 2024-04-25T13:18:11.715 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34743.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34743.log.gz 2024-04-25T13:18:11.715 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34583.log 2024-04-25T13:18:11.715 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34663.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34663.log.gz 2024-04-25T13:18:11.715 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T13:18:11.715 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34583.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34583.log.gz 2024-04-25T13:18:11.715 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T13:18:11.716 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.d.log: 90.8% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-25T13:18:11.716 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T13:18:11.724 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.b.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T13:18:11.748 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41925.log 2024-04-25T13:18:11.748 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45642.log 2024-04-25T13:18:11.748 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44361.log.gz 2024-04-25T13:18:11.749 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46136.log.gz 2024-04-25T13:18:11.749 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44319.log.gz 2024-04-25T13:18:11.749 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44753.log 2024-04-25T13:18:11.749 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43983.log 2024-04-25T13:18:11.749 INFO:teuthology.orchestra.run.smithi052.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41925.log.gz 2024-04-25T13:18:11.749 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44753.log: gzip -5 --verbose 88.1% -- -- replaced with /var/log/ceph/ceph-client.admin.45642.log.gz /var/log/ceph/ceph-client.admin.46808.log 2024-04-25T13:18:11.749 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-04-25T13:18:11.750 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44753.log.gz 2024-04-25T13:18:11.750 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46877.log 2024-04-25T13:18:11.750 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46808.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43983.log.gz 2024-04-25T13:18:11.750 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47046.log 2024-04-25T13:18:11.750 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46808.log.gz 2024-04-25T13:18:11.750 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45968.log 2024-04-25T13:18:11.750 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46877.log.gz 2024-04-25T13:18:11.750 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.47046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44493.log 2024-04-25T13:18:11.750 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47046.log.gz 2024-04-25T13:18:11.751 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39977.log 2024-04-25T13:18:11.751 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45968.log.gz 2024-04-25T13:18:11.751 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46766.log 2024-04-25T13:18:11.751 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.39977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2024-04-25T13:18:11.751 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44493.log.gz 2024-04-25T13:18:11.751 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46766.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39977.log.gz 2024-04-25T13:18:11.751 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42568.log 2024-04-25T13:18:11.751 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46766.log.gz 2024-04-25T13:18:11.751 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39891.log 2024-04-25T13:18:11.752 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42568.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz 2024-04-25T13:18:11.752 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45416.log 2024-04-25T13:18:11.752 INFO:teuthology.orchestra.run.smithi052.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42568.log.gz 2024-04-25T13:18:11.752 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.39891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45600.log 2024-04-25T13:18:11.752 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45416.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39891.log.gz 2024-04-25T13:18:11.752 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T13:18:11.752 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45416.log.gz 2024-04-25T13:18:11.752 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45374.log 2024-04-25T13:18:11.753 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45600.log.gz 2024-04-25T13:18:11.753 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T13:18:11.753 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46052.log 2024-04-25T13:18:11.753 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45374.log.gz 2024-04-25T13:18:11.753 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42059.log 2024-04-25T13:18:11.753 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46052.log: 84.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T13:18:11.753 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34390.log 2024-04-25T13:18:11.753 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46052.log.gz 2024-04-25T13:18:11.753 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42907.log 2024-04-25T13:18:11.753 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42059.log.gz 2024-04-25T13:18:11.754 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39849.log 2024-04-25T13:18:11.754 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45768.log 2024-04-25T13:18:11.754 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34390.log.gz 2024-04-25T13:18:11.754 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.39849.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42907.log.gz 2024-04-25T13:18:11.754 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42573.log 2024-04-25T13:18:11.754 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39849.log.gz 2024-04-25T13:18:11.754 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43689.log 2024-04-25T13:18:11.754 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42573.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45768.log.gz 2024-04-25T13:18:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T13:18:11.755 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42573.log.gz 2024-04-25T13:18:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43269.log 2024-04-25T13:18:11.755 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43689.log.gz 2024-04-25T13:18:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42574.log 2024-04-25T13:18:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42908.log 2024-04-25T13:18:11.755 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43269.log.gz 2024-04-25T13:18:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41967.log 2024-04-25T13:18:11.756 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42908.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T13:18:11.756 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.42574.log.gz 2024-04-25T13:18:11.756 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40430.log 2024-04-25T13:18:11.756 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42908.log.gz 2024-04-25T13:18:11.756 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45684.log 2024-04-25T13:18:11.756 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40430.log: gzip 89.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.41967.log.gz --verbose 2024-04-25T13:18:11.756 INFO:teuthology.orchestra.run.smithi052.stderr: -- /var/log/ceph/ceph-client.admin.42311.log 2024-04-25T13:18:11.756 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40430.log.gz 2024-04-25T13:18:11.756 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45332.log 2024-04-25T13:18:11.757 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46094.log 2024-04-25T13:18:11.757 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45684.log.gz 2024-04-25T13:18:11.757 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42311.log.gz 2024-04-25T13:18:11.757 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42185.log 2024-04-25T13:18:11.757 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45332.log.gz 2024-04-25T13:18:11.757 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47088.log 2024-04-25T13:18:11.757 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42185.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46094.log.gz 2024-04-25T13:18:11.757 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47271.log 2024-04-25T13:18:11.757 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42185.log.gz 2024-04-25T13:18:11.758 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.47088.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T13:18:11.758 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47088.log.gz 2024-04-25T13:18:11.758 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.47271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40241.log 2024-04-25T13:18:11.758 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45144.log 2024-04-25T13:18:11.758 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47271.log.gz 2024-04-25T13:18:11.758 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44067.log 2024-04-25T13:18:11.758 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40241.log.gz 2024-04-25T13:18:11.758 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46682.log 2024-04-25T13:18:11.759 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.45144.log: /var/log/ceph/ceph-client.admin.44067.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T13:18:11.759 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46682.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44067.log.gz 2024-04-25T13:18:11.759 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42143.log 2024-04-25T13:18:11.759 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46682.log.gz 2024-04-25T13:18:11.759 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40556.log 2024-04-25T13:18:11.759 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mds.c.log: 89.4% -- replaced with /var/log/ceph/ceph-client.0.45144.log.gz 2024-04-25T13:18:11.759 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46178.log 2024-04-25T13:18:11.759 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40556.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42143.log.gz 2024-04-25T13:18:11.760 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T13:18:11.760 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40556.log.gz 2024-04-25T13:18:11.760 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T13:18:11.760 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46178.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41759.log 2024-04-25T13:18:11.760 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46178.log.gz 2024-04-25T13:18:11.760 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46472.log 2024-04-25T13:18:11.760 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40640.log 2024-04-25T13:18:11.760 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46472.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41759.log.gz 2024-04-25T13:18:11.760 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40514.log 2024-04-25T13:18:11.761 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0%/var/log/ceph/ceph-client.admin.40640.log: -- replaced with /var/log/ceph/ceph-client.admin.46472.log.gz 2024-04-25T13:18:11.761 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T13:18:11.761 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.40514.log: -- /var/log/ceph/ceph-client.admin.43514.log 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40640.log.gz 2024-04-25T13:18:11.761 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-04-25T13:18:11.761 INFO:teuthology.orchestra.run.smithi052.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40598.log 2024-04-25T13:18:11.761 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40514.log.gz 2024-04-25T13:18:11.761 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.43514.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43514.log.gz 2024-04-25T13:18:11.761 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43857.log 2024-04-25T13:18:11.762 INFO:teuthology.orchestra.run.smithi052.stderr: 92.7%gzip -- replaced with /var/log/ceph/ceph-mgr.y.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.43136.log 2024-04-25T13:18:11.762 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-04-25T13:18:11.762 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40598.log: /var/log/ceph/ceph-client.admin.43857.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43857.log.gz 2024-04-25T13:18:11.762 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40598.log.gz 2024-04-25T13:18:11.762 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42912.log 2024-04-25T13:18:11.762 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34654.log 2024-04-25T13:18:11.762 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42912.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43136.log.gz 2024-04-25T13:18:11.762 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42227.log 2024-04-25T13:18:11.763 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42912.log.gz 2024-04-25T13:18:11.763 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47355.log 2024-04-25T13:18:11.763 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34654.log: /var/log/ceph/ceph-client.admin.42227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46640.log 2024-04-25T13:18:11.763 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1%/var/log/ceph/ceph-client.admin.47355.log: -- replaced with /var/log/ceph/ceph-client.admin.42227.log.gz 2024-04-25T13:18:11.763 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34654.log.gz 2024-04-25T13:18:11.763 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47355.log.gz 2024-04-25T13:18:11.763 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42353.log 2024-04-25T13:18:11.763 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43276.log 2024-04-25T13:18:11.763 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42353.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46640.log.gz 2024-04-25T13:18:11.764 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34757.log 2024-04-25T13:18:11.764 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42353.log.gz/var/log/ceph/ceph-client.admin.43276.log: 2024-04-25T13:18:11.764 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43276.log.gz 2024-04-25T13:18:11.764 INFO:teuthology.orchestra.run.smithi052.stderr: -- /var/log/ceph/ceph-client.admin.42567.log 2024-04-25T13:18:11.764 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34757.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34757.log.gz 2024-04-25T13:18:11.764 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41801.log 2024-04-25T13:18:11.764 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43272.log 2024-04-25T13:18:11.764 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42567.log.gz 2024-04-25T13:18:11.764 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41633.log 2024-04-25T13:18:11.765 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41801.log.gz 2024-04-25T13:18:11.765 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40019.log 2024-04-25T13:18:11.765 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43272.log: /var/log/ceph/ceph-client.admin.41633.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T13:18:11.765 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40019.log: 88.4% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43272.log.gz 2024-04-25T13:18:11.765 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41633.log.gz 2024-04-25T13:18:11.765 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40019.log.gz 2024-04-25T13:18:11.765 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46346.log 2024-04-25T13:18:11.765 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-mon.a.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40191.log 2024-04-25T13:18:11.765 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44151.log 2024-04-25T13:18:11.766 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46346.log.gz 2024-04-25T13:18:11.766 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40191.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40191.log.gz 2024-04-25T13:18:11.766 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42576.log 2024-04-25T13:18:11.766 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9%gzip -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T13:18:11.766 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42903.log 2024-04-25T13:18:11.766 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42576.log: /var/log/ceph/ceph-client.admin.44151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43644.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42576.log.gz 2024-04-25T13:18:11.766 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-04-25T13:18:11.766 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42577.log 2024-04-25T13:18:11.767 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44151.log.gz 2024-04-25T13:18:11.767 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6%/var/log/ceph/ceph-client.admin.43644.log: -- replaced with /var/log/ceph/ceph-client.admin.42903.log.gz 2024-04-25T13:18:11.767 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41591.log 2024-04-25T13:18:11.767 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43644.log.gz 2024-04-25T13:18:11.767 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42575.log 2024-04-25T13:18:11.767 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42577.log: /var/log/ceph/ceph-client.admin.41591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39634.log 2024-04-25T13:18:11.767 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42575.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41591.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42577.log.gz 2024-04-25T13:18:11.767 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-04-25T13:18:11.767 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42575.log.gz 2024-04-25T13:18:11.768 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45542.log 2024-04-25T13:18:11.768 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43271.log 2024-04-25T13:18:11.768 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.39634.log: /var/log/ceph/ceph-client.admin.45542.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39634.log.gz 2024-04-25T13:18:11.768 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45542.log.gz 2024-04-25T13:18:11.768 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43941.log 2024-04-25T13:18:11.768 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46262.log 2024-04-25T13:18:11.768 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43271.log: /var/log/ceph/ceph-client.admin.43941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41717.log 2024-04-25T13:18:11.768 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46262.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43271.log.gz 2024-04-25T13:18:11.769 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43941.log.gz 2024-04-25T13:18:11.769 INFO:teuthology.orchestra.run.smithi052.stderr: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.46262.log.gz -5 2024-04-25T13:18:11.769 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47313.log 2024-04-25T13:18:11.769 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39935.log 2024-04-25T13:18:11.769 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41717.log: /var/log/ceph/ceph-client.admin.47313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44235.log 2024-04-25T13:18:11.769 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.39935.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41717.log.gz 2024-04-25T13:18:11.769 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47313.log.gz 2024-04-25T13:18:11.769 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46922.log 2024-04-25T13:18:11.769 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39935.log.gz 2024-04-25T13:18:11.770 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44625.log 2024-04-25T13:18:11.770 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44235.log: /var/log/ceph/ceph-client.admin.46922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42911.log 2024-04-25T13:18:11.770 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44625.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44235.log.gz 2024-04-25T13:18:11.770 INFO:teuthology.orchestra.run.smithi052.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46922.log.gz 2024-04-25T13:18:11.770 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41675.log 2024-04-25T13:18:11.770 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41323.log 2024-04-25T13:18:11.770 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44625.log.gz 2024-04-25T13:18:11.770 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42911.log: /var/log/ceph/ceph-client.admin.41675.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42911.log.gz 2024-04-25T13:18:11.771 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41675.log.gz 2024-04-25T13:18:11.771 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43602.log 2024-04-25T13:18:11.771 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44559.log 2024-04-25T13:18:11.771 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41323.log: /var/log/ceph/ceph-client.admin.43602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40387.log 2024-04-25T13:18:11.771 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44559.log: 89.2% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41323.log.gz 2024-04-25T13:18:11.771 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43602.log.gz 2024-04-25T13:18:11.771 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43267.log 2024-04-25T13:18:11.771 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46430.log 2024-04-25T13:18:11.771 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44559.log.gz 2024-04-25T13:18:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40387.log: /var/log/ceph/ceph-client.admin.43267.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40387.log.gz 2024-04-25T13:18:11.772 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43267.log.gz 2024-04-25T13:18:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46514.log 2024-04-25T13:18:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-25T13:18:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46430.log: /var/log/ceph/ceph-client.admin.46514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40710.log 2024-04-25T13:18:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mds.e.log: 88.7% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46430.log.gz 2024-04-25T13:18:11.772 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46514.log.gz 2024-04-25T13:18:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42395.log 2024-04-25T13:18:11.773 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47130.log 2024-04-25T13:18:11.773 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40710.log: /var/log/ceph/ceph-client.admin.42395.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40710.log.gz 2024-04-25T13:18:11.773 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44277.log 2024-04-25T13:18:11.773 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42395.log.gz 2024-04-25T13:18:11.773 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.47130.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47130.log.gz 2024-04-25T13:18:11.774 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43815.log 2024-04-25T13:18:11.774 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46304.log 2024-04-25T13:18:11.774 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44277.log: /var/log/ceph/ceph-client.admin.43815.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44277.log.gz 2024-04-25T13:18:11.774 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42913.log 2024-04-25T13:18:11.774 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43815.log.gz 2024-04-25T13:18:11.774 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46304.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46304.log.gz 2024-04-25T13:18:11.775 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40345.log 2024-04-25T13:18:11.775 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39553.log 2024-04-25T13:18:11.775 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42913.log: /var/log/ceph/ceph-client.admin.40345.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42913.log.gz 2024-04-25T13:18:11.775 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41407.log 2024-04-25T13:18:11.775 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40345.log.gz 2024-04-25T13:18:11.775 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.39553.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39553.log.gz 2024-04-25T13:18:11.775 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45810.log 2024-04-25T13:18:11.775 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42572.log 2024-04-25T13:18:11.776 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41407.log: /var/log/ceph/ceph-client.admin.45810.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41407.log.gz 2024-04-25T13:18:11.776 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45810.log.gz 2024-04-25T13:18:11.776 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46010.log 2024-04-25T13:18:11.776 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42572.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42572.log.gz 2024-04-25T13:18:11.776 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46598.log 2024-04-25T13:18:11.776 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41533.log 2024-04-25T13:18:11.776 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46010.log: /var/log/ceph/ceph-client.admin.46598.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46010.log.gz 2024-04-25T13:18:11.776 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46598.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45458.log 2024-04-25T13:18:11.776 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-04-25T13:18:11.777 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41533.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41533.log.gz 2024-04-25T13:18:11.777 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40061.log 2024-04-25T13:18:11.777 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43773.log 2024-04-25T13:18:11.777 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45458.log: /var/log/ceph/ceph-client.admin.40061.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45458.log.gz 2024-04-25T13:18:11.777 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40061.log.gz 2024-04-25T13:18:11.777 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47004.log 2024-04-25T13:18:11.777 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43773.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43773.log.gz 2024-04-25T13:18:11.777 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43731.log 2024-04-25T13:18:11.778 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44109.log 2024-04-25T13:18:11.778 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.47004.log: /var/log/ceph/ceph-client.admin.43731.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47004.log.gz 2024-04-25T13:18:11.778 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.43731.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.42900.log 2024-04-25T13:18:11.778 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-04-25T13:18:11.779 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44109.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44109.log.gz 2024-04-25T13:18:11.779 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40103.log 2024-04-25T13:18:11.779 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40472.log 2024-04-25T13:18:11.779 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42900.log: /var/log/ceph/ceph-client.admin.40103.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42900.log.gz 2024-04-25T13:18:11.779 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40147.log 2024-04-25T13:18:11.779 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40103.log.gz 2024-04-25T13:18:11.779 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40472.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40472.log.gz 2024-04-25T13:18:11.779 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T13:18:11.779 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45500.log 2024-04-25T13:18:11.780 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40147.log: /var/log/ceph/ceph-mds.a.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40147.log.gz 2024-04-25T13:18:11.780 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28362.log 2024-04-25T13:18:11.780 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45500.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45500.log.gz 2024-04-25T13:18:11.780 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42101.log 2024-04-25T13:18:11.780 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.tmp-client.admin.28362.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28362.log.gz 2024-04-25T13:18:11.780 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46388.log 2024-04-25T13:18:11.780 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42101.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42101.log.gz 2024-04-25T13:18:11.780 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42269.log 2024-04-25T13:18:11.781 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46388.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46388.log.gz 2024-04-25T13:18:11.781 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41449.log 2024-04-25T13:18:11.781 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42269.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42269.log.gz 2024-04-25T13:18:11.781 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42906.log 2024-04-25T13:18:11.781 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41449.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41449.log.gz 2024-04-25T13:18:11.781 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43472.log 2024-04-25T13:18:11.781 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42906.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42906.log.gz 2024-04-25T13:18:11.781 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43274.log 2024-04-25T13:18:11.781 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43472.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43472.log.gz 2024-04-25T13:18:11.782 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46220.log 2024-04-25T13:18:11.782 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43274.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43274.log.gz 2024-04-25T13:18:11.782 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46962.log 2024-04-25T13:18:11.782 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46220.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46220.log.gz 2024-04-25T13:18:11.782 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39749.log 2024-04-25T13:18:11.782 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46962.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46962.log.gz 2024-04-25T13:18:11.782 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41491.log 2024-04-25T13:18:11.783 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.39749.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39749.log.gz 2024-04-25T13:18:11.783 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41365.log 2024-04-25T13:18:11.783 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41491.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41491.log.gz 2024-04-25T13:18:11.783 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46724.log 2024-04-25T13:18:11.783 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41365.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41365.log.gz 2024-04-25T13:18:11.783 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45726.log 2024-04-25T13:18:11.783 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46724.log: 91.8% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-25T13:18:11.783 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46724.log.gz 2024-04-25T13:18:11.784 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44193.log 2024-04-25T13:18:11.784 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41131.log 2024-04-25T13:18:11.784 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45726.log: /var/log/ceph/ceph-client.admin.44193.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45726.log.gz 2024-04-25T13:18:11.784 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44193.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46556.log 2024-04-25T13:18:11.784 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-04-25T13:18:11.784 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T13:18:11.784 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44025.log 2024-04-25T13:18:11.784 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40283.log 2024-04-25T13:18:11.784 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44025.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46556.log.gz 2024-04-25T13:18:11.785 INFO:teuthology.orchestra.run.smithi052.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.41131.log.gz 2024-04-25T13:18:11.785 INFO:teuthology.orchestra.run.smithi052.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44025.log.gz 2024-04-25T13:18:11.785 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43268.log 2024-04-25T13:18:11.785 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42009.log 2024-04-25T13:18:11.785 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40283.log: /var/log/ceph/ceph-client.admin.43268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41883.log 2024-04-25T13:18:11.785 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42009.log: 89.3% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40283.log.gz 2024-04-25T13:18:11.785 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43268.log.gz 2024-04-25T13:18:11.785 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42009.log.gz 2024-04-25T13:18:11.785 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47226.log 2024-04-25T13:18:11.786 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44427.log 2024-04-25T13:18:11.786 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41883.log: /var/log/ceph/ceph-client.admin.47226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43899.log 2024-04-25T13:18:11.786 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44427.log: 89.4% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41883.log.gz 2024-04-25T13:18:11.786 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47226.log.gz 2024-04-25T13:18:11.786 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43899.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44427.log.gz 2024-04-25T13:18:11.786 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43899.log.gz 2024-04-25T13:18:11.787 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T13:18:11.795 INFO:teuthology.orchestra.run.smithi102.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T13:18:11.862 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T13:18:12.282 INFO:teuthology.orchestra.run.smithi102.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T13:18:12.293 INFO:teuthology.orchestra.run.smithi102.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T13:18:12.301 INFO:teuthology.orchestra.run.smithi052.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T13:18:12.325 INFO:teuthology.orchestra.run.smithi102.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T13:18:12.364 INFO:teuthology.orchestra.run.smithi052.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T13:18:12.381 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T13:18:12.383 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-25T13:18:12.383 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m0.715s 2024-04-25T13:18:12.383 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m2.729s 2024-04-25T13:18:12.383 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m0.120s 2024-04-25T13:18:12.408 INFO:teuthology.orchestra.run.smithi052.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T13:18:12.409 INFO:teuthology.orchestra.run.smithi052.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T13:18:12.412 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-04-25T13:18:12.412 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m0.765s 2024-04-25T13:18:12.412 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m3.040s 2024-04-25T13:18:12.412 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m0.194s 2024-04-25T13:18:12.412 INFO:tasks.ceph:Archiving logs... 2024-04-25T13:18:12.412 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468/remote/smithi052/log 2024-04-25T13:18:12.413 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:18:13.002 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468/remote/smithi102/log 2024-04-25T13:18:13.003 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:18:13.421 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T13:18:13.430 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T13:18:13.431 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:18:13.433 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:18:13.512 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T13:18:13.522 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T13:18:13.523 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:18:13.525 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:18:13.537 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:18:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:18:13.543 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:18:13.543 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-04-25T13:18:13.543 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 +925us[ +920us] +/- 49ms 2024-04-25T13:18:13.543 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 -1531us[-1531us] +/- 56ms 2024-04-25T13:18:13.543 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +526us[ +520us] +/- 64ms 2024-04-25T13:18:13.544 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:18:13.545 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:18:13.545 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-04-25T13:18:13.545 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +931us[ +931us] +/- 49ms 2024-04-25T13:18:13.545 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -1518us[-1518us] +/- 56ms 2024-04-25T13:18:13.545 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +528us[ +528us] +/- 64ms 2024-04-25T13:18:13.546 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:18:13.546 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T13:18:13.559 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T13:18:13.559 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T13:18:13.573 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T13:18:13.649 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T13:18:13.711 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:18:13.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:18:13.738 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:18:13.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:18:13.766 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T13:18:13.775 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T13:18:13.785 INFO:teuthology.task.internal:Duration was 543.200650 seconds 2024-04-25T13:18:13.785 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T13:18:13.797 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T13:18:13.797 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:18:13.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-25T13:18:13.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-04-25T13:18:13.800 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:18:13.835 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:18:13.844 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:18:14.257 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T13:18:14.258 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T13:18:14.258 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:18:14.319 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-04-25T13:18:14.319 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:18:14.344 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T13:18:14.344 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:18:14.361 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:18:14.409 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T13:18:14.410 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:18:14.427 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:18:14.543 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T13:18:14.554 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T13:18:14.554 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:18:14.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:18:14.602 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T13:18:14.612 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:18:14.621 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:18:14.642 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-04-25T13:18:14.664 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-04-25T13:18:14.686 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:18:14.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:18:14.709 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:18:14.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:18:14.740 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T13:18:14.751 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T13:18:14.751 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468/remote/smithi052 2024-04-25T13:18:14.752 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:18:14.789 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468/remote/smithi102 2024-04-25T13:18:14.790 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:18:14.822 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T13:18:14.822 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:18:14.825 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:18:14.870 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T13:18:14.885 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T13:18:14.885 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T13:18:14.902 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T13:18:14.902 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:18:14.905 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:18:14.917 INFO:teuthology.orchestra.run.smithi052.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:18 /home/ubuntu/cephtest 2024-04-25T13:18:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:18 /home/ubuntu/cephtest 2024-04-25T13:18:14.926 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T13:18:14.937 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T13:18:14.962 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T13:18:14.988 DEBUG:teuthology.nuke:shortname: smithi052 2024-04-25T13:18:14.989 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T13:18:15.012 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:03:59.605070', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHN40TN02CFy16TIYygASZdCzCNdeQkDh4GqddIIZ287jmTGqraO2TBL7HUka/rSlKCcEEwg6W3lJLqETzdbRJY='} 2024-04-25T13:18:15.016 DEBUG:teuthology.nuke:shortname: smithi102 2024-04-25T13:18:15.016 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T13:18:15.041 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673468', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:03:59.606861', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKZy4LXCxehu78tYMqjlOJPaioDsGf4zKFv9f4XShIUJlKtDMUwcfom9Gf15eDhO9WOi99hh12CaXLiXF9jv24Q='} 2024-04-25T13:18:15.070 INFO:teuthology.orchestra.console.smithi052:Power off 2024-04-25T13:18:15.070 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T13:18:15.093 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2024-04-25T13:18:15.094 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:15.108 INFO:teuthology.orchestra.console.smithi102:Power off 2024-04-25T13:18:15.109 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T13:18:15.118 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2024-04-25T13:18:15.131 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2024-04-25T13:18:15.131 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:15.153 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-04-25T13:18:19.120 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:19.154 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:19.232 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2024-04-25T13:18:19.265 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-04-25T13:18:23.233 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:23.266 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:23.344 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2024-04-25T13:18:23.374 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-04-25T13:18:23.445 INFO:teuthology.orchestra.console.smithi052:Power off completed 2024-04-25T13:18:27.378 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:27.488 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-04-25T13:18:27.589 INFO:teuthology.orchestra.console.smithi102:Power off completed 2024-04-25T13:18:27.694 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} duration: 543.2006499767303 failure_reason: '''NoneType'' object has no attribute ''get''' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=0f96263e11274a48b2d9ec40b1ce2076 status: fail success: false 2024-04-25T13:18:27.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T13:18:27.779 INFO:teuthology.run:FAIL